-- Logs begin at Mon 2022-06-20 06:18:43 UTC, end at Mon 2022-06-20 07:54:07 UTC. -- Jun 20 06:58:31.176493 dv-cinder-778193-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 06:58:31.188663 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 06:58:31.189857 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 06:58:31 2022] *** Jun 20 06:58:31.189857 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 06:58:31.189857 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 06:58:31.189857 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: nodename: dv-cinder-778193-28-iscsi Jun 20 06:58:31.189857 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: machine: x86_64 Jun 20 06:58:31.189857 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: clock source: unix Jun 20 06:58:31.189857 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: pcre jit disabled Jun 20 06:58:31.189857 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: detected number of CPU cores: 4 Jun 20 06:58:31.189857 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: current working directory: / Jun 20 06:58:31.189857 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: detected binary path: /usr/bin/uwsgi-core Jun 20 06:58:31.190528 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: your processes number limit is 47680 Jun 20 06:58:31.190528 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: your memory page size is 4096 bytes Jun 20 06:58:31.190528 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: detected max file descriptor number: 2048 Jun 20 06:58:31.190528 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: lock engine: pthread robust mutexes Jun 20 06:58:31.190528 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: thunder lock: enabled Jun 20 06:58:31.190528 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 06:58:31.190528 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 06:58:31.233572 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: Python main interpreter initialized at 0x5564c1e019c0 Jun 20 06:58:31.233572 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: python threads support enabled Jun 20 06:58:31.233572 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: your server socket listen backlog is limited to 100 connections Jun 20 06:58:31.233572 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: your mercy for graceful operations on workers is 90 seconds Jun 20 06:58:31.233957 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 06:58:31.234021 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: *** Operational MODE: preforking *** Jun 20 06:58:31.234253 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: *** uWSGI is running in multiple interpreter mode *** Jun 20 06:58:31.234253 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: spawned uWSGI master process (pid: 103240) Jun 20 06:58:31.234460 dv-cinder-778193-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 06:58:31.240136 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: spawned uWSGI worker 1 (pid: 103273, cores: 1) Jun 20 06:58:31.240136 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: spawned uWSGI worker 2 (pid: 103274, cores: 1) Jun 20 06:58:31.240136 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 06:58:31.909864 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 06:58:31.916077 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 06:58:33.036093 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:58:33.036093 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: from cryptography.utils import int_from_bytes Jun 20 06:58:33.036738 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:58:33.036738 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: from cryptography.utils import int_from_bytes Jun 20 06:58:33.149957 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:58:33.149957 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: from cryptography.utils import int_from_bytes Jun 20 06:58:33.150526 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:58:33.150526 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: from cryptography.utils import int_from_bytes Jun 20 06:58:35.488908 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 06:58:35.489454 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 06:58:35.489661 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 06:58:35.490018 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 06:58:35.490271 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 06:58:35.490650 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.490970 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.491285 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.491596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.491787 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 06:58:35.492159 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.492260 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 06:58:35.492358 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.492531 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.492623 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 06:58:35.492842 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.492930 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 06:58:35.493162 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.493268 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 06:58:35.493414 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.493546 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.493721 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.493874 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.494035 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-778193-28-iscsi {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.494204 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.494346 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.494528 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.494646 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.494861 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.494949 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.495175 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.495267 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.495498 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.495584 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.495821 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.495916 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.496143 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.496232 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.496428 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.496638 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.497053 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.497053 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-778193-28-iscsi {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.497284 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.497390 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.497493 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.497649 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.497772 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.497959 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.498080 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.498269 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.498369 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.498574 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.498678 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.498882 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.498968 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.499183 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.499276 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.499498 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.499698 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.499797 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.500010 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.500209 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-778193-28-iscsi {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.500343 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.500523 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.500655 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.501351 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.501516 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.501648 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.501835 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.502048 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.502135 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.502355 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.502458 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.502657 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.502743 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.502970 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.503055 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.503296 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.503394 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.503596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.503735 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-778193-28-iscsi {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.503915 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.504055 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.504252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.504397 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.504570 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.504719 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.504867 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.505133 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.505219 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.505446 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.505542 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.505746 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.505840 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.506061 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.506147 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.506365 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.506467 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.506664 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.506750 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.506911 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.506996 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.507213 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.507309 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.507525 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.507617 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.507836 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.507921 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.508169 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.508321 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.508406 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.508521 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.508656 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.508827 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.508971 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.509142 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.509287 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.509449 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.509588 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.509755 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.509891 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.510006 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.510192 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.510567 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.510748 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.510889 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.511049 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.511211 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.511350 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.511532 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.511650 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.511782 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.511952 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.512039 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.512292 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.512381 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.512604 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.512698 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.512920 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.513013 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.513223 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.513317 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.513536 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.513624 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.513869 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.513962 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.514158 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.514252 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.514459 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.514545 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.514775 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.514867 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.515084 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.515178 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.515387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.515479 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.515699 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.515786 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.516013 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.516126 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.516342 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.516429 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.517194 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.517284 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.517497 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.517599 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.517811 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.517897 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.518136 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.518228 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.518435 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.518520 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.518680 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.518780 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.518978 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.519088 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.519276 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.519374 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.519589 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.519698 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.519889 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.520009 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.520214 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.520348 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.520516 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.520660 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.520812 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.520982 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.521113 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.521315 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.521402 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.521624 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.521710 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.521876 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.521971 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.522178 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.522270 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.522485 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.522581 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.522804 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.522899 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.523111 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.523198 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.523412 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.523497 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.523717 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.523803 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.524019 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.524124 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.524351 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.524438 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.524648 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.524734 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.524948 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.525044 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.525248 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.525335 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.525551 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.525645 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.525852 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.525937 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.526158 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.526243 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.526460 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.526561 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.526760 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.526846 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.527058 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.527145 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.527370 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.527469 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.527671 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.527765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.527973 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.528068 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.528305 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.528403 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.528601 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.528691 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.528900 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.529002 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.529214 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.529313 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.529513 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.529599 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.529811 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.529907 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.530109 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.530196 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.530407 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.530503 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.530704 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.530799 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.531001 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.531096 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.531299 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.531385 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.531595 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.531757 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.531890 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.531977 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.532239 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.532331 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.532559 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.532663 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.532861 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.532946 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.533163 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.533257 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.533465 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.533551 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.533768 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.533863 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.534073 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.534160 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.534378 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.534466 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.534690 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.534784 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.534995 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.535082 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.535295 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.535390 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.535610 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.535697 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.535929 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.536016 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.536261 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.536349 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.536569 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.536668 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.536878 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.536972 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.537183 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.537276 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:58:35.537491 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.537579 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.537800 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.537898 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.538114 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.538200 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.538427 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.538515 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.538750 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.538849 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.539062 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.539148 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.539376 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.539481 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.539687 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.539783 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.539994 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.540084 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.540333 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.540477 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.540659 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.540756 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.540971 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.541064 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.541277 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.541362 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.541596 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.541695 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.541918 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.542017 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.542231 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.542319 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.542550 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.542638 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.542866 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.542953 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.543172 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.543259 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.543477 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.543565 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.543783 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.543871 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.544099 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.544208 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.544445 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.544532 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.544749 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.544835 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.545065 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.545152 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.545372 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.545460 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.545676 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.545763 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.545982 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.546139 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.546294 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.546388 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.546597 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.546683 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.546927 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.547029 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.547236 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.547329 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.547545 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.547632 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.547902 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.548000 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.548237 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.548338 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.548548 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.548635 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.548855 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.548954 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.549159 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.549253 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.549461 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.549559 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.549759 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.549848 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.550059 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.550147 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.550362 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.550449 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.550661 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.550751 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.550973 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.551059 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.551294 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.551380 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.551595 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.551694 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.551905 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.552003 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.552231 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.552334 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.552540 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.552629 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.552844 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.552930 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.553147 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.553247 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.553451 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.553544 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.553755 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.553841 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.554056 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.554223 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.554356 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.554443 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.554676 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.554764 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.554981 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.555078 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.555282 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.555369 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.555598 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.555686 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.555898 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.555997 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.556226 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.556318 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.556538 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.556625 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.556844 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.556931 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.557146 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.557231 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.557451 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.557538 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.557754 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.557842 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.558070 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.558163 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.558379 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.558466 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.558686 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.558773 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.559013 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.559099 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.559322 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.559408 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.559626 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.559723 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.559937 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.560022 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.560278 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.560381 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.560589 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.560672 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.560891 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.560977 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.561196 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.561291 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.561497 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.561593 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.561796 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.561882 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.562095 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.562201 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.562398 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.562493 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.562697 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.562785 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.562996 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.563091 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.563808 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.564152 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.564242 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.564441 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.564542 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.564759 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.564848 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.565063 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.565239 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.565381 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.565567 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.565656 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.565878 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.565972 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.566186 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.566273 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.566497 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.566592 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.566811 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.566900 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.567119 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.567205 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.567427 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.567525 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.567734 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.567822 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.568040 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.568159 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.568384 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.568480 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.568696 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.568781 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.569005 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.569102 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.569309 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.569396 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.569631 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.569765 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.569922 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.570019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.570225 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.570311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.570540 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.570639 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.570845 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.570948 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.571161 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.571247 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.571473 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.571596 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.571785 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.571893 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.572086 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.572222 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.572418 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.572504 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.572752 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.572852 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.573069 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.573155 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.573377 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.573471 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.573690 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.573784 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.573996 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.574089 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.574305 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.574391 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.574885 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.574979 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.575197 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.575291 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.575501 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.575587 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.575807 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.575895 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.576132 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.576223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.576452 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.576550 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.576764 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.576851 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.577071 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.577158 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.577387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.577482 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.577692 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.577786 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.578007 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.578093 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.578308 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.578404 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.578615 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.578709 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.578979 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.579610 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.579811 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.579906 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.580128 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.580217 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.580444 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.580531 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.580762 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.580900 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.581071 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.581158 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.581376 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.581463 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.581683 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.581772 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.581984 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.582071 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.582285 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.582380 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.582592 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.582681 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.582901 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.582996 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.583206 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.583293 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.583512 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.583608 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.583814 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.583900 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.584147 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.584239 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.584450 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.584540 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.584752 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.584865 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.585053 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.585182 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.585359 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.585501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.585674 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.585816 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.585980 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.586130 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.586304 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.586439 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.586622 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.586754 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.586924 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.587073 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.587224 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.587386 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.587542 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.587700 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.587846 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.588011 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.588172 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.588360 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.588475 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.588674 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.588773 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.588984 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.589101 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.589292 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.589411 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.589652 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.589757 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.589933 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.590020 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.590248 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.590342 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.590574 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.590670 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.590900 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.590988 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.591206 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.591304 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.591512 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.591606 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.591827 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.591913 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.592156 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.592248 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.592465 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.592553 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.592770 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.592855 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.593075 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.593160 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.593382 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.593471 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.593688 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.593775 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.594006 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.594094 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.594311 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.594398 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.594639 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.594725 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.594944 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.595031 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.595245 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.595334 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.595550 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.595636 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.595863 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.595959 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.596257 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.596453 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.596577 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.596781 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.596883 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.597092 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.597180 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.597403 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.597498 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.597718 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.597805 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.598030 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.598170 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.598354 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.598449 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.598673 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.598767 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.599008 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.599095 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.599307 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.599407 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.599612 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.599699 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.599912 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.600008 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.600234 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.600326 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.600544 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.600810 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.600908 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.601133 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.601220 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.601433 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.601521 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.601736 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.601837 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.602035 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.602122 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.602334 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.602422 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.602632 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.602733 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.602931 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.603018 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.603238 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.603333 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.603536 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.603634 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.603840 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.603928 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.604156 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.604246 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.604477 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.604564 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.604780 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.604870 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.605078 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.605172 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.605375 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.605463 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.605672 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.605769 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.606006 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.606094 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.606310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.606404 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.606616 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.606704 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.606923 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.607010 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.607228 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.607323 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.607543 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.607636 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.607844 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.607938 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.608182 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.608396 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.608483 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.608562 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.608769 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.608857 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.609067 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.609164 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.609371 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.609459 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.609674 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.609773 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.609972 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.610063 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.610299 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.610430 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.610604 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.610742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.610909 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.611083 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.611213 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.611413 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.611513 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.611756 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.611857 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.612065 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.612229 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.612396 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.612482 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.612699 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.612796 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.612999 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.613087 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.613297 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.613384 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.613600 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.613694 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.613900 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.613996 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.614197 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.614285 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.614499 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.614592 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.614793 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.614878 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.615104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.615191 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.615405 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.615493 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.615702 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.615789 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.616000 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.616088 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.616337 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.616427 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.616641 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.616727 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.616938 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.617033 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.617257 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.617342 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.617562 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.617656 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.617862 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.617958 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.618164 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.618252 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.618469 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.618559 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.618769 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.618866 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.619067 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.619162 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.619371 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.619456 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.619685 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.619780 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.619989 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.620073 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.620311 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.620399 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.620617 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.620711 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.620914 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.620999 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.621211 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.621298 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.621511 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.621607 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.621814 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.621908 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.622111 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.622198 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.622408 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.622497 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.622705 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.622792 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.623003 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.623092 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.623301 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.623389 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.623604 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.623696 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.623908 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.624003 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.624231 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.624323 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.624532 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.624619 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.624829 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.624937 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.625151 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.625237 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.625450 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.625544 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.626253 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.626355 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.626580 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.626667 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.626891 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.626977 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.627194 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.627293 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.627497 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.627591 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.627799 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.627885 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.628102 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.628210 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.628424 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.628513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.628733 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.628828 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.629037 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.629125 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.629339 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.629425 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.629635 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.629722 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.629933 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.630021 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.630247 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.630332 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.630553 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.630640 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.630858 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.630946 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.631174 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.631261 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.631490 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.631589 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.631808 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.631901 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.632132 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.632221 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.632430 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.632530 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.632738 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.632825 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.633041 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.633126 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.633341 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.633435 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.633644 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.633739 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.633949 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.634041 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.634252 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.634347 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.634556 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.634642 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.634858 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.634951 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.635165 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.635514 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.635721 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.635808 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.636027 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.636133 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.636354 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.636443 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.636657 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.636743 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.636975 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.637062 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.637281 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.637370 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.637580 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.637668 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.637883 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.637969 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.638182 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.638270 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.638489 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.638626 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.638783 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.638870 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.639104 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.639192 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.639417 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.639504 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.639730 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.639830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.640043 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.640186 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.640377 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.640501 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.640681 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.640785 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.640988 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.641074 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.641293 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.641380 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.642139 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.642241 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.642463 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.642550 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.642770 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.642857 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.643081 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.643177 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.643388 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.643484 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.643701 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.643788 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.644006 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.644092 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.644337 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.644459 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.644657 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.644773 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.644959 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.645084 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.645258 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.645391 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.645557 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.645703 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.645873 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.646022 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.646171 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.646338 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.646486 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.646653 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.646899 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.646987 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.647204 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.647362 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.647502 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.647673 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.647906 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.647993 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.648234 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.648326 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.648540 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.648638 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.648856 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.648944 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.649171 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.649262 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.649486 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.649583 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.649785 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.649872 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.650086 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.650171 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.650388 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.650486 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.650707 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.650797 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.651007 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.651093 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.651317 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.651404 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.651626 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.651758 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.651925 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.652020 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.652265 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.652373 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.652584 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.652738 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.652891 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.653048 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.653208 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.653359 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.653613 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.653703 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.653930 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.654018 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.654234 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.654323 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.654548 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.654637 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.654869 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.654965 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.655171 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.655265 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.655472 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.655561 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.655777 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.655865 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.656077 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.656208 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.656401 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.656490 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.656722 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.656809 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.657040 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.657140 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.657354 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.657442 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.657660 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.657748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.657963 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.658060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.658261 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.658384 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.658559 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.658708 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.658874 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.659022 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.659176 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.659342 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.659493 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.659669 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.659802 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.659975 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.660132 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.660306 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.660461 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.660618 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.660762 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.660924 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.661077 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.661229 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.661382 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.661551 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.661681 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.661856 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.661980 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.662168 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.662280 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.662478 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.662614 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.662791 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.662914 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.663097 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.663213 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.663404 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.663535 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.663727 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.663857 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.664034 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.664205 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.664384 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.664537 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.664702 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.664857 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.665022 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.665168 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.665345 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.665481 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.665653 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.665802 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.666064 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.666153 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.666379 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.666478 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.666686 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.666773 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.666985 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.667082 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.667283 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.667371 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.667582 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.667669 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.667884 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.667980 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.668204 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.668296 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.668505 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.668593 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.668804 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.668951 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.669122 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.669211 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.669421 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.669509 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.669736 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.669826 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.670039 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.670135 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.670338 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.670426 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.670637 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.670726 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.670933 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.671028 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.671266 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.671361 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.671563 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.671659 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.671888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.671975 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.672214 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.672305 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.672526 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.672615 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.673348 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.673437 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.673651 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.673751 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.673954 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.674041 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.674257 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.674344 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.674563 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.674659 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.674874 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.674961 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.675180 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.675266 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.675489 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.675586 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.675794 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.675881 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.676101 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.676214 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.676427 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.676528 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.676736 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.676825 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.677044 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.677131 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.677363 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.677524 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.677689 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.677874 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.678012 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.678196 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.678340 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.678506 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.678649 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.678815 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.678975 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.679124 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.679293 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.679432 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.679607 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.679740 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.679923 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.680048 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.680341 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.680431 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.680658 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.680746 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.680961 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.681060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.681278 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.681367 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.681587 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.681683 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.681904 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.682001 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.682220 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.682308 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.682531 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.682617 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.682840 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.683051 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.683140 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.683384 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.683473 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.683702 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.683798 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.684021 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.684164 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.684362 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.684450 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.684680 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.684781 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.684988 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.685075 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.685299 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.685396 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.685608 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.685705 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.685914 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.686002 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.686223 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.686318 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.686532 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.686628 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.686839 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.686927 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.687148 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.687236 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.687458 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.687548 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.687769 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.687856 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.688087 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.688209 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.688971 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.689105 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.689288 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.689374 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.689597 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.689694 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.689908 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.690006 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.690220 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.690308 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.690544 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.690730 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.690864 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.691041 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.691182 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.691368 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.691498 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.691688 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.691811 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.692016 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.692133 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.692355 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.692447 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.692671 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.692748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.692992 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.693078 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.693295 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.693385 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.693594 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.693672 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.693900 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.693977 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.694205 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.694291 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.694506 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.694583 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.694824 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.694900 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.695129 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.695215 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.695428 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.695512 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.695743 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.696001 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.696087 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.696353 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.696589 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.696689 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.696937 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.697030 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.697265 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.697356 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.697587 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.697677 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.697910 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.698008 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.698225 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.698314 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.698530 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.698626 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.698842 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.698938 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.699145 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.699280 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.699448 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.699545 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.699754 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.699849 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.700058 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.700175 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.700386 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.700482 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.700689 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.700824 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.700996 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.701085 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.701302 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.701389 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.701602 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.701834 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.701913 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.702186 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.702273 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.702506 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.702593 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.702808 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.702892 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.703111 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.703188 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.703413 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.703503 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.703721 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.703798 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.704044 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.704147 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.704372 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.704463 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.704676 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.704753 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.704974 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.705051 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.705286 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.705365 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.705590 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.705666 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.706260 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.706347 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.706417 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.706483 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.706556 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.706631 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.706764 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.706920 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.707067 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.707144 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.707376 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.707477 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.707703 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.707802 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.708004 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.708100 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.708331 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.708421 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.708635 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.708736 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.708940 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.709027 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.709242 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.709378 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.709547 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.709637 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.709848 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.709935 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.710149 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.710236 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.710461 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.710552 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.710766 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.710994 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.711090 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.711323 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.711420 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.711639 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.711727 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.711951 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.712038 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.712286 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.712390 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.712616 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.712705 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.712921 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.713009 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.713224 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.713313 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.713524 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.713612 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.713834 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.713921 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.714141 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.714230 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.714446 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.714534 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.714750 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.714838 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.715055 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.715144 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.715361 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.715458 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.715665 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.715762 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.715969 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.716254 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.716348 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.716592 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.716690 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.716897 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.716987 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.717206 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.717301 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.717512 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.717612 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.717818 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.717909 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.718148 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.718235 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.718458 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.718553 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.718768 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.718864 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.719080 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.719169 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.719391 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.719486 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.719719 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.719814 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.720024 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.720128 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.720363 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.720467 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.720667 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.720755 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.720979 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.721115 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.721289 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.721390 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.721599 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.721687 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.721899 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.721995 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.722208 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.722297 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.722518 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.722613 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.722829 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.722916 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.723148 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.723237 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.723489 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.723577 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.723803 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.723889 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.724128 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.724220 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.724448 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.724536 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.724762 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.724863 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.725070 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.725158 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.725380 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.725466 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.725693 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.725795 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.726005 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.726132 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.726323 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.726412 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.726625 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.726723 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.726927 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.727015 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.727234 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.727331 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.727544 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.727659 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.727859 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.727964 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.728191 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.728306 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.728495 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.728592 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.728793 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.728908 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.729096 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.729232 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.729395 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.729556 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.729695 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.729871 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.729993 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.730195 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.730293 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.730509 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.730598 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.730842 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.730931 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.731157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.731245 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.731457 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.731546 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.731757 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.731852 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.732056 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.732160 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.732381 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.732470 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.732686 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.732775 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.732983 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.733072 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.733280 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.733369 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.733581 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.733678 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.733881 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.733978 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.734179 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.734267 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.734500 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.734595 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.734807 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.734902 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.735114 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.735735 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.735946 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.736129 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.736278 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.736371 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.736578 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.736673 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.736878 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.736974 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.737182 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.737269 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.737487 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.737575 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.737796 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.737888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.738098 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.738193 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.738402 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.738489 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.738712 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.738801 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.739063 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.739157 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.739323 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.739410 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.739626 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.739721 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.739928 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.740015 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.740255 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.740347 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.740578 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.740669 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.740898 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.740987 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.741198 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.741296 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.741519 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.741614 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.741832 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.741927 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.742144 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.742239 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.742456 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.742544 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.742761 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.742849 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.743086 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.743181 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.743390 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.743484 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.743694 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.743789 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.744005 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.744095 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.744335 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.744426 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.744643 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.744730 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.744952 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.745041 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.745262 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.745351 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.745582 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.745669 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.745904 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.745993 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.746207 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.746339 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.746526 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.746618 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.746847 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.746935 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.747173 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.747260 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.747479 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.747575 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.747800 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.747887 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.748132 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.748225 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.748454 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.748555 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.748761 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.748850 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.749062 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.749150 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.749301 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 06:58:35.749399 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.749686 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.750000 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.750316 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.750634 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.751496 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.751822 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.752173 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.752490 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.752820 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.753149 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.753499 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.753815 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.754160 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.754491 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.754811 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.755126 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.755433 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:58:35.755677 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 06:58:35.905424 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO dbcounter [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] Registered counter for database nova_api Jun 20 06:58:35.914974 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO dbcounter [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Registered counter for database nova_api Jun 20 06:58:35.927004 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG oslo_db.sqlalchemy.engines [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:58:35.933597 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG dbcounter [-] [103273] Writer thread running {{(pid=103273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:58:35.935231 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_db.sqlalchemy.engines [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:58:35.942413 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writer thread running {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:58:35.990656 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.context [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2fa5826d-163d-47a7-aeb4-e55abc7a6a21(cell1) {{(pid=103273) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 06:58:35.994535 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG oslo_concurrency.lockutils [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:58:35.996067 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG oslo_concurrency.lockutils [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:58:35.996879 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG oslo_concurrency.lockutils [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:58:35.998782 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG oslo_concurrency.lockutils [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:58:35.999209 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.context [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2fa5826d-163d-47a7-aeb4-e55abc7a6a21(cell1) {{(pid=103274) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 06:58:36.000782 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO dbcounter [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] Registered counter for database nova_cell0 Jun 20 06:58:36.003801 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:58:36.005331 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO dbcounter [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] Registered counter for database nova_cell1 Jun 20 06:58:36.005429 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:58:36.006189 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:58:36.008314 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:58:36.010505 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO dbcounter [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Registered counter for database nova_cell0 Jun 20 06:58:36.013387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG oslo_db.sqlalchemy.engines [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:58:36.014731 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO dbcounter [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Registered counter for database nova_cell1 Jun 20 06:58:36.015093 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG oslo_db.sqlalchemy.engines [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:58:36.020076 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG dbcounter [-] [103273] Writer thread running {{(pid=103273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:58:36.022013 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_db.sqlalchemy.engines [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:58:36.024763 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_db.sqlalchemy.engines [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:58:36.028593 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writer thread running {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:58:36.157783 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG dbcounter [-] [103273] Writer thread running {{(pid=103273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:58:36.167437 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO dbcounter [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] Registered counter for database nova_cell0 Jun 20 06:58:36.168361 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writer thread running {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:58:36.176604 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG oslo_db.sqlalchemy.engines [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:58:36.178983 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO dbcounter [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Registered counter for database nova_cell0 Jun 20 06:58:36.180853 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG dbcounter [-] [103273] Writer thread running {{(pid=103273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:58:36.187474 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_db.sqlalchemy.engines [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:58:36.191840 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writer thread running {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:58:36.522379 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: WARNING keystonemiddleware.auth_token [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:58:36.529594 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: WARNING keystonemiddleware.auth_token [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:58:36.534822 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: WARNING keystonemiddleware.auth_token [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:58:36.541926 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: WARNING keystonemiddleware.auth_token [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:58:36.866650 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: WARNING keystonemiddleware.auth_token [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:58:36.872505 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: WARNING keystonemiddleware.auth_token [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:58:36.877763 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5564c1e019c0 pid: 103274 (default app) Jun 20 06:58:36.879797 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:58:36.880371 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: WARNING keystonemiddleware.auth_token [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:58:36.881020 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001744 Jun 20 06:58:36.881430 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Mon Jun 20 06:58:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:58:36.886594 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: WARNING keystonemiddleware.auth_token [None req-831eaf1a-3830-42cd-8342-c4477872bdfc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:58:36.892006 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5564c1e019c0 pid: 103273 (default app) Jun 20 06:59:51.170152 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:59:51.171172 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 Jun 20 06:59:51.171574 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 06:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:59:51.184066 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG dbcounter [-] [103273] Writing DB stats nova_api:SELECT=3 {{(pid=103273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:59:51.185070 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG dbcounter [-] [103273] Writing DB stats nova_cell0:SELECT=3 {{(pid=103273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:59:51.186294 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG dbcounter [-] [103273] Writing DB stats nova_cell1:SELECT=3 {{(pid=103273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:59:51.187402 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG dbcounter [-] [103273] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:59:51.624573 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-b5a3bf12-a842-4e21-be89-29431aa88161 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:59:51.657930 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-b5a3bf12-a842-4e21-be89-29431aa88161 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.479292 Jun 20 06:59:51.658673 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Mon Jun 20 06:59:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:59:53.734547 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:59:53.735542 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-dcd4ca35-c2f3-4e51-909a-c727d931614b None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 20 06:59:53.735930 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 06:59:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:59:53.796893 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-1d5f5bf3-132d-41c4-84ec-7d2f8c9137f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "os-flavor-access:is_public": true, "swap": 0, "ram": 256, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:59:53.814716 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:59:53.814716 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: warnings.warn(msg) Jun 20 06:59:53.846746 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-1d5f5bf3-132d-41c4-84ec-7d2f8c9137f0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104920 Jun 20 06:59:53.847723 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 06:59:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:59:53.862239 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_api:SELECT=3 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:59:53.863313 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_cell0:SELECT=3 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:59:53.864679 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_cell1:SELECT=3 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:59:53.865526 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:59:54.074813 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-201fd4d8-7f1a-4847-9db6-eee77ef2c45d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:59:54.077664 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:59:54.077664 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: warnings.warn(msg) Jun 20 06:59:54.143120 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-201fd4d8-7f1a-4847-9db6-eee77ef2c45d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286792 Jun 20 06:59:54.144084 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Mon Jun 20 06:59:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:59:56.229954 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-1d5f5bf3-132d-41c4-84ec-7d2f8c9137f0 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:59:56.230984 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-1d5f5bf3-132d-41c4-84ec-7d2f8c9137f0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 20 06:59:56.231387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 06:59:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:59:56.336013 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-7d68c0d0-2f8c-4892-9e2a-9b0ecc5bb1ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "name": "ds512M"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:59:56.358949 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:59:56.358949 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: warnings.warn(msg) Jun 20 06:59:56.373115 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-7d68c0d0-2f8c-4892-9e2a-9b0ecc5bb1ea admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135320 Jun 20 06:59:56.373678 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 06:59:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:59:56.386045 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-f8e36cfa-054d-4926-aa05-bc7c0eb2f88b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:59:56.387745 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:59:56.387745 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: warnings.warn(msg) Jun 20 06:59:56.420395 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-f8e36cfa-054d-4926-aa05-bc7c0eb2f88b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037417 Jun 20 06:59:56.421121 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Mon Jun 20 06:59:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:59:58.487341 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-7d68c0d0-2f8c-4892-9e2a-9b0ecc5bb1ea admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:59:58.489146 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-7d68c0d0-2f8c-4892-9e2a-9b0ecc5bb1ea admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002403 Jun 20 06:59:58.489765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 06:59:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:59:58.555805 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-2102f6f6-beee-427d-abdb-89ad9990b8e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "disk": 10, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:59:58.575001 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-2102f6f6-beee-427d-abdb-89ad9990b8e2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078417 Jun 20 06:59:58.576351 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 06:59:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:59:58.588119 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-4d6cced8-a8f9-4fba-8473-3f287153fc67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:59:58.613217 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-4d6cced8-a8f9-4fba-8473-3f287153fc67 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028998 Jun 20 06:59:58.624154 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Mon Jun 20 06:59:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:00:00.714110 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-2102f6f6-beee-427d-abdb-89ad9990b8e2 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:00.715135 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-2102f6f6-beee-427d-abdb-89ad9990b8e2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 20 07:00:00.715538 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 07:00:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:00.777265 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-1919a1bf-889e-4753-9361-c55c644d18d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:00.795369 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-1919a1bf-889e-4753-9361-c55c644d18d7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073887 Jun 20 07:00:00.795921 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 07:00:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:00:00.807539 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-ada251b7-5c85-40a0-99e6-4ba4acc25a3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:00.830447 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-ada251b7-5c85-40a0-99e6-4ba4acc25a3d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026529 Jun 20 07:00:00.831005 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Mon Jun 20 07:00:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:00:02.933380 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-1919a1bf-889e-4753-9361-c55c644d18d7 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:02.934425 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-1919a1bf-889e-4753-9361-c55c644d18d7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 20 07:00:02.935092 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 07:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:02.994885 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-359c92bb-4efb-43bd-b0e7-4e145b4eabbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4}} {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:03.016057 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-359c92bb-4efb-43bd-b0e7-4e145b4eabbe admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075032 Jun 20 07:00:03.016800 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 07:00:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:00:03.036569 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-d28c159a-57e3-4358-8de4-ead1ee9202d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:03.060033 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-d28c159a-57e3-4358-8de4-ead1ee9202d4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027313 Jun 20 07:00:03.060641 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Mon Jun 20 07:00:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:00:05.151926 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-359c92bb-4efb-43bd-b0e7-4e145b4eabbe admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:05.153096 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-359c92bb-4efb-43bd-b0e7-4e145b4eabbe admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jun 20 07:00:05.153654 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 07:00:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:05.219964 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-d6c7a80f-7dcd-4dcc-97e3-0407a3be91ce admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:05.245905 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-d6c7a80f-7dcd-4dcc-97e3-0407a3be91ce admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086377 Jun 20 07:00:05.247287 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Mon Jun 20 07:00:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:00:07.332326 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-359c92bb-4efb-43bd-b0e7-4e145b4eabbe admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:07.333666 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-359c92bb-4efb-43bd-b0e7-4e145b4eabbe admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001949 Jun 20 07:00:07.334210 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 07:00:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:07.396926 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-538bc12a-d38d-440b-8f43-ad8a70d9c6dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "vcpus": 1, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:07.415925 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-538bc12a-d38d-440b-8f43-ad8a70d9c6dc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073855 Jun 20 07:00:07.416501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 07:00:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:00:07.428635 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-6c6978b5-f18f-4aab-802c-8dc5fb323163 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:07.452726 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-6c6978b5-f18f-4aab-802c-8dc5fb323163 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027621 Jun 20 07:00:07.453481 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Mon Jun 20 07:00:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:00:09.595234 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-538bc12a-d38d-440b-8f43-ad8a70d9c6dc admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:09.596265 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-538bc12a-d38d-440b-8f43-ad8a70d9c6dc admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 20 07:00:09.596666 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 07:00:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:09.655008 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-8116c44a-33ca-4520-b17f-81a59d53ba74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "name": "m1.small", "vcpus": 1}} {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:09.673241 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-8116c44a-33ca-4520-b17f-81a59d53ba74 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070621 Jun 20 07:00:09.673835 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 07:00:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:00:09.687211 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-4ba51130-f63e-420c-b756-13be0a09a255 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:09.714453 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-4ba51130-f63e-420c-b756-13be0a09a255 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032215 Jun 20 07:00:09.715040 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Mon Jun 20 07:00:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:00:12.331697 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-8116c44a-33ca-4520-b17f-81a59d53ba74 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:12.332782 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-8116c44a-33ca-4520-b17f-81a59d53ba74 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 20 07:00:12.333186 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 07:00:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:12.396097 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-5308708d-856f-4196-8b31-5646183eb971 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:12.415883 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-5308708d-856f-4196-8b31-5646183eb971 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076566 Jun 20 07:00:12.416663 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 07:00:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:00:12.430421 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-87fd6042-3508-4a2b-b3fc-7a89ff6d51bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:12.457301 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-87fd6042-3508-4a2b-b3fc-7a89ff6d51bf admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031577 Jun 20 07:00:12.457962 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Mon Jun 20 07:00:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:00:14.553426 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-5308708d-856f-4196-8b31-5646183eb971 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:14.554445 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-5308708d-856f-4196-8b31-5646183eb971 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 20 07:00:14.554851 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 07:00:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:14.612364 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-e1ab70d0-2d80-49b2-a70c-51ae80811845 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192}} {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:14.630946 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-e1ab70d0-2d80-49b2-a70c-51ae80811845 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069777 Jun 20 07:00:14.631497 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 07:00:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:00:14.643971 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-e2895923-4543-446d-b3e4-9abd3cd9f30b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:14.666570 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-e2895923-4543-446d-b3e4-9abd3cd9f30b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026310 Jun 20 07:00:14.667147 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Mon Jun 20 07:00:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:00:16.770613 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-e1ab70d0-2d80-49b2-a70c-51ae80811845 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:16.771715 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-e1ab70d0-2d80-49b2-a70c-51ae80811845 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jun 20 07:00:16.772474 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 07:00:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:16.832754 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-d3a0b097-9b9b-464a-ba2e-a32d3cb20e55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:16.857159 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-d3a0b097-9b9b-464a-ba2e-a32d3cb20e55 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077834 Jun 20 07:00:16.857739 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 07:00:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:00:16.871250 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-c7350cea-a184-4417-a968-056660360f3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:16.894553 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-c7350cea-a184-4417-a968-056660360f3a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028634 Jun 20 07:00:16.895326 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Mon Jun 20 07:00:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:00:41.007441 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-d3a0b097-9b9b-464a-ba2e-a32d3cb20e55 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:41.008741 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-d3a0b097-9b9b-464a-ba2e-a32d3cb20e55 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jun 20 07:00:41.009143 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 07:00:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:41.019613 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG dbcounter [-] [103273] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:00:41.068279 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-83ec2218-617c-4ea1-874c-a756efcf1f75 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:41.084598 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-83ec2218-617c-4ea1-874c-a756efcf1f75 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069483 Jun 20 07:00:41.085123 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Mon Jun 20 07:00:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:00:41.996743 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-d3a0b097-9b9b-464a-ba2e-a32d3cb20e55 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:41.997754 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-d3a0b097-9b9b-464a-ba2e-a32d3cb20e55 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 20 07:00:41.998161 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 07:00:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:42.187585 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-a9945e63-b543-452d-8fde-2451d62665c1 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:42.193158 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.wsgi [None req-a9945e63-b543-452d-8fde-2451d62665c1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-a9945e63-b543-452d-8fde-2451d62665c1 admin admin] Request method failure captured: Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Accept: application/json Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Accept-Encoding: gzip, deflate Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Connection: keep-alive Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Content-Length: 0 Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Host: 10.222.0.23 Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Openstack-Api-Version: compute 2.90 Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Openstack-System-Scope: None Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: User-Agent: python-novaclient Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Auth-Token: gAAAAABisBsZ21YnuMtq6VO-zZ6Z1w0Kg5EZ6NcM4_K2VTJrOeNJHlUYXJVpziEjE7VLRPvN7m_O0_iXBtWIvhYqkNBbiUcvROuy1G_S6cOG0YErxezNshHGdnbqYTCN5OPWv9OzrlQy5P1n0zkdTJj2ziTGk8k-KT3F-L9_HWqDiIOJceL-Wyo Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Domain-Id: None Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Domain-Name: None Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Identity-Status: Confirmed Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Is-Admin-Project: True Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Project-Domain-Id: default Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Project-Domain-Name: Default Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Project-Id: 649b350e7f364263b37fbd34d0f07b2b Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Project-Name: admin Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Role: admin,member,reader Jun 20 07:00:42.196409 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Roles: admin,member,reader Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Tenant: admin Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Tenant-Id: 649b350e7f364263b37fbd34d0f07b2b Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Tenant-Name: admin Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User: admin Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User-Domain-Id: default Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User-Domain-Name: Default Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User-Id: 1ecb0c12822b4be89d3c7e17c8adfe7e Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User-Name: admin Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: method: > Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: exception: Flavor 42 could not be found. Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: action_args: {'id': '42'} Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:00:42.198019 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:00:42.199700 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:42.201157 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-a9945e63-b543-452d-8fde-2451d62665c1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:00:42.202449 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-a9945e63-b543-452d-8fde-2451d62665c1 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059744 Jun 20 07:00:42.202449 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Jun 20 07:00:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 20 07:00:42.207928 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-c50d971c-1428-49f2-92f2-b4eb09202f07 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:42.210957 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:00:42.230405 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-c50d971c-1428-49f2-92f2-b4eb09202f07 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026050 Jun 20 07:00:42.230954 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Jun 20 07:00:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:00:42.240470 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-d38b203d-50e2-4b24-a0f6-fc24b347a8e6 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:42.263950 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-d38b203d-50e2-4b24-a0f6-fc24b347a8e6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026983 Jun 20 07:00:42.264516 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Jun 20 07:00:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:00:42.275292 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-9d2f2a59-2c9d-4244-8e2b-409acb471f47 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:42.281473 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.wsgi [None req-9d2f2a59-2c9d-4244-8e2b-409acb471f47 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-9d2f2a59-2c9d-4244-8e2b-409acb471f47 admin admin] Request method failure captured: Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Accept: application/json Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Accept-Encoding: gzip, deflate Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Connection: keep-alive Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Content-Length: 0 Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Host: 10.222.0.23 Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Openstack-Api-Version: compute 2.90 Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Openstack-System-Scope: None Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: User-Agent: python-novaclient Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Auth-Token: gAAAAABisBsZ21YnuMtq6VO-zZ6Z1w0Kg5EZ6NcM4_K2VTJrOeNJHlUYXJVpziEjE7VLRPvN7m_O0_iXBtWIvhYqkNBbiUcvROuy1G_S6cOG0YErxezNshHGdnbqYTCN5OPWv9OzrlQy5P1n0zkdTJj2ziTGk8k-KT3F-L9_HWqDiIOJceL-Wyo Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Domain-Id: None Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Domain-Name: None Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Identity-Status: Confirmed Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Is-Admin-Project: True Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Project-Domain-Id: default Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Project-Domain-Name: Default Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Project-Id: 649b350e7f364263b37fbd34d0f07b2b Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Project-Name: admin Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Role: admin,member,reader Jun 20 07:00:42.284765 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Roles: admin,member,reader Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Tenant: admin Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Tenant-Id: 649b350e7f364263b37fbd34d0f07b2b Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Tenant-Name: admin Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User: admin Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User-Domain-Id: default Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User-Domain-Name: Default Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User-Id: 1ecb0c12822b4be89d3c7e17c8adfe7e Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User-Name: admin Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: method: > Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: exception: Flavor 42 could not be found. Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: action_args: {'id': '42'} Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:00:42.286311 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:00:42.287223 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:42.288310 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-9d2f2a59-2c9d-4244-8e2b-409acb471f47 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:00:42.289353 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-9d2f2a59-2c9d-4244-8e2b-409acb471f47 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015635 Jun 20 07:00:42.289353 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Jun 20 07:00:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 07:00:43.113107 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-d38b203d-50e2-4b24-a0f6-fc24b347a8e6 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:43.114113 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-d38b203d-50e2-4b24-a0f6-fc24b347a8e6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 20 07:00:43.114509 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 07:00:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:43.300649 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-e76dacdf-9461-4781-9538-a9e9de179d5e admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:43.307987 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.wsgi [None req-e76dacdf-9461-4781-9538-a9e9de179d5e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-e76dacdf-9461-4781-9538-a9e9de179d5e admin admin] Request method failure captured: Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Accept: application/json Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Accept-Encoding: gzip, deflate Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Connection: keep-alive Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Content-Length: 0 Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Host: 10.222.0.23 Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Openstack-Api-Version: compute 2.90 Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Openstack-System-Scope: None Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: User-Agent: python-novaclient Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Auth-Token: gAAAAABisBsbHjU1Kdf_4zji1Qs-z0qL0yUE8YcDXvVaSavutBquHKZ3dXipaNJnjZ-nWGv0x5IDEvfsq--ViIHEDJ3ZvV69Uupzld0yCspkV69OOdflQYUs1Kri_zY7F7XKswPN1880Svx3FQX_71t9xFNGEeCVYi9kiUu1c_n2y3y5g7AnYfo Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Domain-Id: None Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Domain-Name: None Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Identity-Status: Confirmed Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Is-Admin-Project: True Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Project-Domain-Id: default Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Project-Domain-Name: Default Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Project-Id: 649b350e7f364263b37fbd34d0f07b2b Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Project-Name: admin Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Role: admin,member,reader Jun 20 07:00:43.309501 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Roles: admin,member,reader Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Tenant: admin Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Tenant-Id: 649b350e7f364263b37fbd34d0f07b2b Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Tenant-Name: admin Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User: admin Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User-Domain-Id: default Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User-Domain-Name: Default Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User-Id: 1ecb0c12822b4be89d3c7e17c8adfe7e Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User-Name: admin Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: method: > Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: exception: Flavor 84 could not be found. Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: action_args: {'id': '84'} Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:00:43.311060 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:00:43.311934 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:43.313014 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-e76dacdf-9461-4781-9538-a9e9de179d5e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:00:43.314044 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-e76dacdf-9461-4781-9538-a9e9de179d5e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062107 Jun 20 07:00:43.314044 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Jun 20 07:00:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 07:00:43.320290 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-1b330cc8-3e39-4254-9dcd-6628c6f6bad4 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:43.334213 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-1b330cc8-3e39-4254-9dcd-6628c6f6bad4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017368 Jun 20 07:00:43.334660 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Jun 20 07:00:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:00:43.345546 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-0dd3b7d9-bd3b-47f9-9808-106be5d9eb75 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:43.359753 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-0dd3b7d9-bd3b-47f9-9808-106be5d9eb75 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018857 Jun 20 07:00:43.360314 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Jun 20 07:00:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:00:43.369451 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-6fcdc27e-a72f-4a78-800f-2f46b6515ebd admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:43.374766 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.wsgi [None req-6fcdc27e-a72f-4a78-800f-2f46b6515ebd admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-6fcdc27e-a72f-4a78-800f-2f46b6515ebd admin admin] Request method failure captured: Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Accept: application/json Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Accept-Encoding: gzip, deflate Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Connection: keep-alive Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Content-Length: 0 Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Host: 10.222.0.23 Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Openstack-Api-Version: compute 2.90 Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Openstack-System-Scope: None Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: User-Agent: python-novaclient Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Auth-Token: gAAAAABisBsbHjU1Kdf_4zji1Qs-z0qL0yUE8YcDXvVaSavutBquHKZ3dXipaNJnjZ-nWGv0x5IDEvfsq--ViIHEDJ3ZvV69Uupzld0yCspkV69OOdflQYUs1Kri_zY7F7XKswPN1880Svx3FQX_71t9xFNGEeCVYi9kiUu1c_n2y3y5g7AnYfo Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Domain-Id: None Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Domain-Name: None Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Identity-Status: Confirmed Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Is-Admin-Project: True Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Project-Domain-Id: default Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Project-Domain-Name: Default Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Project-Id: 649b350e7f364263b37fbd34d0f07b2b Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Project-Name: admin Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Role: admin,member,reader Jun 20 07:00:43.376298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Roles: admin,member,reader Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Tenant: admin Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Tenant-Id: 649b350e7f364263b37fbd34d0f07b2b Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Tenant-Name: admin Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User: admin Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User-Domain-Id: default Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User-Domain-Name: Default Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User-Id: 1ecb0c12822b4be89d3c7e17c8adfe7e Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User-Name: admin Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: method: > Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: exception: Flavor 84 could not be found. Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: action_args: {'id': '84'} Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:00:43.377830 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:00:43.378888 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:43.380252 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-6fcdc27e-a72f-4a78-800f-2f46b6515ebd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:00:43.381504 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-6fcdc27e-a72f-4a78-800f-2f46b6515ebd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011706 Jun 20 07:00:43.381504 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Jun 20 07:00:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 07:00:44.187275 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-0dd3b7d9-bd3b-47f9-9808-106be5d9eb75 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:44.188296 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-0dd3b7d9-bd3b-47f9-9808-106be5d9eb75 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jun 20 07:00:44.188693 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 07:00:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:44.374106 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-3f6c5696-76da-4c47-88ec-8f6a09ddcede admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:44.380022 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.wsgi [None req-3f6c5696-76da-4c47-88ec-8f6a09ddcede admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-3f6c5696-76da-4c47-88ec-8f6a09ddcede admin admin] Request method failure captured: Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Accept: application/json Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Accept-Encoding: gzip, deflate Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Connection: keep-alive Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Content-Length: 0 Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Host: 10.222.0.23 Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Openstack-Api-Version: compute 2.90 Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Openstack-System-Scope: None Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: User-Agent: python-novaclient Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Auth-Token: gAAAAABisBscbDjyBnNXPQGaDSDEO96EoPRpKtUo2z8lJKZG4mYnqQAH2oRJaDHffB1s3N7I9fiKO5eEeSuvIuWtxxwlUcFy1xJyA1ujmw5QTqbqNceeG5XNTHeYGwzpH9P7i2VaCLfJNYxJzzWPZ5w2xIE1f3BqHlzslyOQ1By-TC2-Dg9JRpI Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Domain-Id: None Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Domain-Name: None Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Identity-Status: Confirmed Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Is-Admin-Project: True Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Project-Domain-Id: default Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Project-Domain-Name: Default Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Project-Id: 649b350e7f364263b37fbd34d0f07b2b Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Project-Name: admin Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Role: admin,member,reader Jun 20 07:00:44.381596 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Roles: admin,member,reader Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Tenant: admin Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Tenant-Id: 649b350e7f364263b37fbd34d0f07b2b Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-Tenant-Name: admin Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User: admin Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User-Domain-Id: default Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User-Domain-Name: Default Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User-Id: 1ecb0c12822b4be89d3c7e17c8adfe7e Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: X-User-Name: admin Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: method: > Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: exception: Flavor 451 could not be found. Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: action_args: {'id': '451'} Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:00:44.383104 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:00:44.384387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: ERROR nova.api.openstack.wsgi Jun 20 07:00:44.386429 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-3f6c5696-76da-4c47-88ec-8f6a09ddcede admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:00:44.387643 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-3f6c5696-76da-4c47-88ec-8f6a09ddcede admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058680 Jun 20 07:00:44.387643 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Jun 20 07:00:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 07:00:44.393253 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-4236e5d8-161b-4f62-854e-cf89dc104c42 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:44.407180 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-4236e5d8-161b-4f62-854e-cf89dc104c42 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017376 Jun 20 07:00:44.407638 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Jun 20 07:00:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:00:44.416856 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:44.430065 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016729 Jun 20 07:00:44.430575 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Jun 20 07:00:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:00:44.439824 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-a4f82dcd-1f37-423c-bef5-c5de05a65923 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:44.444980 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.wsgi [None req-a4f82dcd-1f37-423c-bef5-c5de05a65923 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-a4f82dcd-1f37-423c-bef5-c5de05a65923 admin admin] Request method failure captured: Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Accept: application/json Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Accept-Encoding: gzip, deflate Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Connection: keep-alive Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Content-Length: 0 Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Host: 10.222.0.23 Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Openstack-Api-Version: compute 2.90 Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Openstack-System-Scope: None Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: User-Agent: python-novaclient Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Auth-Token: gAAAAABisBscbDjyBnNXPQGaDSDEO96EoPRpKtUo2z8lJKZG4mYnqQAH2oRJaDHffB1s3N7I9fiKO5eEeSuvIuWtxxwlUcFy1xJyA1ujmw5QTqbqNceeG5XNTHeYGwzpH9P7i2VaCLfJNYxJzzWPZ5w2xIE1f3BqHlzslyOQ1By-TC2-Dg9JRpI Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Domain-Id: None Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Domain-Name: None Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Identity-Status: Confirmed Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Is-Admin-Project: True Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Project-Domain-Id: default Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Project-Domain-Name: Default Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Project-Id: 649b350e7f364263b37fbd34d0f07b2b Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Project-Name: admin Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Role: admin,member,reader Jun 20 07:00:44.446513 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Roles: admin,member,reader Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/649b350e7f364263b37fbd34d0f07b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Tenant: admin Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Tenant-Id: 649b350e7f364263b37fbd34d0f07b2b Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-Tenant-Name: admin Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User: admin Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User-Domain-Id: default Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User-Domain-Name: Default Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User-Id: 1ecb0c12822b4be89d3c7e17c8adfe7e Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: X-User-Name: admin Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: method: > Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: exception: Flavor 451 could not be found. Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: action_args: {'id': '451'} Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:00:44.448742 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:00:44.449748 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jun 20 07:00:44.450833 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-a4f82dcd-1f37-423c-bef5-c5de05a65923 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:00:44.451836 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-a4f82dcd-1f37-423c-bef5-c5de05a65923 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011454 Jun 20 07:00:44.451836 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Jun 20 07:00:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 20 07:00:45.255933 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:45.256985 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 20 07:00:45.257387 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 07:00:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:45.449601 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-4d56407b-5de9-47b3-a3e0-7eca99680630 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:45.466672 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-4d56407b-5de9-47b3-a3e0-7eca99680630 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067981 Jun 20 07:00:45.467153 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Jun 20 07:00:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:00:46.299658 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:46.300728 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 20 07:00:46.301128 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 07:00:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:46.488988 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-71892b67-d8cb-4268-a49b-3083b84c5778 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:46.506070 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-71892b67-d8cb-4268-a49b-3083b84c5778 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068719 Jun 20 07:00:46.506650 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Jun 20 07:00:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:00:47.321942 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:47.323613 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 20 07:00:47.324011 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 07:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:47.516232 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-dc421293-c175-4ed3-afdd-eed52224d3c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:47.532733 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-dc421293-c175-4ed3-afdd-eed52224d3c0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069332 Jun 20 07:00:47.533209 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Jun 20 07:00:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:00:48.358724 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:48.359764 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 20 07:00:48.360191 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 07:00:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:48.549725 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-7bbea0cb-c317-4016-8902-a282ea3087c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:00:48.567544 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-7bbea0cb-c317-4016-8902-a282ea3087c8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068767 Jun 20 07:00:48.568157 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Jun 20 07:00:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:00:49.391298 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:49.392356 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 20 07:00:49.392779 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 07:00:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:00:49.580549 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-ddb7304f-e3d6-4d4a-b9ea-71e86b7dc543 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:00:49.599541 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-ddb7304f-e3d6-4d4a-b9ea-71e86b7dc543 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070084 Jun 20 07:00:49.600073 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Mon Jun 20 07:00:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:01:36.190733 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:01:36.191747 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-153692f0-f150-4b69-9d09-2cda012f8784 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 20 07:01:36.192173 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 07:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:01:36.202596 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:01:36.250181 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-fa0d56c5-9eac-4a5c-a850-de1c63ca83f3 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:01:36.269234 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-fa0d56c5-9eac-4a5c-a850-de1c63ca83f3 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071088 Jun 20 07:01:36.269769 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Mon Jun 20 07:01:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:01:36.292943 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-3f29dd26-21ff-4069-a263-e99fd9010083 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:01:36.296448 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG dbcounter [-] [103273] Writing DB stats nova_api:SELECT=14 {{(pid=103273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:01:36.302286 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-3f29dd26-21ff-4069-a263-e99fd9010083 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013468 Jun 20 07:01:36.302815 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Mon Jun 20 07:01:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:01:36.313891 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-45f36aef-d275-4920-b018-c3b790d7d2a4 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:01:36.321347 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-45f36aef-d275-4920-b018-c3b790d7d2a4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010935 Jun 20 07:01:36.321863 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Mon Jun 20 07:01:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:01:36.334789 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-c5a4109f-5b5f-48b9-8cef-52e02b152fe9 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:01:36.342770 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-c5a4109f-5b5f-48b9-8cef-52e02b152fe9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011529 Jun 20 07:01:36.343284 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Mon Jun 20 07:01:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:01:36.354052 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-4deee633-d874-45f6-8de6-bfd2e9b42b8d admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:01:36.362134 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-4deee633-d874-45f6-8de6-bfd2e9b42b8d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011490 Jun 20 07:01:36.362651 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Mon Jun 20 07:01:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:04:54.426107 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-c5a4109f-5b5f-48b9-8cef-52e02b152fe9 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:04:54.427115 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-c5a4109f-5b5f-48b9-8cef-52e02b152fe9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 20 07:04:54.427505 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 07:04:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:04:54.565994 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_api:SELECT=6 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:04:54.677511 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-5d5dd8f6-87cb-4ef3-bcc1-7b10588bef45 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:04:54.678675 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 07:04:54.678675 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: warnings.warn(msg) Jun 20 07:04:54.679868 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-5d5dd8f6-87cb-4ef3-bcc1-7b10588bef45 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:04:54.680331 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-5d5dd8f6-87cb-4ef3-bcc1-7b10588bef45 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:04:54.681123 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-5d5dd8f6-87cb-4ef3-bcc1-7b10588bef45 admin admin] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:04:54.681555 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-5d5dd8f6-87cb-4ef3-bcc1-7b10588bef45 admin admin] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:04:54.714856 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-5d5dd8f6-87cb-4ef3-bcc1-7b10588bef45 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.150208 Jun 20 07:04:54.715426 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Jun 20 07:04:54 2022] GET /compute/v2.1/os-services => generated 794 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:04:55.542513 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-c5a4109f-5b5f-48b9-8cef-52e02b152fe9 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:04:55.543528 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-c5a4109f-5b5f-48b9-8cef-52e02b152fe9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 20 07:04:55.543927 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 07:04:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:04:55.736637 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-ce678479-eb69-49d1-9767-8589393805b5 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:04:55.737831 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 07:04:55.737831 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: warnings.warn(msg) Jun 20 07:04:55.739008 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-ce678479-eb69-49d1-9767-8589393805b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:04:55.739449 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-ce678479-eb69-49d1-9767-8589393805b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:04:55.740296 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-ce678479-eb69-49d1-9767-8589393805b5 admin admin] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:04:55.740724 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-ce678479-eb69-49d1-9767-8589393805b5 admin admin] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:04:55.760592 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-ce678479-eb69-49d1-9767-8589393805b5 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077157 Jun 20 07:04:55.761376 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Jun 20 07:04:55 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:05:06.995366 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-c5a4109f-5b5f-48b9-8cef-52e02b152fe9 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:05:06.996399 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-c5a4109f-5b5f-48b9-8cef-52e02b152fe9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 20 07:05:06.996806 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 07:05:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:05:07.139417 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_cell0:SELECT=4 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:05:07.140416 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_cell1:SELECT=4 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:05:07.141570 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_api:SELECT=8 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:05:07.188221 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-8a7e85d5-3efe-4b81-9f3d-53236d8da28f admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:05:07.189388 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 07:05:07.189388 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: warnings.warn(msg) Jun 20 07:05:07.190595 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-8a7e85d5-3efe-4b81-9f3d-53236d8da28f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:05:07.191034 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-8a7e85d5-3efe-4b81-9f3d-53236d8da28f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:05:07.191823 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-8a7e85d5-3efe-4b81-9f3d-53236d8da28f admin admin] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:05:07.192290 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-8a7e85d5-3efe-4b81-9f3d-53236d8da28f admin admin] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:05:07.217408 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-8a7e85d5-3efe-4b81-9f3d-53236d8da28f admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.082380 Jun 20 07:05:07.217896 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Jun 20 07:05:07 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:05:08.045386 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: DEBUG nova.api.openstack.wsgi [None req-c5a4109f-5b5f-48b9-8cef-52e02b152fe9 admin admin] Calling method '>' {{(pid=103273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:05:08.046386 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: INFO nova.api.openstack.requestlog [None req-c5a4109f-5b5f-48b9-8cef-52e02b152fe9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 20 07:05:08.047308 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: [pid: 103273|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 07:05:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:05:08.235869 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-ab24eef0-ee19-4395-9161-83c1b4c80d5d admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:05:08.237097 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 07:05:08.237097 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: warnings.warn(msg) Jun 20 07:05:08.238322 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-ab24eef0-ee19-4395-9161-83c1b4c80d5d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:05:08.239404 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-ab24eef0-ee19-4395-9161-83c1b4c80d5d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:05:08.240308 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-ab24eef0-ee19-4395-9161-83c1b4c80d5d admin admin] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:05:08.240772 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-ab24eef0-ee19-4395-9161-83c1b4c80d5d admin admin] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:05:08.265980 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-ab24eef0-ee19-4395-9161-83c1b4c80d5d admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080284 Jun 20 07:05:08.267023 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Jun 20 07:05:08 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:06:02.248776 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: Mon Jun 20 07:06:02 2022 - graceful shutdown triggered... Jun 20 07:06:02.248548 dv-cinder-778193-28-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 20 07:06:02.249708 dv-cinder-778193-28-iscsi devstack@n-api.service[103273]: Gracefully killing worker 1 (pid: 103273)... Jun 20 07:06:02.250346 dv-cinder-778193-28-iscsi devstack@n-api.service[103274]: Gracefully killing worker 2 (pid: 103274)... Jun 20 07:06:03.249068 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: worker 1 buried after 1 seconds Jun 20 07:06:03.249632 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: worker 2 buried after 1 seconds Jun 20 07:06:03.249632 dv-cinder-778193-28-iscsi devstack@n-api.service[103240]: goodbye to uWSGI. Jun 20 07:06:03.250667 dv-cinder-778193-28-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 20 07:06:03.251211 dv-cinder-778193-28-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 20 07:06:03.254028 dv-cinder-778193-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 07:06:03.263134 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 07:06:03.265901 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 07:06:03 2022] *** Jun 20 07:06:03.265901 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 07:06:03.265901 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 07:06:03.265901 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: nodename: dv-cinder-778193-28-iscsi Jun 20 07:06:03.265901 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: machine: x86_64 Jun 20 07:06:03.265901 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: clock source: unix Jun 20 07:06:03.265901 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: pcre jit disabled Jun 20 07:06:03.265901 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: detected number of CPU cores: 4 Jun 20 07:06:03.265901 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: current working directory: / Jun 20 07:06:03.265901 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: detected binary path: /usr/bin/uwsgi-core Jun 20 07:06:03.265901 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: your processes number limit is 47680 Jun 20 07:06:03.265901 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: your memory page size is 4096 bytes Jun 20 07:06:03.266673 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: detected max file descriptor number: 2048 Jun 20 07:06:03.266673 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: lock engine: pthread robust mutexes Jun 20 07:06:03.266673 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: thunder lock: enabled Jun 20 07:06:03.266673 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 07:06:03.266673 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 07:06:03.312819 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: Python main interpreter initialized at 0x5626fe12e9c0 Jun 20 07:06:03.312819 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: python threads support enabled Jun 20 07:06:03.312819 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: your server socket listen backlog is limited to 100 connections Jun 20 07:06:03.312819 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: your mercy for graceful operations on workers is 90 seconds Jun 20 07:06:03.313280 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 07:06:03.313280 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: *** Operational MODE: preforking *** Jun 20 07:06:03.313547 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: *** uWSGI is running in multiple interpreter mode *** Jun 20 07:06:03.313547 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: spawned uWSGI master process (pid: 117588) Jun 20 07:06:03.313749 dv-cinder-778193-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 07:06:03.315378 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: spawned uWSGI worker 1 (pid: 117606, cores: 1) Jun 20 07:06:03.315378 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: spawned uWSGI worker 2 (pid: 117607, cores: 1) Jun 20 07:06:03.315378 dv-cinder-778193-28-iscsi devstack@n-api.service[117588]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 07:06:03.989023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 07:06:03.989578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 07:06:05.190433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 07:06:05.190433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: from cryptography.utils import int_from_bytes Jun 20 07:06:05.191068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 07:06:05.191068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: from cryptography.utils import int_from_bytes Jun 20 07:06:05.191211 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 07:06:05.191211 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: from cryptography.utils import int_from_bytes Jun 20 07:06:05.191597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 07:06:05.191597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: from cryptography.utils import int_from_bytes Jun 20 07:06:07.596167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 07:06:07.597185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 07:06:07.597734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 07:06:07.598104 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 07:06:07.598361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 07:06:07.598753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.599080 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.599407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.599727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.600057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.600395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.600717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.601038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.601363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.601621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.601944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.602263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-778193-28-iscsi {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.602583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.602888 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.603195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.603509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.603807 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.604149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.604459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.604959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.606364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.606641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.606970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.607314 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.607627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.607938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.608283 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.609177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.609504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.609812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.610203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-778193-28-iscsi {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.610514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.610842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.611162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.611563 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.611889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.612217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.612540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.612862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.613169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.613508 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.613811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.614132 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.614445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.614770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.615051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.615359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.615674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.615979 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.616379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.616627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.616933 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.617249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.617566 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.617884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.618136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.618384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.618697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.619012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.619321 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.619621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.619922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.620249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.620549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.620849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.621149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.621448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.621760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.622071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.622389 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.622693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.623004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.623398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.623649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.623950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.624346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.624660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.624964 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.625279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.625592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.625894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.626266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.626423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 07:06:07.626943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.627111 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 07:06:07.627277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.627429 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 07:06:07.627584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.627759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 07:06:07.627912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.628066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 07:06:07.628245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.628245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.628540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.628712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.628858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.629017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.629172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.629326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.629480 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.629480 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.629775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.630107 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.630294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.630452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.630597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.630749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.630945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.631097 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.631240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.631397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.631540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.631692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.631846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-778193-28-iscsi {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.631992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.632183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.632920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.632920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.633240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.633923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.634088 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.634264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.634440 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.634588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.634740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.634893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.635100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.635426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.635586 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.635732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.635732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.635732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.636225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.636423 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.636577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.636577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.636877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.637028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.637180 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.637327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.637479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.637664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.637940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.638098 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.638250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.638416 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.638571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.638731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.638876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.639061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.639219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.639369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.639529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.639529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.639839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-778193-28-iscsi {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.639993 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.640190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.640352 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.640509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.640925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.641071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.641221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.641365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.641567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.641717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.641860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.642012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.642156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.642310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.642465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.642629 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.642774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.642774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.643047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.643238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.643400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.644167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.644337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.644492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.644640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.644796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.644949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.645101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.645261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.645560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.645720 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.645876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.646021 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.646171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.646323 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.646478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.646637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.646794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.646947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.646947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.647270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.647427 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.647580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.647725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.647880 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.648172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.648365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.648365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.648734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.648889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.649040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.649186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.649340 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.649495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.649669 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.649815 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.649958 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.650110 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.650259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.650413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.650565 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.650717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.650876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.651029 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.651183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.651346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.651346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.651627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.651770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.651920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.652064 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.652249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.652396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.652538 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.652689 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.652832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.652990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.653154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.653317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.653473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.653642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.654327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.654327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.654638 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.654638 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.654933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.654933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.655209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.655967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.656255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.656255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.656569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.656722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.656873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.657033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.657178 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.657342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.657617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.657770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.657932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.658092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.658315 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.658472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.658635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.658635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.658918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.658918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.659232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.659382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.659525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.659669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.659825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.659825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.660099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.660279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.660444 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.660588 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.660740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.660885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.661028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.661177 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.661328 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.661481 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.661626 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.661776 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.661927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.662070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.662221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.662389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.662541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.662691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.662845 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.662997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.663176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.663339 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.663499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.663655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.663807 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.664359 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.664515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.664782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.664945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.665096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.665248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.665392 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.665542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.665697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.665843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.666084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.666236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.666388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.666547 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.666701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.666861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.667026 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.667172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.667324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.667469 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.667469 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.667751 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.667915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.668138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.668323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.668545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.668702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.668856 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.669008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.669173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.669326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.669471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.669615 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.669758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.669914 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.670068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.670214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.670365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.670518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.670670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.670814 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.671541 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.671703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.671883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.672032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.672197 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.672358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.672518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.672672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.672817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.672963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.673116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.673273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.673418 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.673596 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.673792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.673938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.674473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.674639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.674802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.675045 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.675238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.675401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.675547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.675705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.675858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.676011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.676310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.676461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.676619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.676775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.676977 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.677145 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.677400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.677565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.677792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 07:06:07.677955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.678109 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.678263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.678263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.678574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.678735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.678735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.679149 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.679413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.679413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.679836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.680087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.680087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.680626 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.680844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.680844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.680844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.681626 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.681871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.682097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.682315 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.682315 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.682766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.682958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.682958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.683258 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.683421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.683421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.683724 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.683883 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.684035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.684591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.684591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.684894 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.685076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.685320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.685470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.685623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.685775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.685775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.686068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.686213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.686463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.686642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.686787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.686942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.687104 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.687249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.687392 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.687544 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.687698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.687857 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.688008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.688184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.688344 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.688497 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.688641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.688799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.688945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.689089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.689233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.689385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.689536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.689727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.689886 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.690039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.690199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.690354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.690512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.690658 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.690658 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.690940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.691084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.691234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.691424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.691574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.691726 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.691880 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.692024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.692198 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.692375 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.692521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.692664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.692807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.692951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.693095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.693247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.693406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.693563 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.693715 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.693860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.694018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.694170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.694549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.694875 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.695023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.695168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.695443 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.695606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.695751 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.695903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.696056 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.696265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.696444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.696663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.696812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.696975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.697121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.697265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.697423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.697569 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.697712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.697864 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.698008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.698163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.698307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.698458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.698603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.698757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.698927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.699096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.699243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.699395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.699547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.699691 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.699834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.699993 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.700156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.700308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.700452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.700596 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.700750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.700912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.701058 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.701208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.701361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.701505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.701647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.701801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.701944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.702087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.702262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.702407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.702560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.702717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.702717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.703008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.703152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.703304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.703469 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.703623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.703775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.703926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.704072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.704285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.704672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.704983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.705146 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.705291 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.705461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.705700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.705900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.706051 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.706195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.706338 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.706481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.706654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.706869 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.707025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.707190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.707336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.708093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.708270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.708414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.708557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.708712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.708864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.709023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.709175 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.709326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.709477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.709633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.709777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.709998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.710152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.710304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.710464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.710610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.710763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.710909 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.711059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.711211 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.711399 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.711556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.711721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.711876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.712021 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.712199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.712359 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.712359 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.712643 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.712788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.712941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.713085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.713235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.713389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.713543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.713706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.713852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.714001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.714152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.714316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.714475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.714992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.715167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.715320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.715479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.715644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.715828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.715993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.716175 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.716345 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.716505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.716657 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.716814 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.717054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.717225 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.717384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.717543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.717692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.718376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.718528 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.718699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.718858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.719010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.719162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.719312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.719469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.719635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.719786 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.719948 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.720100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.720313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.720473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.720634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.720807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.720965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.721116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.721267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.721267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.721566 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.721566 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.721861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.721861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.722155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.722315 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.722466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.722623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.722792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.722943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.723102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.723262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.723414 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.723565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.723722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.723884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.724042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.724247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.724412 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.724564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.724740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.725248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.725421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.725584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.725734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.725891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.726050 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.726209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.726369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.726522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.726672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.726830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.726989 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.727234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.727401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.727561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.727712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.727870 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.728028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.728251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.728417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.728578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.728736 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.728887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.729038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.729194 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.729377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.729543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.729711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.729816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.729909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.730012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.730102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.730187 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.730289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.730384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.730477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.730572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.730658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.730741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.730824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.730907 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.730991 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.731084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.731178 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.731271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.731362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.731447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.731447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.731632 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.731724 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.731808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.731900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.731991 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.732085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.732210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.732297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.732380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.732459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.732549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.732682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.732777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.732871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.732962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.733052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.733142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.733239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.733324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.733446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.734032 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.734127 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.734221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.734314 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.734406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.734491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.734573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.734663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.734756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.734841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.734935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735094 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735395 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735537 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.735973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.736079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.736186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.736286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.736379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.736469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.736560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.736645 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.736737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.736827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.736908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.736987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.737059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.737136 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.737282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.737358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.737436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.737516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.737595 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.737673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.737753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.737863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.737947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738097 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738097 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738528 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.738985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.739081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.739165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.739255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.739346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.739436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.739520 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.739601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.739701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.739794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.739794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.739794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.740035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.740143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.740247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.740333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.740423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.740508 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.740600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.740691 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.740783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.740867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.740950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.741040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.741201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.741287 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.741377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.741468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.741468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.741636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.741739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.741836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.741928 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.742024 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.742122 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.742218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.742304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.742394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.742485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.742577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.742668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.742752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.742835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.742918 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.743000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.743091 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.743183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.743275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.743367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.743458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.743549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.743645 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.743730 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.743813 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.743903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.743987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.744238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.744372 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.744551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.744659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.744850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.744954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.745162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.745271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.745464 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.745564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.745775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.745878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.746079 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.746174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.746382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.746508 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.746691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.746818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.747039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.747132 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.747347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.747447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.747689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.747792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.748007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.748133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.748344 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.748439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.748657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.748760 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.748960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.749061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.749312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.749410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.749621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.749731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.749929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.750028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.750234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.750327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.750545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.750640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.750855 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.750947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.751160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.751251 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.751472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.751564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.751771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.751869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.752071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.752230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.752395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.752496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.752714 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.752814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.753015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.753122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.753325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.753416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.753644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.753737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.753956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.754057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.754304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.754410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.754566 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.754729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.754878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.755038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.755253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.755366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.755494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.755652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.755806 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.755974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.756128 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.756353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.756451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.756618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.756752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.756934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.757059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.757244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.757365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.757565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.757668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.757887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.757990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.758198 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.758304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.758593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.758725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.758810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.758885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.759128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.759244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.759447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.759550 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.759759 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.759853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.760069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.760222 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.760402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.760509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.760714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.760808 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.761041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.761134 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.761361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.761461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.761667 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.761760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.761980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.762072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.762286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.762386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.762593 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.762685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.762900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.762998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.763205 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.763305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.763515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.763614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.763819 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.763911 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.764140 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.764247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.764452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.764546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.765281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.765398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.765833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.765935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.766144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.766226 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.766456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.766558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.766757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.766848 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.767060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.767159 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.767380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.767552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.767700 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.767794 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.768020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.768126 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.768348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.768453 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.768669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.768761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.768975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.769067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.769278 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.769371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.769582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.769682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.769886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.769987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.770208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.770306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.770518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.770609 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.770828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.770918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.771144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.771237 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.771452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.771548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.771756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.771846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.772079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.772200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.772415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.772509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.772726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.772832 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.773042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.773132 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.773363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.773453 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.773666 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.773766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.773971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.774070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.774281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.774382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.774581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.774680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.774885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.774978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.775187 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.775289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.775495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.775700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.775806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.775893 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.776089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.776215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.776413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.776506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.776735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.776835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.777039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.777141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.777358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.777500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.777665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.777766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.777967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.778079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.778269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.778370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.778570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.778663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.778890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.778983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.779198 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.779290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.779507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.779598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.779816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.779910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.780159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.780292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.781018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.781124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.781389 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.781486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.781713 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.781805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.782031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.782126 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.782346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.782438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.782659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.782758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.782972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.783078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.783285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.783378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.783598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.783699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.783909 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.784009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.784238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.784334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.784555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.784653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.784869 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.784972 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.785184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.785277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.785539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.785725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.785846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.786036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.786159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.786348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.786484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.786659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.786791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.786970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.787096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.787281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.787402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.787592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.787724 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.787900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.788030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.788232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.788379 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.788541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.788799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.788900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.789114 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.789215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.789423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.789522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.789776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.789869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.790108 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.790209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.790424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.790532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.790738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.790831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.791057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.791158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.791371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.791477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.791675 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.791774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.791992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.792085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.792340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.792447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.792654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.792756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.792969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.793069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.793281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.793372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.793590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.793683 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.793900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.793994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.794214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.794315 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.794527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.794621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.794837 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.794930 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.795145 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.795239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.795456 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.795548 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.795769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.795921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.796171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.796271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.796468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.796573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.796787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.796891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.797099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.797228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.797412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.797505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.797725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.797829 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.798032 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.798237 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.798329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.798552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.798659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.798882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.798982 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.799206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.799306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.799527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.799634 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.799838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.799929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.800165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.800281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.800473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.800582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.800787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.800887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.801092 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.801191 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.801400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.801504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.801708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.801803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.802012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.802105 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.802333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.802433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.802644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.802744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.802947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.803042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.803264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.803358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.803568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.803659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.803879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.804089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.804213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.804463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.804556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.804781 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.804911 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.805106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.805213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.805431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.805532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.805747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.805883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.806053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.806155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.806373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.806466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.806678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.806770 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.806981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.807091 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.807294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.807389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.807604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.807696 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.807907 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.808000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.808232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.808343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.808542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.808643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.808849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.808943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.809150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.809243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.809456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.809556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.809755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.809859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.810061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.810159 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.810368 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.810470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.810668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.810759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.810976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.811068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.811283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.811388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.811610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.811872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.811964 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.812212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.812321 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.812523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.812625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.812831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.812923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.813138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.813242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.813445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.813545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.813747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.813841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.814057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.814158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.814359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.814465 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.814666 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.814765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.815019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.815132 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.815340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.815434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.815644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.815744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.815945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.816091 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.816269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.816367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.816581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.816711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.816902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.817004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.817213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.817306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.817523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.817623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.817839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.817930 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.818150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.818251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.818469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.818683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.818852 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.819016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.819110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.819337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.819605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.819698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.819940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.820042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.820285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.820379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.820594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.820699 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.820900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.821000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.821215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.821306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.821523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.821624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.821833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.821934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.822143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.822243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.822453 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.822555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.822762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.822863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.823070 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.823171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.823378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.823472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.823683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.823775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.823992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.824087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.824323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.824419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.824630 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.824730 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.824938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.825057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.825249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.825354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.825560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.825654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.825897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.826001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.826216 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.826352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.826531 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.826623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.826842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.826943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.827692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.827795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.828008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.828101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.828339 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.828483 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.828650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.828743 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.828958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.829059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.829271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.829364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.829584 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.829677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.829894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.829985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.830199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.830293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.830525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.830695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.830864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.831012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.831189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.831331 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.831507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.831657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.831826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.831969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.832166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.832318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.832640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.832731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.832952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.833054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.833272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.833372 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.833581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.833674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.833908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.834194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.834296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.834528 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.834629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.834851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.834953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.835157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.835311 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.835465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.835588 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.835772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.835881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.836081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.836372 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.836469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.836550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.836714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.836826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.837012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.837094 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.837313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.837407 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.837620 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.837728 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.837921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.838017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.838222 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.838314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.838523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.838751 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.838844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.839099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.839206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.839407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.839524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.839713 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.839817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.840013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.840127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.840383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.840495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.840693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.840792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.840991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.841096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.841298 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.841416 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.841608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.841700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.841926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.842022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.842215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.842317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.842515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.842609 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.843357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.843455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.843675 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.843770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.843990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.844083 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.844331 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.844428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.844644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.844745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.844952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.845055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.845272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.845417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.845578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.845670 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.845888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.845980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.846244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.846396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.846549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.846635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.846801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.846894 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.847107 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.847213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.847416 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.847508 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.847721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.847812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.848031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.848182 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.848364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.848455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.848671 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.848764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.848976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.849068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.849289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.849391 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.849597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.849697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.849902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.849994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.850224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.850319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.850542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.850644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.850859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.850950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.851166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.851260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.851471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.851562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.851785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.851877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.852095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.852263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.852420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.852734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.853036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.853128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.853343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.853435 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.853657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.853759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.856089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.856300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.856399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.856475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.856556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.856644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.856724 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.856803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.856888 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.856979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.857077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.857077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.857334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.857423 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.857515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.857601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.857696 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.857782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.857874 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.857967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.858060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.858185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.858292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.858379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.858379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 07:06:07.858551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.858551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.858551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.858857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.859171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.859484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.859798 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.860132 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.860449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.860763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.861077 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.861391 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.861710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.862056 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.862381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.862704 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.863023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.863343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.863656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.863970 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.864319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.865153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.865153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.865355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.865575 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.865882 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.866387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.866706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.867030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.867355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.867670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.867995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.868352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.868666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.868991 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.869303 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.869636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.869978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.870308 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.870635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.870968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.871280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.871588 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.871900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.872248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.872563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.872870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.873177 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.873489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.873795 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.874128 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.874441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.874746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.875054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.875360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.875665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.875969 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.876310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.876616 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.876921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.877229 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.877567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.877840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.878144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.878451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.878753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.879082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.879415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.879736 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.880061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.880425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.880752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.881066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.881393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.881718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.882038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.882350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.882685 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.882998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.883313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.883627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.883939 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.884282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.884598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.884929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.885258 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.885567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.885895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.886215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.886539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.886858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.887174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.887505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.887818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.888145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.888550 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.888782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.889095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.889414 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.890265 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.890838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.891175 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.891489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.891816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.892165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.892517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.892830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.893177 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.893509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.893827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.894141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.894449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 07:06:07.894691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 07:06:07.919731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO dbcounter [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] Registered counter for database nova_api Jun 20 07:06:07.939572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_db.sqlalchemy.engines [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 07:06:07.945901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writer thread running {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 07:06:07.957110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] Registered counter for database nova_api Jun 20 07:06:07.977398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 07:06:07.983937 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 07:06:08.001898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.context [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2fa5826d-163d-47a7-aeb4-e55abc7a6a21(cell1) {{(pid=117607) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 07:06:08.005972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:06:08.007557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:06:08.008381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:06:08.010323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:06:08.012302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO dbcounter [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] Registered counter for database nova_cell0 Jun 20 07:06:08.017009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO dbcounter [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] Registered counter for database nova_cell1 Jun 20 07:06:08.023720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_db.sqlalchemy.engines [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 07:06:08.025903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_db.sqlalchemy.engines [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 07:06:08.031477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writer thread running {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 07:06:08.033986 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writer thread running {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 07:06:08.041377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.context [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2fa5826d-163d-47a7-aeb4-e55abc7a6a21(cell1) {{(pid=117606) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 07:06:08.045530 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:06:08.047125 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:06:08.047939 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:06:08.049922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:06:08.051914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] Registered counter for database nova_cell0 Jun 20 07:06:08.055904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] Registered counter for database nova_cell1 Jun 20 07:06:08.063381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 07:06:08.066753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 07:06:08.070568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 07:06:08.181477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO dbcounter [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] Registered counter for database nova_cell0 Jun 20 07:06:08.187917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_db.sqlalchemy.engines [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 07:06:08.192305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writer thread running {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 07:06:08.214348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 07:06:08.223957 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] Registered counter for database nova_cell0 Jun 20 07:06:08.230800 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 07:06:08.236049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 07:06:08.519089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: WARNING keystonemiddleware.auth_token [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 07:06:08.526416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: WARNING keystonemiddleware.auth_token [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 07:06:08.560978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 07:06:08.568403 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 07:06:08.876947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: WARNING keystonemiddleware.auth_token [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 07:06:08.882864 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: WARNING keystonemiddleware.auth_token [None req-9b373503-736a-4e5e-a0b1-4520182d0c5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 07:06:08.888215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5626fe12e9c0 pid: 117607 (default app) Jun 20 07:06:08.916876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 07:06:08.923457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-e2b1eeb1-b812-4853-b579-0fc82767bcaf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 07:06:08.928867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5626fe12e9c0 pid: 117606 (default app) Jun 20 07:06:48.782119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:06:48.784344 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:06:48.787527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:06:48.789149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:06:50.221018 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9483af6d-5a04-4748-81bb-5b8f24d2b98b tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] Action: 'create', calling method: .version_select at 0x7ffa2dc39700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-329150954", "metadata": {"Type": "work"}}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:06:52.012362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9483af6d-5a04-4748-81bb-5b8f24d2b98b tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.244372 Jun 20 07:06:52.014908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1155 bytes} [Mon Jun 20 07:06:48 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3249 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 07:06:52.035273 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:06:52.037070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:06:52.038442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:06:52.041940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:06:52.459998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3760b1e3-b82a-44af-b5d7-02e29f4838a5 tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] Calling method '.version_select at 0x7ffa2dc831f0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:06:53.099614 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3760b1e3-b82a-44af-b5d7-02e29f4838a5 tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/021d0883-651e-417e-99ff-371155dd3583" status: 200 len: 353 microversion: 2.1 time: 1.073539 Jun 20 07:06:53.100890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1/2] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:06:52 2022] GET /compute/v2.1/os-volumes/021d0883-651e-417e-99ff-371155dd3583 => generated 353 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:06:53.113299 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a0b56220-16c2-4194-bf12-4fb2ad24faef tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] Calling method '.version_select at 0x7ffa2dafe550>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:06:53.201626 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a0b56220-16c2-4194-bf12-4fb2ad24faef tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/021d0883-651e-417e-99ff-371155dd3583" status: 200 len: 353 microversion: 2.1 time: 0.092358 Jun 20 07:06:53.202200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:06:53 2022] GET /compute/v2.1/os-volumes/021d0883-651e-417e-99ff-371155dd3583 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:06:53.217640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d7d8c4d2-3628-4532-a774-8985e8b10a7f tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] Calling method '.version_select at 0x7ffa2db48550>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:06:53.375130 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d7d8c4d2-3628-4532-a774-8985e8b10a7f tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/021d0883-651e-417e-99ff-371155dd3583" status: 202 len: 0 microversion: 2.1 time: 0.164220 Jun 20 07:06:53.376213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 07:06:53 2022] DELETE /compute/v2.1/os-volumes/021d0883-651e-417e-99ff-371155dd3583 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:06:53.385090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ad996710-567a-464d-a517-0692e7b64091 tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] Calling method '.version_select at 0x7ffa2dafe790>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:06:53.678551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ad996710-567a-464d-a517-0692e7b64091 tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/021d0883-651e-417e-99ff-371155dd3583" status: 200 len: 352 microversion: 2.1 time: 0.298453 Jun 20 07:06:53.680240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:06:53 2022] GET /compute/v2.1/os-volumes/021d0883-651e-417e-99ff-371155dd3583 => generated 352 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:06:54.697612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e581e473-9b14-4246-a53b-9eb703a6a4a0 tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] Calling method '.version_select at 0x7ffa2db48c10>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:06:54.864653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-e581e473-9b14-4246-a53b-9eb703a6a4a0 tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] HTTP exception thrown: Volume 021d0883-651e-417e-99ff-371155dd3583 could not be found. Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e581e473-9b14-4246-a53b-9eb703a6a4a0 tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] Request method failure captured: Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/os-volumes/021d0883-651e-417e-99ff-371155dd3583 HTTP/1.1 Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByIvygqVxqXAutDYRK8jWU8cgnzfyWf-unIdMXxThJHY5jGB13gpP2v1ORPaqKbS9AWT_ybtLuOLkrW-xVFoCOIuPzfK444d-5kGtFtFBIRciaASTKoTnh-CPU3FKt_TO6cLZSQhYHaTAIjtXAMb6BKTX3kto4XqLmFPXd9FhkA_Vw Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: f310d483bcb642e58d7f2f12b8e2fd15 Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesGetTestJSON-1243513345 Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:06:54.869296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f310d483bcb642e58d7f2f12b8e2fd15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f310d483bcb642e58d7f2f12b8e2fd15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f310d483bcb642e58d7f2f12b8e2fd15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f310d483bcb642e58d7f2f12b8e2fd15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesGetTestJSON-1243513345 Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: f310d483bcb642e58d7f2f12b8e2fd15 Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesGetTestJSON-1243513345 Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesGetTestJSON-1243513345-project Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: ea022840c9a443249bd0c84ff9763e30 Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesGetTestJSON-1243513345-project Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Volume 021d0883-651e-417e-99ff-371155dd3583 could not be found. Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '021d0883-651e-417e-99ff-371155dd3583'} Jun 20 07:06:54.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 021d0883-651e-417e-99ff-371155dd3583 could not be found. (HTTP 404) (Request-ID: req-de8b7290-d0f9-4d35-954d-69f9ba50f94b) Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:06:54.871138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 07:06:54.872135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 021d0883-651e-417e-99ff-371155dd3583 could not be found. Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 07:06:54.873677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:06:54.875236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 021d0883-651e-417e-99ff-371155dd3583 could not be found. Jun 20 07:06:54.875236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:06:54.875236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:06:54.875236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:06:54.875236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:06:54.875236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:06:54.875236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:06:54.875236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:06:54.875236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:06:54.875236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 021d0883-651e-417e-99ff-371155dd3583 could not be found. Jun 20 07:06:54.875236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:06:54.877513 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e581e473-9b14-4246-a53b-9eb703a6a4a0 tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] Returning 404 to user: Volume 021d0883-651e-417e-99ff-371155dd3583 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:06:54.879325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e581e473-9b14-4246-a53b-9eb703a6a4a0 tempest-VolumesGetTestJSON-1243513345 tempest-VolumesGetTestJSON-1243513345-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/021d0883-651e-417e-99ff-371155dd3583" status: 404 len: 109 microversion: 2.1 time: 0.190092 Jun 20 07:06:54.880840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 3/6] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:06:54 2022] GET /compute/v2.1/os-volumes/021d0883-651e-417e-99ff-371155dd3583 => generated 109 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:07:00.626639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-396812d7-efd0-4024-b4d5-616ea407e30a tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] Calling method '.version_select at 0x7ffa2dafeca0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:00.729885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-396812d7-efd0-4024-b4d5-616ea407e30a tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4b515be1-cd98-4734-939c-dfdc2157f6fe" status: 200 len: 350 microversion: 2.1 time: 0.107589 Jun 20 07:07:00.730790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:07:00 2022] GET /compute/v2.1/os-volumes/4b515be1-cd98-4734-939c-dfdc2157f6fe => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:02.870002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ee4243db-f7c4-4b93-bdf9-e9517eebd4bc tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] Calling method '.version_select at 0x7ffa2dacbca0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:03.031464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ee4243db-f7c4-4b93-bdf9-e9517eebd4bc tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2b9311c8-4395-4b42-bd7e-823164dc9eac" status: 200 len: 350 microversion: 2.1 time: 0.164745 Jun 20 07:07:03.037646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:07:02 2022] GET /compute/v2.1/os-volumes/2b9311c8-4395-4b42-bd7e-823164dc9eac => generated 350 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:04.747051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2739e97d-e953-48ac-b1bf-c51faca0ce77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Action: 'create', calling method: .version_select at 0x7ffa2da953a0>, body: {"keypair": {"name": "tempest-keypair-625940569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIQcAIB2opvSp3TN2r1/Tkad1yxQZQbjy4MTLYWMHWqWlkv7piNG3s2bCxZ2LNyLcyH81l844xVbPhDdDzOBgmQ3PGiPQ4J4WLiAHA8ECIwv86F0NeqPzBKo6IReptSYQ=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:04.868644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cbb0c555-5648-4883-8e3f-d16ea653ce2f tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] Calling method '.version_select at 0x7ffa2da66430>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:04.881141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-2739e97d-e953-48ac-b1bf-c51faca0ce77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:07:04.919607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-2739e97d-e953-48ac-b1bf-c51faca0ce77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for user f66183ca9d884f43befaace02099c7f2 and project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:07:05.017247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cbb0c555-5648-4883-8e3f-d16ea653ce2f tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7d28a950-940d-4ec4-84d2-b863b6f80b30" status: 200 len: 349 microversion: 2.1 time: 0.152587 Jun 20 07:07:05.018152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 5/9] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:07:04 2022] GET /compute/v2.1/os-volumes/7d28a950-940d-4ec4-84d2-b863b6f80b30 => generated 349 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:05.095290 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2739e97d-e953-48ac-b1bf-c51faca0ce77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.037900 Jun 20 07:07:05.096479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 5/10] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 07:07:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:05.105564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e06f11bd-14c8-4b8d-bde5-c2d3d75717da tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] Calling method '.version_select at 0x7ffa2da68430>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:05.260765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0596a5d3-1a91-4700-b84c-1aec0a59f732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Action: 'create', calling method: .version_select at 0x7ffa2dacbd30>, body: {"keypair": {"name": "tempest-keypair-373797149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqdf9gPx5xcxSJDHlRkppvs7eSK8wQfU+Zu2/uO7JC17+Wbdyd6nByCZ3ox3XVlTC56vi+DFj4RihG5FvrI/HiZJ9ouv67vuz2Slp81zy7lFjS9DQ+Bp7KkNxRr7Fbiqg=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:05.365269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e06f11bd-14c8-4b8d-bde5-c2d3d75717da tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.265713 Jun 20 07:07:05.372365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 6/11] 10.222.0.23 () {58 vars in 1133 bytes} [Mon Jun 20 07:07:05 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:05.417108 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-0596a5d3-1a91-4700-b84c-1aec0a59f732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Getting quotas for project 530da3341ec44dddbab5b0042706ac7b. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:07:05.449571 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-0596a5d3-1a91-4700-b84c-1aec0a59f732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Getting quotas for user 1c618f9ab8bd47a3a9913078f8ae895e and project 530da3341ec44dddbab5b0042706ac7b. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:07:05.615978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0596a5d3-1a91-4700-b84c-1aec0a59f732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.596163 Jun 20 07:07:05.617700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 6/12] 10.222.0.23 () {62 vars in 1199 bytes} [Mon Jun 20 07:07:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 599 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 07:07:05.629170 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5122df3d-c1e0-4149-a19e-1b09e1dec213 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] Calling method '.version_select at 0x7ffa2da40430>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:05.846027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ce955fcc-aeee-4f18-8a47-7175e46f993f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Action: 'create', calling method: .version_select at 0x7ffa2d21b550>, body: {"keypair": {"name": "tempest-keypair-249288607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbvZr+btu1O9I866718/yafMIyyyY5MvhCHu/P33Hvt8JrhupNjWFA5x9MxEnvS1BD+bWwOECZTPPQIl9VHTEg7LTnj3bt2cYNBJMFvnd9O50LJNl1JlX3nV5R0mWlsBQ=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:05.865454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5122df3d-c1e0-4149-a19e-1b09e1dec213 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.246207 Jun 20 07:07:05.867530 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1148 bytes} [Mon Jun 20 07:07:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:05.880568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-832f450e-f597-4382-ac5f-3b633095ba89 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] Calling method '.version_select at 0x7ffa2d1f1670>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:05.884765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-ce955fcc-aeee-4f18-8a47-7175e46f993f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Getting quotas for project 0e19a3f933284f088747a9d623e9ec24. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:07:05.894916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-ce955fcc-aeee-4f18-8a47-7175e46f993f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Getting quotas for user 785140aa617e46608e8b3cf89aac5a44 and project 0e19a3f933284f088747a9d623e9ec24. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:07:05.921077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ce955fcc-aeee-4f18-8a47-7175e46f993f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.546762 Jun 20 07:07:05.922480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 7/14] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 07:07:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:06.073646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-832f450e-f597-4382-ac5f-3b633095ba89 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.197290 Jun 20 07:07:06.074614 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1133 bytes} [Mon Jun 20 07:07:05 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:06.096763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d917d56d-5371-4e9f-bb21-06dd0c63e749 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] Calling method '.version_select at 0x7ffa2d21b820>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:06.364228 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d917d56d-5371-4e9f-bb21-06dd0c63e749 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.274964 Jun 20 07:07:06.365109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1166 bytes} [Mon Jun 20 07:07:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:06.378142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-600eba78-2540-4e59-b6de-20d95d782d93 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] Calling method '.version_select at 0x7ffa2d1ff310>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:06.588660 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-600eba78-2540-4e59-b6de-20d95d782d93 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.215078 Jun 20 07:07:06.599218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 9/17] 10.222.0.23 () {58 vars in 1169 bytes} [Mon Jun 20 07:07:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:06.606020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a3e8c80e-0090-44c4-a7f7-52aca2294678 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] Calling method '.version_select at 0x7ffa2da68d30>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:06.782776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a3e8c80e-0090-44c4-a7f7-52aca2294678 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.181630 Jun 20 07:07:06.783703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 9/18] 10.222.0.23 () {58 vars in 1154 bytes} [Mon Jun 20 07:07:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:06.795441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5f8a26eb-be07-4a52-954d-71a7a9aaaf30 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] Calling method '.version_select at 0x7ffa2da40ca0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:06.998658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5f8a26eb-be07-4a52-954d-71a7a9aaaf30 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.207788 Jun 20 07:07:07.000359 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 10/19] 10.222.0.23 () {58 vars in 1187 bytes} [Mon Jun 20 07:07:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:07.014290 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b1e683da-68da-4272-b274-b4193b56b855 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] Calling method '.version_select at 0x7ffa2d224700>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:07.240827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b1e683da-68da-4272-b274-b4193b56b855 tempest-VolumesTestJSON-15182878 tempest-VolumesTestJSON-15182878-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.231404 Jun 20 07:07:07.241688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 10/20] 10.222.0.23 () {58 vars in 1154 bytes} [Mon Jun 20 07:07:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:09.892995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1059005479", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:10.136691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] validate_networks() for [('268c66c4-17bf-4494-8dc1-1ea1d6190507', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:07:10.911124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-140487773", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "networks": [{"uuid": "f7ee6af1-d7a4-4619-a572-b9fd4241454f"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:11.079549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] validate_networks() for [('f7ee6af1-d7a4-4619-a572-b9fd4241454f', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:07:12.179353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:07:12.181031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:07:12.182326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:07:12.189338 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:07:12.192568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:07:12.240925 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:12.253033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:12.257191 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:12.262996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:12.329841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Getting quotas for project b07b7ec64ab448338374bb16c29c7b1d. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:07:12.338684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Getting quotas for user af0dee4e1dfb4f879dfe41622a9e23b1 and project b07b7ec64ab448338374bb16c29c7b1d. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:07:12.361941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:07:12.366474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:07:12.446802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:07:12.447387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:07:12.447777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:07:12.448217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:07:12.448634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:07:12.466057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:12.468310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:12.471109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:12.471611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:12.520599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-74c14deb-7b56-4abd-802c-1ea89abc0c3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.967041 Jun 20 07:07:12.528168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 11/21] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:07:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:07:12.533291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Getting quotas for project 96ee20ba4bcd469097e1a8815eee16e6. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:07:12.538560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-160318479", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "882e9092-6971-4957-9705-059b858de12f"}], "security_groups": [{"name": "tempest-securitygroup--1663526595"}], "key_name": "tempest-keypair-625940569", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:12.543299 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Getting quotas for user b974bab2e7934b57ab79128210c439a7 and project 96ee20ba4bcd469097e1a8815eee16e6. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:07:12.579164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:07:12.586826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:07:12.746038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-17d4d0d2-7fe6-4dac-b3cd-63dc8a8da1f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.949609 Jun 20 07:07:12.746674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 11/22] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:07:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 07:07:12.774077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-533d2418-f706-462f-9b2f-f3b1e43afde1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:12.774722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-533d2418-f706-462f-9b2f-f3b1e43afde1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:12.808494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] validate_networks() for [('882e9092-6971-4957-9705-059b858de12f', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:07:12.922473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-533d2418-f706-462f-9b2f-f3b1e43afde1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:12.944982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-533d2418-f706-462f-9b2f-f3b1e43afde1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1222 microversion: 2.1 time: 0.190854 Jun 20 07:07:12.945573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:12 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1222 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:12.961275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1782116560", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69e9f1e9-dc5c-4bf7-bef0-e92bd1c5f965"}], "security_groups": [{"name": "tempest-securitygroup--554411802"}], "key_name": "tempest-keypair-249288607", "user_data": "}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:13.134751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] validate_networks() for [('69e9f1e9-dc5c-4bf7-bef0-e92bd1c5f965', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:07:13.755581 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:07:13.756995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:07:13.757648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:07:13.758316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:07:13.758967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:07:13.780192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:13.797760 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:13.798942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:13.806262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:13.896619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:07:13.916644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for user f66183ca9d884f43befaace02099c7f2 and project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:07:13.981627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:07:13.992811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:07:14.207746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d4320f1d-e411-44f7-88cd-3710749b5c98 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.662169 Jun 20 07:07:14.210242 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 12/24] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:07:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:07:14.238467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3af2f296-4148-4cbd-ba39-4562ae71eec2 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:14.241013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3af2f296-4148-4cbd-ba39-4562ae71eec2 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:14.315990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:07:14.316558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:07:14.317158 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:07:14.317850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:07:14.318272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:07:14.337450 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:14.338800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:14.339639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:14.340921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:14.505300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Getting quotas for project 0e19a3f933284f088747a9d623e9ec24. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:07:14.540142 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Getting quotas for user 785140aa617e46608e8b3cf89aac5a44 and project 0e19a3f933284f088747a9d623e9ec24. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:07:14.587444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3af2f296-4148-4cbd-ba39-4562ae71eec2 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:14.618012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3af2f296-4148-4cbd-ba39-4562ae71eec2 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1214 microversion: 2.1 time: 0.406568 Jun 20 07:07:14.624762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:07:14.625079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:14 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1214 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:14.631399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:07:14.639885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-921459279", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43f7ac38-a22a-45e1-9bdd-77dcc5cb133f"}], "security_groups": [{"name": "tempest-securitygroup--985880338"}], "key_name": "tempest-keypair-373797149", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:14.811316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8a383969-fdfc-4a0e-96a2-bda7a73949dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.864050 Jun 20 07:07:14.817787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 13/26] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:07:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:07:14.835951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-173560576", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:14.903973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] validate_networks() for [('43f7ac38-a22a-45e1-9bdd-77dcc5cb133f', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:07:14.968761 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] validate_networks() for [('268c66c4-17bf-4494-8dc1-1ea1d6190507', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:07:16.716803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:07:16.718355 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:07:16.719318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:07:16.722373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:07:16.723005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:07:16.771528 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:16.772543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:16.777284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:16.778023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:16.790604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:07:16.791123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:07:16.791803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:07:16.792579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:07:16.793101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:07:16.825389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:16.834395 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:16.837062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:16.838761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:16.855035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Getting quotas for project b07b7ec64ab448338374bb16c29c7b1d. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:07:16.876016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Getting quotas for user af0dee4e1dfb4f879dfe41622a9e23b1 and project b07b7ec64ab448338374bb16c29c7b1d. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:07:16.928721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Getting quotas for project 530da3341ec44dddbab5b0042706ac7b. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:07:16.939740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Getting quotas for user 1c618f9ab8bd47a3a9913078f8ae895e and project 530da3341ec44dddbab5b0042706ac7b. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:07:16.944413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:07:16.960416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:07:16.990032 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:07:17.000493 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:07:17.062247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d63e7630-8363-410d-a56e-0b73d0f85d43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.242562 Jun 20 07:07:17.063213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 14/27] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:07:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:07:17.070005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-347d0772-5aa7-4ada-aab4-d396929e5515 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:17.071119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-347d0772-5aa7-4ada-aab4-d396929e5515 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:17.079962 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-347d0772-5aa7-4ada-aab4-d396929e5515 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:17.080799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-347d0772-5aa7-4ada-aab4-d396929e5515 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:17.082105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-347d0772-5aa7-4ada-aab4-d396929e5515 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:17.082842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-347d0772-5aa7-4ada-aab4-d396929e5515 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:17.186791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6d350c28-b8ae-4924-b5cf-0bad8da0b36c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.560566 Jun 20 07:07:17.191498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 14/28] 10.222.0.23 () {62 vars in 1187 bytes} [Mon Jun 20 07:07:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 2565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 07:07:17.209742 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c7a12b72-ce17-40d0-86ad-2d5bd1a09713 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:17.210294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c7a12b72-ce17-40d0-86ad-2d5bd1a09713 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:17.288272 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7a12b72-ce17-40d0-86ad-2d5bd1a09713 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:17.291908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7a12b72-ce17-40d0-86ad-2d5bd1a09713 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:17.292890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7a12b72-ce17-40d0-86ad-2d5bd1a09713 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:17.299362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7a12b72-ce17-40d0-86ad-2d5bd1a09713 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:17.437558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-347d0772-5aa7-4ada-aab4-d396929e5515 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:17.466829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-347d0772-5aa7-4ada-aab4-d396929e5515 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1292 microversion: 2.1 time: 0.401672 Jun 20 07:07:17.493090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 15/29] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:17 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1292 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:17.515297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f3e6bb8a-125d-44c3-94b0-854fe2d13a37 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:17.516791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f3e6bb8a-125d-44c3-94b0-854fe2d13a37 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:17.532997 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3e6bb8a-125d-44c3-94b0-854fe2d13a37 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:17.533662 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3e6bb8a-125d-44c3-94b0-854fe2d13a37 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:17.544355 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3e6bb8a-125d-44c3-94b0-854fe2d13a37 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:17.545143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3e6bb8a-125d-44c3-94b0-854fe2d13a37 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:17.768878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f3e6bb8a-125d-44c3-94b0-854fe2d13a37 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:17.781046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f3e6bb8a-125d-44c3-94b0-854fe2d13a37 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1284 microversion: 2.1 time: 0.286601 Jun 20 07:07:17.795021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 16/30] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:17 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1284 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:17.808793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-613e87d3-d2e5-4a60-b9b5-04a663c6a744 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:17.809262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-613e87d3-d2e5-4a60-b9b5-04a663c6a744 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:18.641131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c7a12b72-ce17-40d0-86ad-2d5bd1a09713 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:18.733413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c7a12b72-ce17-40d0-86ad-2d5bd1a09713 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1289 microversion: 2.1 time: 1.535418 Jun 20 07:07:18.743225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 15/31] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:17 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1289 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:18.767763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e800d37b-6e6e-4255-bc78-9bb2f7ad7b6e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:18.787689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e800d37b-6e6e-4255-bc78-9bb2f7ad7b6e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:18.813343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-613e87d3-d2e5-4a60-b9b5-04a663c6a744 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:18.826217 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e800d37b-6e6e-4255-bc78-9bb2f7ad7b6e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:18.831620 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e800d37b-6e6e-4255-bc78-9bb2f7ad7b6e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:18.838478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-613e87d3-d2e5-4a60-b9b5-04a663c6a744 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1221 microversion: 2.1 time: 1.042038 Jun 20 07:07:18.840629 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e800d37b-6e6e-4255-bc78-9bb2f7ad7b6e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:18.841946 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e800d37b-6e6e-4255-bc78-9bb2f7ad7b6e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:18.845603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 17/32] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:17 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1221 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:18.861286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a814ea8d-0cec-49ba-9a9e-fcfdcda98477 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:18.878518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a814ea8d-0cec-49ba-9a9e-fcfdcda98477 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:18.924373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a814ea8d-0cec-49ba-9a9e-fcfdcda98477 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:18.928333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a814ea8d-0cec-49ba-9a9e-fcfdcda98477 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:18.930197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a814ea8d-0cec-49ba-9a9e-fcfdcda98477 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:18.932969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a814ea8d-0cec-49ba-9a9e-fcfdcda98477 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:19.106363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e800d37b-6e6e-4255-bc78-9bb2f7ad7b6e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:19.135261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e800d37b-6e6e-4255-bc78-9bb2f7ad7b6e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:19.142605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e800d37b-6e6e-4255-bc78-9bb2f7ad7b6e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:19.150904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e800d37b-6e6e-4255-bc78-9bb2f7ad7b6e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1284 microversion: 2.20 time: 0.405779 Jun 20 07:07:19.152034 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 16/33] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:18 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1284 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:19.170676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-60eaa743-1d9f-4400-b37b-200c3a9ee4ad tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:19.178215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-60eaa743-1d9f-4400-b37b-200c3a9ee4ad tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:19.199939 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60eaa743-1d9f-4400-b37b-200c3a9ee4ad tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:19.201995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60eaa743-1d9f-4400-b37b-200c3a9ee4ad tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:19.203019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60eaa743-1d9f-4400-b37b-200c3a9ee4ad tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:19.205974 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60eaa743-1d9f-4400-b37b-200c3a9ee4ad tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:19.313400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a814ea8d-0cec-49ba-9a9e-fcfdcda98477 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:19.323329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a814ea8d-0cec-49ba-9a9e-fcfdcda98477 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1298 microversion: 2.1 time: 0.476576 Jun 20 07:07:19.340929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 18/34] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:18 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1298 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:19.545582 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-60eaa743-1d9f-4400-b37b-200c3a9ee4ad tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:19.559426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-60eaa743-1d9f-4400-b37b-200c3a9ee4ad tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1272 microversion: 2.1 time: 0.399868 Jun 20 07:07:19.561031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 17/35] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:19 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1272 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:19.755438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0de524f3-b33a-4ef6-87e1-98c5ca93364e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:19.756375 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0de524f3-b33a-4ef6-87e1-98c5ca93364e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:19.770173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0de524f3-b33a-4ef6-87e1-98c5ca93364e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:19.770737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0de524f3-b33a-4ef6-87e1-98c5ca93364e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:19.774030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0de524f3-b33a-4ef6-87e1-98c5ca93364e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:19.777118 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0de524f3-b33a-4ef6-87e1-98c5ca93364e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:19.858539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c950f32d-184d-4ece-b2b6-883262c0149b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:19.859406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c950f32d-184d-4ece-b2b6-883262c0149b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:19.890064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c950f32d-184d-4ece-b2b6-883262c0149b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:19.891003 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c950f32d-184d-4ece-b2b6-883262c0149b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:19.892596 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c950f32d-184d-4ece-b2b6-883262c0149b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:19.893219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c950f32d-184d-4ece-b2b6-883262c0149b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:19.936431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0de524f3-b33a-4ef6-87e1-98c5ca93364e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:19.947167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0de524f3-b33a-4ef6-87e1-98c5ca93364e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1295 microversion: 2.1 time: 0.194019 Jun 20 07:07:19.962901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 19/36] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:19 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1295 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:20.171796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b2449a44-6785-45d4-bc28-d534b9ae28a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:20.172842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b2449a44-6785-45d4-bc28-d534b9ae28a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:20.188164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2449a44-6785-45d4-bc28-d534b9ae28a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:20.195216 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2449a44-6785-45d4-bc28-d534b9ae28a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:20.200206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2449a44-6785-45d4-bc28-d534b9ae28a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:20.201971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2449a44-6785-45d4-bc28-d534b9ae28a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:20.409577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c950f32d-184d-4ece-b2b6-883262c0149b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:20.420227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c950f32d-184d-4ece-b2b6-883262c0149b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1273 microversion: 2.1 time: 0.567163 Jun 20 07:07:20.424572 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 18/37] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:19 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1273 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:20.435917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-54fc4a16-96f7-4f3a-81bf-32b48b35edcb tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:20.438616 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-54fc4a16-96f7-4f3a-81bf-32b48b35edcb tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:20.453060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54fc4a16-96f7-4f3a-81bf-32b48b35edcb tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:20.453788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54fc4a16-96f7-4f3a-81bf-32b48b35edcb tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:20.454765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54fc4a16-96f7-4f3a-81bf-32b48b35edcb tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:20.456922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54fc4a16-96f7-4f3a-81bf-32b48b35edcb tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:20.659900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b2449a44-6785-45d4-bc28-d534b9ae28a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:20.671805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b2449a44-6785-45d4-bc28-d534b9ae28a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:20.682755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b2449a44-6785-45d4-bc28-d534b9ae28a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:20.685912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b2449a44-6785-45d4-bc28-d534b9ae28a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1340 microversion: 2.20 time: 0.519340 Jun 20 07:07:20.689052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 20/38] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:20 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1340 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:07:20.705701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1aa258a1-7fb1-4b05-9cef-5c74cd67a0d2 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:20.706654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1aa258a1-7fb1-4b05-9cef-5c74cd67a0d2 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:20.716571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1aa258a1-7fb1-4b05-9cef-5c74cd67a0d2 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:20.718337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1aa258a1-7fb1-4b05-9cef-5c74cd67a0d2 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:20.722415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1aa258a1-7fb1-4b05-9cef-5c74cd67a0d2 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:20.722971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1aa258a1-7fb1-4b05-9cef-5c74cd67a0d2 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:21.145328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-54fc4a16-96f7-4f3a-81bf-32b48b35edcb tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:21.162129 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-54fc4a16-96f7-4f3a-81bf-32b48b35edcb tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1298 microversion: 2.1 time: 0.735610 Jun 20 07:07:21.167150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 19/39] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:20 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1298 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:21.201036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a9004a3e-0997-49d6-a04e-c5685c729f1d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:21.202125 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a9004a3e-0997-49d6-a04e-c5685c729f1d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:21.213788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9004a3e-0997-49d6-a04e-c5685c729f1d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:21.222891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9004a3e-0997-49d6-a04e-c5685c729f1d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:21.226036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9004a3e-0997-49d6-a04e-c5685c729f1d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:21.226635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9004a3e-0997-49d6-a04e-c5685c729f1d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:21.460086 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1aa258a1-7fb1-4b05-9cef-5c74cd67a0d2 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:21.489441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1aa258a1-7fb1-4b05-9cef-5c74cd67a0d2 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1272 microversion: 2.1 time: 0.798864 Jun 20 07:07:21.492953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 21/40] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:20 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1272 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:21.515003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d5d6f7be-67ae-499f-9b0e-4669c2fa9080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:21.526230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d5d6f7be-67ae-499f-9b0e-4669c2fa9080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:21.550486 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5d6f7be-67ae-499f-9b0e-4669c2fa9080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:21.553662 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5d6f7be-67ae-499f-9b0e-4669c2fa9080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:21.556426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5d6f7be-67ae-499f-9b0e-4669c2fa9080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:21.566868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5d6f7be-67ae-499f-9b0e-4669c2fa9080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:21.870812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a9004a3e-0997-49d6-a04e-c5685c729f1d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:21.887187 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a9004a3e-0997-49d6-a04e-c5685c729f1d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1295 microversion: 2.1 time: 0.706845 Jun 20 07:07:21.892256 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 20/41] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:21 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1295 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:21.929315 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4ffc2609-c71a-4de5-911d-a23ca5ae2fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:21.931070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4ffc2609-c71a-4de5-911d-a23ca5ae2fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:21.974034 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ffc2609-c71a-4de5-911d-a23ca5ae2fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:21.983956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ffc2609-c71a-4de5-911d-a23ca5ae2fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:21.984938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ffc2609-c71a-4de5-911d-a23ca5ae2fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:21.985402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ffc2609-c71a-4de5-911d-a23ca5ae2fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:22.144827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d5d6f7be-67ae-499f-9b0e-4669c2fa9080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:22.157233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d5d6f7be-67ae-499f-9b0e-4669c2fa9080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1279 microversion: 2.1 time: 0.661805 Jun 20 07:07:22.162541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 22/42] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:21 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1279 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:22.205547 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1a42e5ce-20b7-4fb8-8e7b-c8beb30217fc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:22.207100 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a42e5ce-20b7-4fb8-8e7b-c8beb30217fc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:22.237629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a42e5ce-20b7-4fb8-8e7b-c8beb30217fc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:22.240568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a42e5ce-20b7-4fb8-8e7b-c8beb30217fc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:22.244024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a42e5ce-20b7-4fb8-8e7b-c8beb30217fc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:22.244847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a42e5ce-20b7-4fb8-8e7b-c8beb30217fc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:22.324750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ffc2609-c71a-4de5-911d-a23ca5ae2fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:22.352940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ffc2609-c71a-4de5-911d-a23ca5ae2fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:22.355060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ffc2609-c71a-4de5-911d-a23ca5ae2fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:22.358404 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4ffc2609-c71a-4de5-911d-a23ca5ae2fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1338 microversion: 2.20 time: 0.464517 Jun 20 07:07:22.362876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 21/43] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:21 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1338 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:22.507701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c820d438-444f-4e3f-a133-b88593c9cfef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:22.508257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c820d438-444f-4e3f-a133-b88593c9cfef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:22.519028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c820d438-444f-4e3f-a133-b88593c9cfef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:22.520958 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c820d438-444f-4e3f-a133-b88593c9cfef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:22.521856 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c820d438-444f-4e3f-a133-b88593c9cfef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:22.522341 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c820d438-444f-4e3f-a133-b88593c9cfef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:22.806456 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1a42e5ce-20b7-4fb8-8e7b-c8beb30217fc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:22.818643 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1a42e5ce-20b7-4fb8-8e7b-c8beb30217fc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1298 microversion: 2.1 time: 0.632230 Jun 20 07:07:22.819220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 23/44] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:22 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1298 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:22.909685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-13e35745-621f-4f29-8cc2-a23e0bcc3ada tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:22.909685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-13e35745-621f-4f29-8cc2-a23e0bcc3ada tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:22.913707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:22.934230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13e35745-621f-4f29-8cc2-a23e0bcc3ada tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:22.938209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13e35745-621f-4f29-8cc2-a23e0bcc3ada tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:22.945226 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13e35745-621f-4f29-8cc2-a23e0bcc3ada tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:22.946695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c820d438-444f-4e3f-a133-b88593c9cfef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:22.948988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13e35745-621f-4f29-8cc2-a23e0bcc3ada tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:22.960722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c820d438-444f-4e3f-a133-b88593c9cfef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1272 microversion: 2.1 time: 0.455348 Jun 20 07:07:22.964706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 22/45] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:22 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1272 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:23.112842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-13e35745-621f-4f29-8cc2-a23e0bcc3ada tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:23.129420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-13e35745-621f-4f29-8cc2-a23e0bcc3ada tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1295 microversion: 2.1 time: 0.223568 Jun 20 07:07:23.131507 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 24/46] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:22 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1295 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:23.185718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ec39990b-ded2-4886-a2aa-7caa3de002e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:23.187052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ec39990b-ded2-4886-a2aa-7caa3de002e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:23.204887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec39990b-ded2-4886-a2aa-7caa3de002e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:23.206727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec39990b-ded2-4886-a2aa-7caa3de002e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:23.208334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec39990b-ded2-4886-a2aa-7caa3de002e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:23.211593 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec39990b-ded2-4886-a2aa-7caa3de002e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:23.379834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dd9b13f5-255f-4775-be97-99f950eee2c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:23.380404 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dd9b13f5-255f-4775-be97-99f950eee2c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:23.390312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd9b13f5-255f-4775-be97-99f950eee2c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:23.394403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd9b13f5-255f-4775-be97-99f950eee2c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:23.396901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd9b13f5-255f-4775-be97-99f950eee2c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:23.400858 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd9b13f5-255f-4775-be97-99f950eee2c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:23.488144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ec39990b-ded2-4886-a2aa-7caa3de002e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:23.499520 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ec39990b-ded2-4886-a2aa-7caa3de002e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1279 microversion: 2.1 time: 0.324423 Jun 20 07:07:23.504405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 23/47] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:23 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1279 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:23.806097 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dd9b13f5-255f-4775-be97-99f950eee2c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:23.827559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dd9b13f5-255f-4775-be97-99f950eee2c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:23.837397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-00d78a3c-7a75-477a-b035-40fcdba258d6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:23.838205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-00d78a3c-7a75-477a-b035-40fcdba258d6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:23.851900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dd9b13f5-255f-4775-be97-99f950eee2c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:23.860383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00d78a3c-7a75-477a-b035-40fcdba258d6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:23.860977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dd9b13f5-255f-4775-be97-99f950eee2c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1338 microversion: 2.20 time: 0.484371 Jun 20 07:07:23.866162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00d78a3c-7a75-477a-b035-40fcdba258d6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:23.866603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 25/48] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:23 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1338 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:23.873199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00d78a3c-7a75-477a-b035-40fcdba258d6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:23.873199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00d78a3c-7a75-477a-b035-40fcdba258d6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:23.980992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-28ff6426-2232-436c-8b75-d7b3712e4c3e tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:23.981710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-28ff6426-2232-436c-8b75-d7b3712e4c3e tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:24.006521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28ff6426-2232-436c-8b75-d7b3712e4c3e tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:24.007000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28ff6426-2232-436c-8b75-d7b3712e4c3e tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:24.007827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28ff6426-2232-436c-8b75-d7b3712e4c3e tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:24.018730 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28ff6426-2232-436c-8b75-d7b3712e4c3e tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:24.193524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-00d78a3c-7a75-477a-b035-40fcdba258d6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:24.206422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-00d78a3c-7a75-477a-b035-40fcdba258d6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1298 microversion: 2.1 time: 0.373445 Jun 20 07:07:24.208489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 24/49] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:23 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1298 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:24.219978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7a785851-b0d8-4b84-b4fa-dda3439cc018 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:24.221647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7a785851-b0d8-4b84-b4fa-dda3439cc018 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:24.241095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a785851-b0d8-4b84-b4fa-dda3439cc018 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:24.248469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a785851-b0d8-4b84-b4fa-dda3439cc018 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:24.249679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a785851-b0d8-4b84-b4fa-dda3439cc018 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:24.256185 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a785851-b0d8-4b84-b4fa-dda3439cc018 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:24.422049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7a785851-b0d8-4b84-b4fa-dda3439cc018 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:24.430149 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7a785851-b0d8-4b84-b4fa-dda3439cc018 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1295 microversion: 2.1 time: 0.220351 Jun 20 07:07:24.437453 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 25/50] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:24 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1295 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:24.521943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-165993fb-f5c1-4b7f-9952-89af576ac6ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:24.523583 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-165993fb-f5c1-4b7f-9952-89af576ac6ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:24.540915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-165993fb-f5c1-4b7f-9952-89af576ac6ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:24.542902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-165993fb-f5c1-4b7f-9952-89af576ac6ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:24.545633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-165993fb-f5c1-4b7f-9952-89af576ac6ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:24.549096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-165993fb-f5c1-4b7f-9952-89af576ac6ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:24.836272 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-165993fb-f5c1-4b7f-9952-89af576ac6ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:24.845782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-165993fb-f5c1-4b7f-9952-89af576ac6ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1279 microversion: 2.1 time: 0.330636 Jun 20 07:07:24.864466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 26/51] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:24 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1279 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:24.890053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-541c1dec-35e5-46b8-808d-e3ccdf2bc4f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:24.890658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-541c1dec-35e5-46b8-808d-e3ccdf2bc4f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:24.908826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-541c1dec-35e5-46b8-808d-e3ccdf2bc4f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:24.912681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-541c1dec-35e5-46b8-808d-e3ccdf2bc4f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:24.914035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-541c1dec-35e5-46b8-808d-e3ccdf2bc4f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:24.914630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-541c1dec-35e5-46b8-808d-e3ccdf2bc4f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:25.069365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-28ff6426-2232-436c-8b75-d7b3712e4c3e tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:25.090345 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-28ff6426-2232-436c-8b75-d7b3712e4c3e tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 1.113346 Jun 20 07:07:25.096446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 26/52] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:23 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:25.225078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9d3f1b24-84db-4c53-882f-120645aea37f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:25.225966 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9d3f1b24-84db-4c53-882f-120645aea37f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:25.243821 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d3f1b24-84db-4c53-882f-120645aea37f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:25.244600 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d3f1b24-84db-4c53-882f-120645aea37f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:25.252542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d3f1b24-84db-4c53-882f-120645aea37f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:25.259002 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d3f1b24-84db-4c53-882f-120645aea37f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:25.351823 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-541c1dec-35e5-46b8-808d-e3ccdf2bc4f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:25.379817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-541c1dec-35e5-46b8-808d-e3ccdf2bc4f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:25.389317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-541c1dec-35e5-46b8-808d-e3ccdf2bc4f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:25.394945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-541c1dec-35e5-46b8-808d-e3ccdf2bc4f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1338 microversion: 2.20 time: 0.509568 Jun 20 07:07:25.395600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 27/53] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:24 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1338 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:25.454659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-93ccd017-74fb-4801-a60e-c66e8cf77a6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:25.455494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-93ccd017-74fb-4801-a60e-c66e8cf77a6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:25.474710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93ccd017-74fb-4801-a60e-c66e8cf77a6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:25.475218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93ccd017-74fb-4801-a60e-c66e8cf77a6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:25.476204 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93ccd017-74fb-4801-a60e-c66e8cf77a6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:25.488728 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93ccd017-74fb-4801-a60e-c66e8cf77a6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:26.484223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-93ccd017-74fb-4801-a60e-c66e8cf77a6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:26.499999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-93ccd017-74fb-4801-a60e-c66e8cf77a6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 1.049997 Jun 20 07:07:26.500794 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 28/54] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:25 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:26.505926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-483fdf14-8075-4c44-8784-42f97466670f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:26.517102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-483fdf14-8075-4c44-8784-42f97466670f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:26.535475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-483fdf14-8075-4c44-8784-42f97466670f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:26.536052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-483fdf14-8075-4c44-8784-42f97466670f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:26.537145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-483fdf14-8075-4c44-8784-42f97466670f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:26.537761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-483fdf14-8075-4c44-8784-42f97466670f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:26.732887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-483fdf14-8075-4c44-8784-42f97466670f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:26.741409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-483fdf14-8075-4c44-8784-42f97466670f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1279 microversion: 2.1 time: 0.239285 Jun 20 07:07:26.752215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 29/55] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:26 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:26.759303 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6442e260-93de-4c99-9623-548cb5212d56 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:26.763929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9d3f1b24-84db-4c53-882f-120645aea37f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:26.777626 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9d3f1b24-84db-4c53-882f-120645aea37f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1366 microversion: 2.1 time: 1.557362 Jun 20 07:07:26.778445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 27/56] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:25 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1366 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:26.779439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6442e260-93de-4c99-9623-548cb5212d56 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:26.789300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-71876c68-0bca-4263-be58-2782275ddfbb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:26.795106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:26.796036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-71876c68-0bca-4263-be58-2782275ddfbb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:26.805476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6442e260-93de-4c99-9623-548cb5212d56 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:26.806052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6442e260-93de-4c99-9623-548cb5212d56 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:26.811129 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6442e260-93de-4c99-9623-548cb5212d56 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:26.811704 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6442e260-93de-4c99-9623-548cb5212d56 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:26.815279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=6 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:26.823286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71876c68-0bca-4263-be58-2782275ddfbb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:26.824057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71876c68-0bca-4263-be58-2782275ddfbb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:26.829466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71876c68-0bca-4263-be58-2782275ddfbb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:26.832382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71876c68-0bca-4263-be58-2782275ddfbb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:26.898386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:26.900994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:26.974358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=24 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:27.176955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-71876c68-0bca-4263-be58-2782275ddfbb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:27.186456 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-71876c68-0bca-4263-be58-2782275ddfbb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:27.189706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-71876c68-0bca-4263-be58-2782275ddfbb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:27.201535 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-71876c68-0bca-4263-be58-2782275ddfbb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1338 microversion: 2.20 time: 0.420861 Jun 20 07:07:27.208780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 28/57] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:26 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1338 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:27.517811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5025753a-82ae-4f48-a9a8-aced5a2699f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:27.518794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5025753a-82ae-4f48-a9a8-aced5a2699f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:27.546102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5025753a-82ae-4f48-a9a8-aced5a2699f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:27.546604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5025753a-82ae-4f48-a9a8-aced5a2699f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:27.558638 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5025753a-82ae-4f48-a9a8-aced5a2699f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:27.560660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5025753a-82ae-4f48-a9a8-aced5a2699f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:27.586369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6442e260-93de-4c99-9623-548cb5212d56 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:27.600965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6442e260-93de-4c99-9623-548cb5212d56 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.844940 Jun 20 07:07:27.602869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 30/58] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:26 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:27.759923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4c18e30b-cd61-4eaf-a3f7-76f257453cd4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:27.761669 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4c18e30b-cd61-4eaf-a3f7-76f257453cd4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:27.777120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c18e30b-cd61-4eaf-a3f7-76f257453cd4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:27.787993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c18e30b-cd61-4eaf-a3f7-76f257453cd4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:27.787993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c18e30b-cd61-4eaf-a3f7-76f257453cd4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:27.787993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c18e30b-cd61-4eaf-a3f7-76f257453cd4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:28.819842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=30 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:29.262551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5025753a-82ae-4f48-a9a8-aced5a2699f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:29.283295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5025753a-82ae-4f48-a9a8-aced5a2699f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 1.763141 Jun 20 07:07:29.288523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4c18e30b-cd61-4eaf-a3f7-76f257453cd4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:29.312593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:27 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:29.312793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4c18e30b-cd61-4eaf-a3f7-76f257453cd4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 1.555690 Jun 20 07:07:29.326949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 31/60] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:27 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:29.329795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8b1db80d-fa3b-478a-96d6-7b4b7d061218 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:29.341488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8b1db80d-fa3b-478a-96d6-7b4b7d061218 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:29.354901 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-38e72ed3-f4fc-4663-adb5-344ce7aa2b0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:29.358543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-38e72ed3-f4fc-4663-adb5-344ce7aa2b0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:29.369854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b1db80d-fa3b-478a-96d6-7b4b7d061218 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:29.379568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b1db80d-fa3b-478a-96d6-7b4b7d061218 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:29.381678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b1db80d-fa3b-478a-96d6-7b4b7d061218 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:29.382126 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b1db80d-fa3b-478a-96d6-7b4b7d061218 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:29.384279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38e72ed3-f4fc-4663-adb5-344ce7aa2b0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:29.385761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38e72ed3-f4fc-4663-adb5-344ce7aa2b0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:29.387569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38e72ed3-f4fc-4663-adb5-344ce7aa2b0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:29.388376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38e72ed3-f4fc-4663-adb5-344ce7aa2b0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:30.150467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8b1db80d-fa3b-478a-96d6-7b4b7d061218 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:30.163720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8b1db80d-fa3b-478a-96d6-7b4b7d061218 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1366 microversion: 2.1 time: 0.855593 Jun 20 07:07:30.165980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 30/61] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:29 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1366 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:30.178698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ca601b07-b018-4103-8318-7295b77efe88 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:30.179566 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ca601b07-b018-4103-8318-7295b77efe88 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:30.205634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca601b07-b018-4103-8318-7295b77efe88 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:30.209191 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca601b07-b018-4103-8318-7295b77efe88 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:30.210406 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca601b07-b018-4103-8318-7295b77efe88 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:30.214941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca601b07-b018-4103-8318-7295b77efe88 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:30.281699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:30.298388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-38e72ed3-f4fc-4663-adb5-344ce7aa2b0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:30.309907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-38e72ed3-f4fc-4663-adb5-344ce7aa2b0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:30.320794 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-38e72ed3-f4fc-4663-adb5-344ce7aa2b0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:30.323406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-38e72ed3-f4fc-4663-adb5-344ce7aa2b0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.992529 Jun 20 07:07:30.329018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:29 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:30.345332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4f1039b6-d601-424b-ae49-486d1d952f86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:30.360707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4f1039b6-d601-424b-ae49-486d1d952f86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:30.384854 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f1039b6-d601-424b-ae49-486d1d952f86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:30.395108 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f1039b6-d601-424b-ae49-486d1d952f86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:30.396351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f1039b6-d601-424b-ae49-486d1d952f86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:30.398248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f1039b6-d601-424b-ae49-486d1d952f86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:31.442403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca601b07-b018-4103-8318-7295b77efe88 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:31.457925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ca601b07-b018-4103-8318-7295b77efe88 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 1.288569 Jun 20 07:07:31.467060 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 31/63] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:30 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:31.478524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7ab73285-4ff1-468c-abbb-6ffe51132696 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:31.482737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7ab73285-4ff1-468c-abbb-6ffe51132696 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:31.514216 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ab73285-4ff1-468c-abbb-6ffe51132696 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:31.525381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ab73285-4ff1-468c-abbb-6ffe51132696 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:31.532737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ab73285-4ff1-468c-abbb-6ffe51132696 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:31.535428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ab73285-4ff1-468c-abbb-6ffe51132696 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:31.561714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4f1039b6-d601-424b-ae49-486d1d952f86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:31.574773 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4f1039b6-d601-424b-ae49-486d1d952f86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 1.244425 Jun 20 07:07:31.575419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 33/64] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:30 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:31.579966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ce28f196-8e88-4f00-9df7-d7e49faa377c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:31.613411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ce28f196-8e88-4f00-9df7-d7e49faa377c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:31.639199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce28f196-8e88-4f00-9df7-d7e49faa377c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:31.639767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce28f196-8e88-4f00-9df7-d7e49faa377c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:31.646363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce28f196-8e88-4f00-9df7-d7e49faa377c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:31.646828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce28f196-8e88-4f00-9df7-d7e49faa377c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:33.012907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce28f196-8e88-4f00-9df7-d7e49faa377c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:33.021275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ce28f196-8e88-4f00-9df7-d7e49faa377c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1366 microversion: 2.1 time: 1.444802 Jun 20 07:07:33.025406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 34/65] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:31 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1366 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:33.036962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-680724b3-ee92-4e1d-b16f-3e499f4c7b9d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:33.038627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-680724b3-ee92-4e1d-b16f-3e499f4c7b9d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:33.054305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-680724b3-ee92-4e1d-b16f-3e499f4c7b9d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:33.056445 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-680724b3-ee92-4e1d-b16f-3e499f4c7b9d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:33.057543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-680724b3-ee92-4e1d-b16f-3e499f4c7b9d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:33.059254 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-680724b3-ee92-4e1d-b16f-3e499f4c7b9d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:33.439688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7ab73285-4ff1-468c-abbb-6ffe51132696 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:33.489997 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7ab73285-4ff1-468c-abbb-6ffe51132696 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 2.021326 Jun 20 07:07:33.495630 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 32/66] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:31 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:34.004260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-92a9b8e8-68c2-4f6a-a629-de8c69369bbd req-e3634d59-7991-4656-b487-abc3715e5b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b09ad717-132f-4b7d-896e-48b569f56e34", "tag": "d4ec0034-9c02-41b8-881f-5fa07d109509"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:34.043275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-92a9b8e8-68c2-4f6a-a629-de8c69369bbd req-e3634d59-7991-4656-b487-abc3715e5b3c service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:34.044548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-92a9b8e8-68c2-4f6a-a629-de8c69369bbd req-e3634d59-7991-4656-b487-abc3715e5b3c service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:34.091774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-92a9b8e8-68c2-4f6a-a629-de8c69369bbd req-e3634d59-7991-4656-b487-abc3715e5b3c service nova] Creating event network-changed:d4ec0034-9c02-41b8-881f-5fa07d109509 for instance b09ad717-132f-4b7d-896e-48b569f56e34 on hv-cinder-77819 Jun 20 07:07:34.093420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-92a9b8e8-68c2-4f6a-a629-de8c69369bbd req-e3634d59-7991-4656-b487-abc3715e5b3c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117607) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 07:07:34.094811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85b31893-c967-43b9-a598-d01077442371 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:34.095918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85b31893-c967-43b9-a598-d01077442371 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:34.096976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85b31893-c967-43b9-a598-d01077442371 None None] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:34.097635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85b31893-c967-43b9-a598-d01077442371 None None] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:34.110009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.compute.rpcapi [None req-85b31893-c967-43b9-a598-d01077442371 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 07:07:34.111355 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85b31893-c967-43b9-a598-d01077442371 None None] Releasing lock "compute-rpcapi-router" {{(pid=117607) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 07:07:34.134915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-85b31893-c967-43b9-a598-d01077442371 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.631397 Jun 20 07:07:34.136218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 33/67] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:34.149267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e97c434-0708-47c4-a2a7-6215b56bbe9b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:34.150236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7e97c434-0708-47c4-a2a7-6215b56bbe9b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:34.158633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e97c434-0708-47c4-a2a7-6215b56bbe9b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:34.159399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e97c434-0708-47c4-a2a7-6215b56bbe9b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:34.161381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e97c434-0708-47c4-a2a7-6215b56bbe9b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:34.163119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e97c434-0708-47c4-a2a7-6215b56bbe9b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:34.355947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-680724b3-ee92-4e1d-b16f-3e499f4c7b9d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:34.382524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-680724b3-ee92-4e1d-b16f-3e499f4c7b9d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:34.390278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-680724b3-ee92-4e1d-b16f-3e499f4c7b9d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:34.391710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-680724b3-ee92-4e1d-b16f-3e499f4c7b9d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 1.364889 Jun 20 07:07:34.395782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:33 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:34.408605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1fcf8798-07f8-4341-bc33-0ff62bf2891e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:34.420850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1fcf8798-07f8-4341-bc33-0ff62bf2891e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:34.464334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fcf8798-07f8-4341-bc33-0ff62bf2891e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:34.465525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fcf8798-07f8-4341-bc33-0ff62bf2891e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:34.467297 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fcf8798-07f8-4341-bc33-0ff62bf2891e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:34.468044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fcf8798-07f8-4341-bc33-0ff62bf2891e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:34.881188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e97c434-0708-47c4-a2a7-6215b56bbe9b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:34.897638 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7e97c434-0708-47c4-a2a7-6215b56bbe9b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.759268 Jun 20 07:07:34.912409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 34/69] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:34 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:34.917323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c5ac5c93-1fcf-4de0-8d57-3b49902eec71 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:34.917935 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c5ac5c93-1fcf-4de0-8d57-3b49902eec71 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:34.934835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5ac5c93-1fcf-4de0-8d57-3b49902eec71 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:34.935499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5ac5c93-1fcf-4de0-8d57-3b49902eec71 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:34.936503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5ac5c93-1fcf-4de0-8d57-3b49902eec71 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:34.937118 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5ac5c93-1fcf-4de0-8d57-3b49902eec71 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:35.254122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1fcf8798-07f8-4341-bc33-0ff62bf2891e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:35.265369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1fcf8798-07f8-4341-bc33-0ff62bf2891e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 0.867413 Jun 20 07:07:35.266086 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 36/70] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:34 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:35.279336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca555b39-7a99-4fcb-adbe-2e6ef10ddcea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:35.281156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca555b39-7a99-4fcb-adbe-2e6ef10ddcea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:35.290644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca555b39-7a99-4fcb-adbe-2e6ef10ddcea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:35.291301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca555b39-7a99-4fcb-adbe-2e6ef10ddcea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:35.292300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca555b39-7a99-4fcb-adbe-2e6ef10ddcea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:35.292921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca555b39-7a99-4fcb-adbe-2e6ef10ddcea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:35.412605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c5ac5c93-1fcf-4de0-8d57-3b49902eec71 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:35.423449 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c5ac5c93-1fcf-4de0-8d57-3b49902eec71 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1366 microversion: 2.1 time: 0.509418 Jun 20 07:07:35.435026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 35/71] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:34 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1366 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:35.553524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-8fee3497-0d5c-4154-a624-ade312712b62 req-77066d44-4007-48cd-8f62-5b017bd8b37d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e214060-f046-41a1-b243-020c88edde42", "tag": "316c2317-90c4-4b27-bb5e-34a3153b065e"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:35.575248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-8fee3497-0d5c-4154-a624-ade312712b62 req-77066d44-4007-48cd-8f62-5b017bd8b37d service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:35.580957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-8fee3497-0d5c-4154-a624-ade312712b62 req-77066d44-4007-48cd-8f62-5b017bd8b37d service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:35.585601 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca555b39-7a99-4fcb-adbe-2e6ef10ddcea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:35.629236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-8fee3497-0d5c-4154-a624-ade312712b62 req-77066d44-4007-48cd-8f62-5b017bd8b37d service nova] Creating event network-changed:316c2317-90c4-4b27-bb5e-34a3153b065e for instance 0e214060-f046-41a1-b243-020c88edde42 on hv-cinder-77819 Jun 20 07:07:35.629626 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca555b39-7a99-4fcb-adbe-2e6ef10ddcea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.355637 Jun 20 07:07:35.634055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 37/72] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:35 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:35.649464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-985157a5-433f-4ce5-842f-10b7c99a8779 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:35.650084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-985157a5-433f-4ce5-842f-10b7c99a8779 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:35.654794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-8fee3497-0d5c-4154-a624-ade312712b62 req-77066d44-4007-48cd-8f62-5b017bd8b37d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217455 Jun 20 07:07:35.655414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 36/73] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:35.671947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-985157a5-433f-4ce5-842f-10b7c99a8779 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:35.672429 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-985157a5-433f-4ce5-842f-10b7c99a8779 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:35.678388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-985157a5-433f-4ce5-842f-10b7c99a8779 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:35.679106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-985157a5-433f-4ce5-842f-10b7c99a8779 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:35.889662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-985157a5-433f-4ce5-842f-10b7c99a8779 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:35.899627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-985157a5-433f-4ce5-842f-10b7c99a8779 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:35.901457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-985157a5-433f-4ce5-842f-10b7c99a8779 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:35.902834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-985157a5-433f-4ce5-842f-10b7c99a8779 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.267159 Jun 20 07:07:35.916491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:35 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:35.923521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-492fc296-e20b-4733-97d6-4f244cba1694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:35.924731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-492fc296-e20b-4733-97d6-4f244cba1694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:35.931917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-492fc296-e20b-4733-97d6-4f244cba1694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:35.932389 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-492fc296-e20b-4733-97d6-4f244cba1694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:35.933182 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-492fc296-e20b-4733-97d6-4f244cba1694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:35.933616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-492fc296-e20b-4733-97d6-4f244cba1694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:36.102359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-492fc296-e20b-4733-97d6-4f244cba1694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:36.111021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-492fc296-e20b-4733-97d6-4f244cba1694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.193309 Jun 20 07:07:36.124741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 37/75] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:35 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:36.242792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-9876b9c9-14ef-4827-81b1-8263b365311d req-daaa0589-2c1e-47bb-8558-75f488b579ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "184f7c82-c8b4-45cf-ba43-b6f17794e153", "tag": "9f060390-c538-4ca5-a4da-a0ff281045f1"}, {"name": "network-changed", "server_uuid": "fd99d933-7d4d-429a-9de4-d589c69c89c5", "tag": "c9d59064-4403-4327-b155-afc400b0b340"}, {"name": "network-changed", "server_uuid": "63d6b982-e069-44bd-8110-df44d83d451c", "tag": "d64665e9-c9cd-4584-98fa-4fc8c61bdd87"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:36.269459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-9876b9c9-14ef-4827-81b1-8263b365311d req-daaa0589-2c1e-47bb-8558-75f488b579ab service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:36.274118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-9876b9c9-14ef-4827-81b1-8263b365311d req-daaa0589-2c1e-47bb-8558-75f488b579ab service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:36.282914 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-751dda12-7d12-4dd2-a7b0-79db38ccbf7e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:36.283896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-751dda12-7d12-4dd2-a7b0-79db38ccbf7e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:36.293218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-751dda12-7d12-4dd2-a7b0-79db38ccbf7e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:36.297848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-751dda12-7d12-4dd2-a7b0-79db38ccbf7e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:36.302588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-751dda12-7d12-4dd2-a7b0-79db38ccbf7e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:36.303351 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-751dda12-7d12-4dd2-a7b0-79db38ccbf7e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:36.343233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-9876b9c9-14ef-4827-81b1-8263b365311d req-daaa0589-2c1e-47bb-8558-75f488b579ab service nova] Creating event network-changed:9f060390-c538-4ca5-a4da-a0ff281045f1 for instance 184f7c82-c8b4-45cf-ba43-b6f17794e153 on hv-cinder-77819 Jun 20 07:07:36.347152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-9876b9c9-14ef-4827-81b1-8263b365311d req-daaa0589-2c1e-47bb-8558-75f488b579ab service nova] Creating event network-changed:c9d59064-4403-4327-b155-afc400b0b340 for instance fd99d933-7d4d-429a-9de4-d589c69c89c5 on hv-cinder-77819 Jun 20 07:07:36.347914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-9876b9c9-14ef-4827-81b1-8263b365311d req-daaa0589-2c1e-47bb-8558-75f488b579ab service nova] Creating event network-changed:d64665e9-c9cd-4584-98fa-4fc8c61bdd87 for instance 63d6b982-e069-44bd-8110-df44d83d451c on hv-cinder-77819 Jun 20 07:07:36.348613 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-9876b9c9-14ef-4827-81b1-8263b365311d req-daaa0589-2c1e-47bb-8558-75f488b579ab service nova] Acquired lock "compute-rpcapi-router" {{(pid=117606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 07:07:36.350092 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3156b425-3bb3-4fb0-9bf7-a4a0ab84655d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:36.353418 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3156b425-3bb3-4fb0-9bf7-a4a0ab84655d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:36.354413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3156b425-3bb3-4fb0-9bf7-a4a0ab84655d None None] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:36.355500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3156b425-3bb3-4fb0-9bf7-a4a0ab84655d None None] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:36.375777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.compute.rpcapi [None req-3156b425-3bb3-4fb0-9bf7-a4a0ab84655d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 07:07:36.376802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3156b425-3bb3-4fb0-9bf7-a4a0ab84655d None None] Releasing lock "compute-rpcapi-router" {{(pid=117606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 07:07:36.404315 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3156b425-3bb3-4fb0-9bf7-a4a0ab84655d None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.166416 Jun 20 07:07:36.406170 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 39/76] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:36.441567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2332c64-87ed-48a3-bbd7-d70d8c785931 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:36.442277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c2332c64-87ed-48a3-bbd7-d70d8c785931 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:36.449375 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2332c64-87ed-48a3-bbd7-d70d8c785931 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:36.449843 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2332c64-87ed-48a3-bbd7-d70d8c785931 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:36.451139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2332c64-87ed-48a3-bbd7-d70d8c785931 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:36.451747 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2332c64-87ed-48a3-bbd7-d70d8c785931 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:36.974242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-751dda12-7d12-4dd2-a7b0-79db38ccbf7e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:36.984012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-751dda12-7d12-4dd2-a7b0-79db38ccbf7e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 0.704904 Jun 20 07:07:36.985220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 38/77] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:36 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:36.999998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2523004c-a908-4295-980a-7ee0a039ead8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:37.000686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2523004c-a908-4295-980a-7ee0a039ead8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:37.007177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2523004c-a908-4295-980a-7ee0a039ead8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:37.007616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2523004c-a908-4295-980a-7ee0a039ead8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:37.011096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c2332c64-87ed-48a3-bbd7-d70d8c785931 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:37.015724 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2523004c-a908-4295-980a-7ee0a039ead8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:37.016637 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2523004c-a908-4295-980a-7ee0a039ead8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:37.024442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c2332c64-87ed-48a3-bbd7-d70d8c785931 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1366 microversion: 2.1 time: 0.586993 Jun 20 07:07:37.025871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 40/78] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:36 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1366 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:37.035056 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a45097f6-18ad-472f-8a2d-5bcb1ca8c963 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:37.036396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a45097f6-18ad-472f-8a2d-5bcb1ca8c963 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:37.046722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a45097f6-18ad-472f-8a2d-5bcb1ca8c963 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:37.047533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a45097f6-18ad-472f-8a2d-5bcb1ca8c963 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:37.048639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a45097f6-18ad-472f-8a2d-5bcb1ca8c963 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:37.051414 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a45097f6-18ad-472f-8a2d-5bcb1ca8c963 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:37.349743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2523004c-a908-4295-980a-7ee0a039ead8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:37.360039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2523004c-a908-4295-980a-7ee0a039ead8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.364118 Jun 20 07:07:37.361912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 39/79] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:36 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:37.374478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a45097f6-18ad-472f-8a2d-5bcb1ca8c963 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:37.383771 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a45097f6-18ad-472f-8a2d-5bcb1ca8c963 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:37.385576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a45097f6-18ad-472f-8a2d-5bcb1ca8c963 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:37.386301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-183f7bab-fb9f-4946-a43e-50c4af6cc0b3 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:37.387173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-183f7bab-fb9f-4946-a43e-50c4af6cc0b3 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:37.387422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a45097f6-18ad-472f-8a2d-5bcb1ca8c963 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.359910 Jun 20 07:07:37.388510 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 41/80] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:37 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:37.407005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-183f7bab-fb9f-4946-a43e-50c4af6cc0b3 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:37.408002 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-183f7bab-fb9f-4946-a43e-50c4af6cc0b3 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:37.409250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-183f7bab-fb9f-4946-a43e-50c4af6cc0b3 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:37.409888 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-183f7bab-fb9f-4946-a43e-50c4af6cc0b3 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:37.674362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-8d24f8f3-d9c3-4da1-861d-6add507b0bfb req-4e6a58ac-0719-441a-a59b-e27279e0936a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c3378a3-113f-4381-91ac-4478c0a3371d", "tag": "022b9a11-cfc5-443c-a77c-b63c7232b0dd"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:37.682620 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-8d24f8f3-d9c3-4da1-861d-6add507b0bfb req-4e6a58ac-0719-441a-a59b-e27279e0936a service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:37.683268 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-8d24f8f3-d9c3-4da1-861d-6add507b0bfb req-4e6a58ac-0719-441a-a59b-e27279e0936a service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:37.696234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-183f7bab-fb9f-4946-a43e-50c4af6cc0b3 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:37.702123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-183f7bab-fb9f-4946-a43e-50c4af6cc0b3 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.323770 Jun 20 07:07:37.702381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-8d24f8f3-d9c3-4da1-861d-6add507b0bfb req-4e6a58ac-0719-441a-a59b-e27279e0936a service nova] Creating event network-changed:022b9a11-cfc5-443c-a77c-b63c7232b0dd for instance 6c3378a3-113f-4381-91ac-4478c0a3371d on hv-cinder-77819 Jun 20 07:07:37.708222 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 40/81] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:37 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:37.715545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-8d24f8f3-d9c3-4da1-861d-6add507b0bfb req-4e6a58ac-0719-441a-a59b-e27279e0936a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044719 Jun 20 07:07:37.716721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 42/82] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:07:38.002431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ba95a013-af80-418c-b4a1-1be3351a0860 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:38.003036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ba95a013-af80-418c-b4a1-1be3351a0860 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:38.008963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba95a013-af80-418c-b4a1-1be3351a0860 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:38.009409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba95a013-af80-418c-b4a1-1be3351a0860 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:38.010170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba95a013-af80-418c-b4a1-1be3351a0860 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:38.010601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba95a013-af80-418c-b4a1-1be3351a0860 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:38.043320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1f283bbc-4696-44a5-b760-bcaa3967a73b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:38.045343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1f283bbc-4696-44a5-b760-bcaa3967a73b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:38.053093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f283bbc-4696-44a5-b760-bcaa3967a73b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:38.053754 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f283bbc-4696-44a5-b760-bcaa3967a73b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:38.055047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f283bbc-4696-44a5-b760-bcaa3967a73b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:38.055648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f283bbc-4696-44a5-b760-bcaa3967a73b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:38.282256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ba95a013-af80-418c-b4a1-1be3351a0860 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:38.288661 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1f283bbc-4696-44a5-b760-bcaa3967a73b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:38.295066 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ba95a013-af80-418c-b4a1-1be3351a0860 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 0.294639 Jun 20 07:07:38.297123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 41/83] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:37 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:38.300161 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1f283bbc-4696-44a5-b760-bcaa3967a73b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1366 microversion: 2.1 time: 0.260876 Jun 20 07:07:38.300721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 43/84] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:38 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:38.378736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b47cd25c-e77d-4e72-af2c-e6c92002b85d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:38.379732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b47cd25c-e77d-4e72-af2c-e6c92002b85d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:38.386702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b47cd25c-e77d-4e72-af2c-e6c92002b85d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:38.387693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b47cd25c-e77d-4e72-af2c-e6c92002b85d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:38.388811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b47cd25c-e77d-4e72-af2c-e6c92002b85d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:38.389613 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b47cd25c-e77d-4e72-af2c-e6c92002b85d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:38.407612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-48709916-0e4a-4be6-879b-2b5fd5c4e0de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:38.408356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-48709916-0e4a-4be6-879b-2b5fd5c4e0de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:38.420275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48709916-0e4a-4be6-879b-2b5fd5c4e0de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:38.420275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48709916-0e4a-4be6-879b-2b5fd5c4e0de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:38.420275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48709916-0e4a-4be6-879b-2b5fd5c4e0de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:38.420931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48709916-0e4a-4be6-879b-2b5fd5c4e0de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:38.691203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b47cd25c-e77d-4e72-af2c-e6c92002b85d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:38.711610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b47cd25c-e77d-4e72-af2c-e6c92002b85d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.335670 Jun 20 07:07:38.713103 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 42/85] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:38 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:38.721628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48709916-0e4a-4be6-879b-2b5fd5c4e0de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:38.727956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aeef2656-bab3-408f-a0b6-3155c3a3ef06 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:38.728725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aeef2656-bab3-408f-a0b6-3155c3a3ef06 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:38.731005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48709916-0e4a-4be6-879b-2b5fd5c4e0de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:38.732595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48709916-0e4a-4be6-879b-2b5fd5c4e0de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:38.735469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-48709916-0e4a-4be6-879b-2b5fd5c4e0de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.332910 Jun 20 07:07:38.736029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 44/86] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:38 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:38.743228 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aeef2656-bab3-408f-a0b6-3155c3a3ef06 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:38.743675 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aeef2656-bab3-408f-a0b6-3155c3a3ef06 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:38.744469 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aeef2656-bab3-408f-a0b6-3155c3a3ef06 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:38.744903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aeef2656-bab3-408f-a0b6-3155c3a3ef06 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:39.132858 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-aeef2656-bab3-408f-a0b6-3155c3a3ef06 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:39.141944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aeef2656-bab3-408f-a0b6-3155c3a3ef06 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.417694 Jun 20 07:07:39.142533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 43/87] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:38 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:39.314615 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6e89c0c3-7bdc-4e8b-bf17-6f033d368ac0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:39.315472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6e89c0c3-7bdc-4e8b-bf17-6f033d368ac0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:39.316848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fc4172ce-a546-4aa6-8039-ced2ab45cba6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:39.317642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fc4172ce-a546-4aa6-8039-ced2ab45cba6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:39.328011 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e89c0c3-7bdc-4e8b-bf17-6f033d368ac0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:39.328781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e89c0c3-7bdc-4e8b-bf17-6f033d368ac0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:39.329657 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e89c0c3-7bdc-4e8b-bf17-6f033d368ac0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:39.329921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4172ce-a546-4aa6-8039-ced2ab45cba6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:39.330294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e89c0c3-7bdc-4e8b-bf17-6f033d368ac0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:39.330572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4172ce-a546-4aa6-8039-ced2ab45cba6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:39.331341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4172ce-a546-4aa6-8039-ced2ab45cba6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:39.331775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4172ce-a546-4aa6-8039-ced2ab45cba6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:39.584813 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fc4172ce-a546-4aa6-8039-ced2ab45cba6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:39.596267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fc4172ce-a546-4aa6-8039-ced2ab45cba6 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1366 microversion: 2.1 time: 0.283043 Jun 20 07:07:39.607292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 44/88] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:39 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:39.608199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6e89c0c3-7bdc-4e8b-bf17-6f033d368ac0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:39.619155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6e89c0c3-7bdc-4e8b-bf17-6f033d368ac0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 0.309163 Jun 20 07:07:39.621654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 45/89] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:39 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:39.730911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e55d9ee-87f7-43db-864b-91610d568a08 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:39.732181 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e55d9ee-87f7-43db-864b-91610d568a08 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:39.745578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e55d9ee-87f7-43db-864b-91610d568a08 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:39.748565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e55d9ee-87f7-43db-864b-91610d568a08 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:39.750051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e55d9ee-87f7-43db-864b-91610d568a08 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:39.751307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e55d9ee-87f7-43db-864b-91610d568a08 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:39.753082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d0276361-04cf-4ccf-97df-e4e47636a644 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:39.753984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d0276361-04cf-4ccf-97df-e4e47636a644 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:39.762235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0276361-04cf-4ccf-97df-e4e47636a644 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:39.763061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0276361-04cf-4ccf-97df-e4e47636a644 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:39.771280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0276361-04cf-4ccf-97df-e4e47636a644 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:39.772884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0276361-04cf-4ccf-97df-e4e47636a644 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:40.026183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6e55d9ee-87f7-43db-864b-91610d568a08 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:40.035091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e55d9ee-87f7-43db-864b-91610d568a08 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.308529 Jun 20 07:07:40.036210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 45/90] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:39 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:40.077496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d0276361-04cf-4ccf-97df-e4e47636a644 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:40.085967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d0276361-04cf-4ccf-97df-e4e47636a644 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:40.087525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d0276361-04cf-4ccf-97df-e4e47636a644 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:40.088890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d0276361-04cf-4ccf-97df-e4e47636a644 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.339634 Jun 20 07:07:40.090084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 46/91] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:39 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:40.159384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1680feca-8a67-4864-8dc2-358256d29398 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:40.160005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1680feca-8a67-4864-8dc2-358256d29398 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:40.167864 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1680feca-8a67-4864-8dc2-358256d29398 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:40.168534 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1680feca-8a67-4864-8dc2-358256d29398 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:40.170132 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1680feca-8a67-4864-8dc2-358256d29398 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:40.170514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1680feca-8a67-4864-8dc2-358256d29398 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:40.309275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1680feca-8a67-4864-8dc2-358256d29398 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:40.317594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1680feca-8a67-4864-8dc2-358256d29398 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.162808 Jun 20 07:07:40.318373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 46/92] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:40 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:40.614385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-207acd4e-d33a-453b-9fcc-c3754ccedecc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:40.615905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-207acd4e-d33a-453b-9fcc-c3754ccedecc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:40.623602 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-207acd4e-d33a-453b-9fcc-c3754ccedecc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:40.624612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-207acd4e-d33a-453b-9fcc-c3754ccedecc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:40.625585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-207acd4e-d33a-453b-9fcc-c3754ccedecc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:40.626090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-207acd4e-d33a-453b-9fcc-c3754ccedecc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:40.639523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e83aa14-9fcf-478e-b58f-3179354125f4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:40.640181 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e83aa14-9fcf-478e-b58f-3179354125f4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:40.654598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e83aa14-9fcf-478e-b58f-3179354125f4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:40.655445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e83aa14-9fcf-478e-b58f-3179354125f4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:40.657087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e83aa14-9fcf-478e-b58f-3179354125f4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:40.657750 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e83aa14-9fcf-478e-b58f-3179354125f4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:41.236833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-207acd4e-d33a-453b-9fcc-c3754ccedecc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:41.245945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-207acd4e-d33a-453b-9fcc-c3754ccedecc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1366 microversion: 2.1 time: 0.636134 Jun 20 07:07:41.247203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 47/93] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:40 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1366 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:41.252260 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cd98281e-4b3e-4a7a-bf00-45b553aa693b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:41.253143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cd98281e-4b3e-4a7a-bf00-45b553aa693b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:41.259506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd98281e-4b3e-4a7a-bf00-45b553aa693b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:41.260292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd98281e-4b3e-4a7a-bf00-45b553aa693b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:41.261271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd98281e-4b3e-4a7a-bf00-45b553aa693b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:41.262002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd98281e-4b3e-4a7a-bf00-45b553aa693b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:41.267896 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:41.323401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6e83aa14-9fcf-478e-b58f-3179354125f4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:41.333102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e83aa14-9fcf-478e-b58f-3179354125f4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 0.698090 Jun 20 07:07:41.343547 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 47/94] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:40 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:41.353409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c80e54f6-40c1-4217-bd86-5da384c89190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:41.354512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c80e54f6-40c1-4217-bd86-5da384c89190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:41.368006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c80e54f6-40c1-4217-bd86-5da384c89190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:41.369130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c80e54f6-40c1-4217-bd86-5da384c89190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:41.371342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c80e54f6-40c1-4217-bd86-5da384c89190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:41.372363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c80e54f6-40c1-4217-bd86-5da384c89190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:41.673863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cd98281e-4b3e-4a7a-bf00-45b553aa693b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:41.684236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cd98281e-4b3e-4a7a-bf00-45b553aa693b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.435690 Jun 20 07:07:41.689812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 48/95] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:41 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:41.700844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63c0b89d-3239-4187-a701-aa59c523f694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:41.705195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63c0b89d-3239-4187-a701-aa59c523f694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:41.739791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63c0b89d-3239-4187-a701-aa59c523f694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:41.740604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63c0b89d-3239-4187-a701-aa59c523f694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:41.742053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63c0b89d-3239-4187-a701-aa59c523f694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:41.744348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63c0b89d-3239-4187-a701-aa59c523f694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:41.763018 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c80e54f6-40c1-4217-bd86-5da384c89190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:41.776392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c80e54f6-40c1-4217-bd86-5da384c89190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:41.781305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c80e54f6-40c1-4217-bd86-5da384c89190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:41.782744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c80e54f6-40c1-4217-bd86-5da384c89190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.437691 Jun 20 07:07:41.784512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 48/96] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:41 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:41.883121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-75756d2f-11c3-4a43-810e-c95dc38dcdd8 req-c393a9b6-472a-453b-b2e5-2273e6996b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09ad717-132f-4b7d-896e-48b569f56e34", "name": "network-vif-plugged", "status": "completed", "tag": "d4ec0034-9c02-41b8-881f-5fa07d109509"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:41.898633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-75756d2f-11c3-4a43-810e-c95dc38dcdd8 req-c393a9b6-472a-453b-b2e5-2273e6996b79 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:41.899101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-75756d2f-11c3-4a43-810e-c95dc38dcdd8 req-c393a9b6-472a-453b-b2e5-2273e6996b79 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:41.917146 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:41.932274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-75756d2f-11c3-4a43-810e-c95dc38dcdd8 req-c393a9b6-472a-453b-b2e5-2273e6996b79 service nova] Creating event network-vif-plugged:d4ec0034-9c02-41b8-881f-5fa07d109509 for instance b09ad717-132f-4b7d-896e-48b569f56e34 on hv-cinder-77819 Jun 20 07:07:41.947668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-75756d2f-11c3-4a43-810e-c95dc38dcdd8 req-c393a9b6-472a-453b-b2e5-2273e6996b79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159239 Jun 20 07:07:41.948305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 49/97] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:42.072141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-63c0b89d-3239-4187-a701-aa59c523f694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:42.081110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63c0b89d-3239-4187-a701-aa59c523f694 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.389972 Jun 20 07:07:42.081987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 49/98] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:41 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:42.264261 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5d8b821a-e8cd-4e39-ae90-a1bff1a26c27 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:42.264958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5d8b821a-e8cd-4e39-ae90-a1bff1a26c27 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:42.283143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d8b821a-e8cd-4e39-ae90-a1bff1a26c27 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:42.283846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d8b821a-e8cd-4e39-ae90-a1bff1a26c27 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:42.286927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d8b821a-e8cd-4e39-ae90-a1bff1a26c27 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:42.288365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d8b821a-e8cd-4e39-ae90-a1bff1a26c27 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:42.363233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-52ba5961-9260-4057-8a96-11d605790efc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:42.364747 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-52ba5961-9260-4057-8a96-11d605790efc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:42.377599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52ba5961-9260-4057-8a96-11d605790efc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:42.378735 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52ba5961-9260-4057-8a96-11d605790efc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:42.382468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52ba5961-9260-4057-8a96-11d605790efc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:42.383102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52ba5961-9260-4057-8a96-11d605790efc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:42.694130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5d8b821a-e8cd-4e39-ae90-a1bff1a26c27 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:42.707304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5d8b821a-e8cd-4e39-ae90-a1bff1a26c27 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1366 microversion: 2.1 time: 0.447716 Jun 20 07:07:42.707893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 50/99] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:42 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:42.718936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ede4b2d4-4b9c-4adc-95d7-d9b4f2b2f058 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:42.721157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ede4b2d4-4b9c-4adc-95d7-d9b4f2b2f058 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:42.738598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ede4b2d4-4b9c-4adc-95d7-d9b4f2b2f058 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:42.739426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ede4b2d4-4b9c-4adc-95d7-d9b4f2b2f058 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:42.740631 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ede4b2d4-4b9c-4adc-95d7-d9b4f2b2f058 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:42.742886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ede4b2d4-4b9c-4adc-95d7-d9b4f2b2f058 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:42.834867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-52ba5961-9260-4057-8a96-11d605790efc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:42.845218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-52ba5961-9260-4057-8a96-11d605790efc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 0.489515 Jun 20 07:07:42.854755 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 50/100] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:42 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:42.857843 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4d139261-3770-482e-9639-764a9d794fb8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:42.858455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4d139261-3770-482e-9639-764a9d794fb8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:42.874362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d139261-3770-482e-9639-764a9d794fb8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:42.875133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d139261-3770-482e-9639-764a9d794fb8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:42.875937 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d139261-3770-482e-9639-764a9d794fb8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:42.876440 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d139261-3770-482e-9639-764a9d794fb8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:43.057700 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ede4b2d4-4b9c-4adc-95d7-d9b4f2b2f058 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:43.069504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ede4b2d4-4b9c-4adc-95d7-d9b4f2b2f058 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.358791 Jun 20 07:07:43.072409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 51/101] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:42 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:43.099991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15da4ffb-8022-457c-882c-670f5f587159 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:43.100928 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-15da4ffb-8022-457c-882c-670f5f587159 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:43.116527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15da4ffb-8022-457c-882c-670f5f587159 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:43.117280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15da4ffb-8022-457c-882c-670f5f587159 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:43.118425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15da4ffb-8022-457c-882c-670f5f587159 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:43.119104 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15da4ffb-8022-457c-882c-670f5f587159 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:43.212900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d139261-3770-482e-9639-764a9d794fb8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:43.229342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d139261-3770-482e-9639-764a9d794fb8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:43.234504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d139261-3770-482e-9639-764a9d794fb8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:43.237332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4d139261-3770-482e-9639-764a9d794fb8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.383744 Jun 20 07:07:43.248807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 51/102] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:43.363099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-15da4ffb-8022-457c-882c-670f5f587159 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:43.378577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-15da4ffb-8022-457c-882c-670f5f587159 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.283397 Jun 20 07:07:43.380450 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 52/103] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:43 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:43.729593 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-10809da4-9495-4d40-91e6-e91f14331fe1 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:43.730516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-10809da4-9495-4d40-91e6-e91f14331fe1 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:43.740966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10809da4-9495-4d40-91e6-e91f14331fe1 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:43.741656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10809da4-9495-4d40-91e6-e91f14331fe1 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:43.743756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10809da4-9495-4d40-91e6-e91f14331fe1 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:43.744841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10809da4-9495-4d40-91e6-e91f14331fe1 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:43.863627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2a5c260d-4c54-4098-a860-5050b732b2e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:43.865269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2a5c260d-4c54-4098-a860-5050b732b2e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:43.881756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a5c260d-4c54-4098-a860-5050b732b2e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:43.883094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a5c260d-4c54-4098-a860-5050b732b2e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:43.884617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a5c260d-4c54-4098-a860-5050b732b2e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:43.885449 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2a5c260d-4c54-4098-a860-5050b732b2e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:44.108244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:44.128120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-10809da4-9495-4d40-91e6-e91f14331fe1 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:44.139389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-10809da4-9495-4d40-91e6-e91f14331fe1 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1366 microversion: 2.1 time: 0.418707 Jun 20 07:07:44.150311 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 52/104] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:43 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:44.154179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2a5c260d-4c54-4098-a860-5050b732b2e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:44.158514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b4eee2ff-95be-4364-92ab-10e7f8d5c44b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:44.159449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b4eee2ff-95be-4364-92ab-10e7f8d5c44b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:44.162343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2a5c260d-4c54-4098-a860-5050b732b2e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 0.303719 Jun 20 07:07:44.166911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 53/105] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:43 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:44.173373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4eee2ff-95be-4364-92ab-10e7f8d5c44b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:44.174090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4eee2ff-95be-4364-92ab-10e7f8d5c44b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:44.175113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4eee2ff-95be-4364-92ab-10e7f8d5c44b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:44.176280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4eee2ff-95be-4364-92ab-10e7f8d5c44b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:44.255881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8593cb72-565c-4fa5-a967-8876ddf523c0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:44.264494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8593cb72-565c-4fa5-a967-8876ddf523c0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:44.279324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8593cb72-565c-4fa5-a967-8876ddf523c0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:44.280602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8593cb72-565c-4fa5-a967-8876ddf523c0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:44.281889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8593cb72-565c-4fa5-a967-8876ddf523c0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:44.283072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8593cb72-565c-4fa5-a967-8876ddf523c0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:44.476859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b4eee2ff-95be-4364-92ab-10e7f8d5c44b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:44.487083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b4eee2ff-95be-4364-92ab-10e7f8d5c44b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.335195 Jun 20 07:07:44.491295 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 53/106] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:44 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:44.502630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-49a75527-8ce1-4316-bddc-a1364d524977 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:44.503929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-49a75527-8ce1-4316-bddc-a1364d524977 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:44.510539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49a75527-8ce1-4316-bddc-a1364d524977 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:44.511109 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49a75527-8ce1-4316-bddc-a1364d524977 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:44.512994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49a75527-8ce1-4316-bddc-a1364d524977 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:44.513646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49a75527-8ce1-4316-bddc-a1364d524977 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:44.529574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8593cb72-565c-4fa5-a967-8876ddf523c0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:44.544381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8593cb72-565c-4fa5-a967-8876ddf523c0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:44.547261 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8593cb72-565c-4fa5-a967-8876ddf523c0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:44.548792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8593cb72-565c-4fa5-a967-8876ddf523c0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.296579 Jun 20 07:07:44.549756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 54/107] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:44 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:07:44.679610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-49a75527-8ce1-4316-bddc-a1364d524977 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:44.689190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-49a75527-8ce1-4316-bddc-a1364d524977 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.196000 Jun 20 07:07:44.689755 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 54/108] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:44 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:45.158020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b9397664-3b4f-411c-8f3a-bb53a8988017 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:45.159529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b9397664-3b4f-411c-8f3a-bb53a8988017 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:45.168079 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9397664-3b4f-411c-8f3a-bb53a8988017 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:45.169271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9397664-3b4f-411c-8f3a-bb53a8988017 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:45.170234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9397664-3b4f-411c-8f3a-bb53a8988017 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:45.170858 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9397664-3b4f-411c-8f3a-bb53a8988017 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:45.188892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4f0d913b-51a7-4012-920d-fb9189112a04 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:45.189525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4f0d913b-51a7-4012-920d-fb9189112a04 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:45.209386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f0d913b-51a7-4012-920d-fb9189112a04 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:45.213967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f0d913b-51a7-4012-920d-fb9189112a04 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:45.214834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f0d913b-51a7-4012-920d-fb9189112a04 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:45.220417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f0d913b-51a7-4012-920d-fb9189112a04 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:45.483327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b9397664-3b4f-411c-8f3a-bb53a8988017 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:45.497632 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b9397664-3b4f-411c-8f3a-bb53a8988017 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1556 microversion: 2.1 time: 0.344271 Jun 20 07:07:45.508143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 55/109] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:45 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1556 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:45.508143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-71b38d16-0ccd-4a01-a91d-48dd1fab098e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:45.508701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-71b38d16-0ccd-4a01-a91d-48dd1fab098e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:45.517203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71b38d16-0ccd-4a01-a91d-48dd1fab098e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:45.518074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71b38d16-0ccd-4a01-a91d-48dd1fab098e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:45.519604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71b38d16-0ccd-4a01-a91d-48dd1fab098e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:45.520386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71b38d16-0ccd-4a01-a91d-48dd1fab098e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:45.520625 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4f0d913b-51a7-4012-920d-fb9189112a04 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:45.530541 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4f0d913b-51a7-4012-920d-fb9189112a04 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 0.350357 Jun 20 07:07:45.531436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 55/110] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:45 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:45.536430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4a43f54f-884a-4f1b-9ec2-347b16c892d0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:45.537166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4a43f54f-884a-4f1b-9ec2-347b16c892d0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:45.544283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a43f54f-884a-4f1b-9ec2-347b16c892d0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:45.544971 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a43f54f-884a-4f1b-9ec2-347b16c892d0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:45.545900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a43f54f-884a-4f1b-9ec2-347b16c892d0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:45.546516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a43f54f-884a-4f1b-9ec2-347b16c892d0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:45.777424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-71b38d16-0ccd-4a01-a91d-48dd1fab098e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:45.788162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-71b38d16-0ccd-4a01-a91d-48dd1fab098e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.283775 Jun 20 07:07:45.793453 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 56/111] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:45 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:45.804152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-34eefb19-2520-45a8-ae0f-d058c5b4d354 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:45.810684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4a43f54f-884a-4f1b-9ec2-347b16c892d0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.277888 Jun 20 07:07:45.811462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 56/112] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 07:07:45 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/os-interface => generated 284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:45.816542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0d187be2-8aa9-43b7-a201-f345206edb0b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:45.817413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0d187be2-8aa9-43b7-a201-f345206edb0b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:45.818725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-34eefb19-2520-45a8-ae0f-d058c5b4d354 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:45.832160 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d187be2-8aa9-43b7-a201-f345206edb0b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:45.834470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34eefb19-2520-45a8-ae0f-d058c5b4d354 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:45.835142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d187be2-8aa9-43b7-a201-f345206edb0b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:45.836642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34eefb19-2520-45a8-ae0f-d058c5b4d354 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:45.837119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d187be2-8aa9-43b7-a201-f345206edb0b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:45.838306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d187be2-8aa9-43b7-a201-f345206edb0b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:45.839034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34eefb19-2520-45a8-ae0f-d058c5b4d354 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:45.841522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34eefb19-2520-45a8-ae0f-d058c5b4d354 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:46.157469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0d187be2-8aa9-43b7-a201-f345206edb0b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:46.175077 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0d187be2-8aa9-43b7-a201-f345206edb0b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.352955 Jun 20 07:07:46.175745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 57/113] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:45 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:46.196165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-2949e721-c775-43e4-a613-1a33d7e40bac req-33dc1543-9c9c-42e9-810c-7a9942c65c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184f7c82-c8b4-45cf-ba43-b6f17794e153", "name": "network-vif-plugged", "status": "completed", "tag": "9f060390-c538-4ca5-a4da-a0ff281045f1"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:46.213932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-34eefb19-2520-45a8-ae0f-d058c5b4d354 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:46.223923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-34eefb19-2520-45a8-ae0f-d058c5b4d354 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:46.229660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-34eefb19-2520-45a8-ae0f-d058c5b4d354 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:46.230809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-34eefb19-2520-45a8-ae0f-d058c5b4d354 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.434840 Jun 20 07:07:46.233642 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-2949e721-c775-43e4-a613-1a33d7e40bac req-33dc1543-9c9c-42e9-810c-7a9942c65c59 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:46.234017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-2949e721-c775-43e4-a613-1a33d7e40bac req-33dc1543-9c9c-42e9-810c-7a9942c65c59 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:46.235747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 57/114] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:45 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:46.254887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-2949e721-c775-43e4-a613-1a33d7e40bac req-33dc1543-9c9c-42e9-810c-7a9942c65c59 service nova] Creating event network-vif-plugged:9f060390-c538-4ca5-a4da-a0ff281045f1 for instance 184f7c82-c8b4-45cf-ba43-b6f17794e153 on hv-cinder-77819 Jun 20 07:07:46.266955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-2949e721-c775-43e4-a613-1a33d7e40bac req-33dc1543-9c9c-42e9-810c-7a9942c65c59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089085 Jun 20 07:07:46.268250 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 58/115] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:46.552266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8701eb31-a98e-4d08-89b8-16b1d3c2f519 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:46.553386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8701eb31-a98e-4d08-89b8-16b1d3c2f519 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:46.563721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8701eb31-a98e-4d08-89b8-16b1d3c2f519 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:46.564593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8701eb31-a98e-4d08-89b8-16b1d3c2f519 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:46.565661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8701eb31-a98e-4d08-89b8-16b1d3c2f519 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:46.566466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8701eb31-a98e-4d08-89b8-16b1d3c2f519 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:46.760852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8701eb31-a98e-4d08-89b8-16b1d3c2f519 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:46.774230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8701eb31-a98e-4d08-89b8-16b1d3c2f519 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 0.227137 Jun 20 07:07:46.776647 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 58/116] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:46 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:46.815475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-04c51fa2-b938-42c8-a40b-3065365a140e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:46.816518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-04c51fa2-b938-42c8-a40b-3065365a140e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:46.819482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:46.834103 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04c51fa2-b938-42c8-a40b-3065365a140e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:46.834564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04c51fa2-b938-42c8-a40b-3065365a140e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:46.835380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04c51fa2-b938-42c8-a40b-3065365a140e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:46.835745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04c51fa2-b938-42c8-a40b-3065365a140e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:47.025692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-04c51fa2-b938-42c8-a40b-3065365a140e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:47.036707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-04c51fa2-b938-42c8-a40b-3065365a140e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.227010 Jun 20 07:07:47.037763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 59/117] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:46 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:47.192226 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-999db6b3-b02c-4f88-8268-b21e58ebc42f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:47.193229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-999db6b3-b02c-4f88-8268-b21e58ebc42f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:47.203472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-999db6b3-b02c-4f88-8268-b21e58ebc42f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:47.205838 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-999db6b3-b02c-4f88-8268-b21e58ebc42f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:47.208767 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-999db6b3-b02c-4f88-8268-b21e58ebc42f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:47.209580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-999db6b3-b02c-4f88-8268-b21e58ebc42f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:47.254238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-15dce744-f3d4-4899-9711-622fcb1b4af4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:47.255648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-15dce744-f3d4-4899-9711-622fcb1b4af4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:47.264096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15dce744-f3d4-4899-9711-622fcb1b4af4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:47.264585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15dce744-f3d4-4899-9711-622fcb1b4af4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:47.266696 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15dce744-f3d4-4899-9711-622fcb1b4af4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:47.267145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15dce744-f3d4-4899-9711-622fcb1b4af4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:47.603556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-999db6b3-b02c-4f88-8268-b21e58ebc42f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:47.608806 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-15dce744-f3d4-4899-9711-622fcb1b4af4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:47.616786 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-999db6b3-b02c-4f88-8268-b21e58ebc42f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.427817 Jun 20 07:07:47.618465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 59/118] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:47 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:47.625912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-15dce744-f3d4-4899-9711-622fcb1b4af4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:47.629235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-15dce744-f3d4-4899-9711-622fcb1b4af4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:47.631436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-15dce744-f3d4-4899-9711-622fcb1b4af4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.381010 Jun 20 07:07:47.642294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 60/119] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:47 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:47.792973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7fe9b88a-e790-4b32-b5a1-7dafd3f130bc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:47.794297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7fe9b88a-e790-4b32-b5a1-7dafd3f130bc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:47.801580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fe9b88a-e790-4b32-b5a1-7dafd3f130bc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:47.802167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fe9b88a-e790-4b32-b5a1-7dafd3f130bc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:47.802935 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fe9b88a-e790-4b32-b5a1-7dafd3f130bc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:47.803886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fe9b88a-e790-4b32-b5a1-7dafd3f130bc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:47.975683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7fe9b88a-e790-4b32-b5a1-7dafd3f130bc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:47.995163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7fe9b88a-e790-4b32-b5a1-7dafd3f130bc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1362 microversion: 2.1 time: 0.202085 Jun 20 07:07:47.995163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 60/120] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:47 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:48.018724 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-bba13d0f-b2c7-4f76-87d7-536f15612287 req-6509d340-9810-4155-9b05-e765dbf410fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b09ad717-132f-4b7d-896e-48b569f56e34", "tag": "d4ec0034-9c02-41b8-881f-5fa07d109509"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:48.027673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-bba13d0f-b2c7-4f76-87d7-536f15612287 req-6509d340-9810-4155-9b05-e765dbf410fa service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:48.029083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-bba13d0f-b2c7-4f76-87d7-536f15612287 req-6509d340-9810-4155-9b05-e765dbf410fa service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:48.042028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-bba13d0f-b2c7-4f76-87d7-536f15612287 req-6509d340-9810-4155-9b05-e765dbf410fa service nova] Creating event network-changed:d4ec0034-9c02-41b8-881f-5fa07d109509 for instance b09ad717-132f-4b7d-896e-48b569f56e34 on hv-cinder-77819 Jun 20 07:07:48.051500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-bba13d0f-b2c7-4f76-87d7-536f15612287 req-6509d340-9810-4155-9b05-e765dbf410fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037077 Jun 20 07:07:48.052569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 61/121] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:48.056708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-61d83177-e07d-486a-b77e-da5f2dd24fc6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:48.057338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-61d83177-e07d-486a-b77e-da5f2dd24fc6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:48.063892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61d83177-e07d-486a-b77e-da5f2dd24fc6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:48.064378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61d83177-e07d-486a-b77e-da5f2dd24fc6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:48.066249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61d83177-e07d-486a-b77e-da5f2dd24fc6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:48.066701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61d83177-e07d-486a-b77e-da5f2dd24fc6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:48.241331 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-61d83177-e07d-486a-b77e-da5f2dd24fc6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:48.251182 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-61d83177-e07d-486a-b77e-da5f2dd24fc6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.200975 Jun 20 07:07:48.261110 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 61/122] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:48 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:48.302045 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-82d8c713-717f-439a-8483-167fd61277d8 req-202e54c3-83ce-4d2a-87f0-b66c29f70a96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d6b982-e069-44bd-8110-df44d83d451c", "name": "network-vif-plugged", "status": "completed", "tag": "d64665e9-c9cd-4584-98fa-4fc8c61bdd87"}, {"server_uuid": "fd99d933-7d4d-429a-9de4-d589c69c89c5", "name": "network-vif-plugged", "status": "completed", "tag": "c9d59064-4403-4327-b155-afc400b0b340"}, {"server_uuid": "6c3378a3-113f-4381-91ac-4478c0a3371d", "name": "network-vif-plugged", "status": "completed", "tag": "022b9a11-cfc5-443c-a77c-b63c7232b0dd"}, {"server_uuid": "0e214060-f046-41a1-b243-020c88edde42", "name": "network-vif-plugged", "status": "completed", "tag": "316c2317-90c4-4b27-bb5e-34a3153b065e"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:48.316722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-82d8c713-717f-439a-8483-167fd61277d8 req-202e54c3-83ce-4d2a-87f0-b66c29f70a96 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:48.317166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-82d8c713-717f-439a-8483-167fd61277d8 req-202e54c3-83ce-4d2a-87f0-b66c29f70a96 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:48.334662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-82d8c713-717f-439a-8483-167fd61277d8 req-202e54c3-83ce-4d2a-87f0-b66c29f70a96 service nova] Creating event network-vif-plugged:d64665e9-c9cd-4584-98fa-4fc8c61bdd87 for instance 63d6b982-e069-44bd-8110-df44d83d451c on hv-cinder-77819 Jun 20 07:07:48.335534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-82d8c713-717f-439a-8483-167fd61277d8 req-202e54c3-83ce-4d2a-87f0-b66c29f70a96 service nova] Creating event network-vif-plugged:c9d59064-4403-4327-b155-afc400b0b340 for instance fd99d933-7d4d-429a-9de4-d589c69c89c5 on hv-cinder-77819 Jun 20 07:07:48.336031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-82d8c713-717f-439a-8483-167fd61277d8 req-202e54c3-83ce-4d2a-87f0-b66c29f70a96 service nova] Creating event network-vif-plugged:022b9a11-cfc5-443c-a77c-b63c7232b0dd for instance 6c3378a3-113f-4381-91ac-4478c0a3371d on hv-cinder-77819 Jun 20 07:07:48.336789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-82d8c713-717f-439a-8483-167fd61277d8 req-202e54c3-83ce-4d2a-87f0-b66c29f70a96 service nova] Creating event network-vif-plugged:316c2317-90c4-4b27-bb5e-34a3153b065e for instance 0e214060-f046-41a1-b243-020c88edde42 on hv-cinder-77819 Jun 20 07:07:48.347794 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-82d8c713-717f-439a-8483-167fd61277d8 req-202e54c3-83ce-4d2a-87f0-b66c29f70a96 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.049870 Jun 20 07:07:48.348601 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 62/123] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:48.636985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4c7d98c3-f05c-4b64-9f79-3a0e6d1507cb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:48.638575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4c7d98c3-f05c-4b64-9f79-3a0e6d1507cb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:48.647630 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c7d98c3-f05c-4b64-9f79-3a0e6d1507cb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:48.650704 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-50c77238-5ac4-435c-b9d2-56e37059ea21 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:48.651082 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c7d98c3-f05c-4b64-9f79-3a0e6d1507cb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:48.651189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-50c77238-5ac4-435c-b9d2-56e37059ea21 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:48.653464 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c7d98c3-f05c-4b64-9f79-3a0e6d1507cb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:48.654168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c7d98c3-f05c-4b64-9f79-3a0e6d1507cb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:48.664763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50c77238-5ac4-435c-b9d2-56e37059ea21 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:48.665486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50c77238-5ac4-435c-b9d2-56e37059ea21 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:48.666608 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50c77238-5ac4-435c-b9d2-56e37059ea21 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:48.667209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50c77238-5ac4-435c-b9d2-56e37059ea21 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:49.067401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4c7d98c3-f05c-4b64-9f79-3a0e6d1507cb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:49.074398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-50c77238-5ac4-435c-b9d2-56e37059ea21 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:49.075463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4c7d98c3-f05c-4b64-9f79-3a0e6d1507cb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.443631 Jun 20 07:07:49.076054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 62/124] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:48 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:49.081470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6c8e671d-c9f5-4f69-8c0a-c17e2a6ad17a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:49.082019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6c8e671d-c9f5-4f69-8c0a-c17e2a6ad17a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:49.083340 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-50c77238-5ac4-435c-b9d2-56e37059ea21 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:49.084878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-50c77238-5ac4-435c-b9d2-56e37059ea21 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:49.086277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-50c77238-5ac4-435c-b9d2-56e37059ea21 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.440000 Jun 20 07:07:49.087197 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 63/125] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:48 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:49.093260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c8e671d-c9f5-4f69-8c0a-c17e2a6ad17a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:49.093709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c8e671d-c9f5-4f69-8c0a-c17e2a6ad17a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:49.094854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c8e671d-c9f5-4f69-8c0a-c17e2a6ad17a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:49.095474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c8e671d-c9f5-4f69-8c0a-c17e2a6ad17a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:49.239925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6c8e671d-c9f5-4f69-8c0a-c17e2a6ad17a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:49.251010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6c8e671d-c9f5-4f69-8c0a-c17e2a6ad17a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1547 microversion: 2.1 time: 0.171968 Jun 20 07:07:49.251010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 63/126] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:49 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1547 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:49.266269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0916522-9248-40a1-bd4a-31f1ac13cdbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:49.267061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f0916522-9248-40a1-bd4a-31f1ac13cdbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:49.268276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7457e40f-f15c-41ed-a482-da55e5f7d74f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:49.268896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7457e40f-f15c-41ed-a482-da55e5f7d74f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:49.274199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0916522-9248-40a1-bd4a-31f1ac13cdbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:49.275020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0916522-9248-40a1-bd4a-31f1ac13cdbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:49.275987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0916522-9248-40a1-bd4a-31f1ac13cdbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:49.276452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7457e40f-f15c-41ed-a482-da55e5f7d74f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:49.276795 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0916522-9248-40a1-bd4a-31f1ac13cdbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:49.276916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7457e40f-f15c-41ed-a482-da55e5f7d74f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:49.277666 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7457e40f-f15c-41ed-a482-da55e5f7d74f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:49.278188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7457e40f-f15c-41ed-a482-da55e5f7d74f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:49.404334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f0916522-9248-40a1-bd4a-31f1ac13cdbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142079 Jun 20 07:07:49.411480 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 64/127] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 07:07:49 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:49.671978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7457e40f-f15c-41ed-a482-da55e5f7d74f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:49.679566 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7457e40f-f15c-41ed-a482-da55e5f7d74f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.415271 Jun 20 07:07:49.680178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 64/128] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:49 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:50.096575 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-729bce95-2bd8-4d35-95fb-29be4770cd4b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:50.097286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-729bce95-2bd8-4d35-95fb-29be4770cd4b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:50.105546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-729bce95-2bd8-4d35-95fb-29be4770cd4b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:50.106547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-729bce95-2bd8-4d35-95fb-29be4770cd4b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:50.107313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-729bce95-2bd8-4d35-95fb-29be4770cd4b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:50.107693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dcbec639-f257-45cb-96c0-18c5cd06fe6b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:50.107807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-729bce95-2bd8-4d35-95fb-29be4770cd4b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:50.108352 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dcbec639-f257-45cb-96c0-18c5cd06fe6b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:50.115723 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dcbec639-f257-45cb-96c0-18c5cd06fe6b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:50.116450 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dcbec639-f257-45cb-96c0-18c5cd06fe6b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:50.117868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dcbec639-f257-45cb-96c0-18c5cd06fe6b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:50.118447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dcbec639-f257-45cb-96c0-18c5cd06fe6b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:50.519832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-729bce95-2bd8-4d35-95fb-29be4770cd4b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:50.523855 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dcbec639-f257-45cb-96c0-18c5cd06fe6b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:50.529282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-729bce95-2bd8-4d35-95fb-29be4770cd4b tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.438452 Jun 20 07:07:50.529852 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 65/129] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:50 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:50.542535 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dcbec639-f257-45cb-96c0-18c5cd06fe6b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:50.544050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dcbec639-f257-45cb-96c0-18c5cd06fe6b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:50.545187 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dcbec639-f257-45cb-96c0-18c5cd06fe6b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.442625 Jun 20 07:07:50.545742 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 65/130] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:50 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:50.697180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0aeb4c6a-25cd-436e-a064-795d49c2ef5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:50.697792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0aeb4c6a-25cd-436e-a064-795d49c2ef5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:50.704697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aeb4c6a-25cd-436e-a064-795d49c2ef5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:50.705371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aeb4c6a-25cd-436e-a064-795d49c2ef5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:50.713574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aeb4c6a-25cd-436e-a064-795d49c2ef5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:50.714217 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aeb4c6a-25cd-436e-a064-795d49c2ef5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:50.907179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0aeb4c6a-25cd-436e-a064-795d49c2ef5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:50.914834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0aeb4c6a-25cd-436e-a064-795d49c2ef5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.221496 Jun 20 07:07:50.915439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 66/131] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:50 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:51.017418 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-06bbda37-1317-4ca5-aab7-60dc9fa11531 req-8f962582-876c-45ce-b6c7-38bc25bdaaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "184f7c82-c8b4-45cf-ba43-b6f17794e153", "tag": "9f060390-c538-4ca5-a4da-a0ff281045f1"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:51.025640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-06bbda37-1317-4ca5-aab7-60dc9fa11531 req-8f962582-876c-45ce-b6c7-38bc25bdaaf7 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:51.026084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-06bbda37-1317-4ca5-aab7-60dc9fa11531 req-8f962582-876c-45ce-b6c7-38bc25bdaaf7 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:51.037727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-06bbda37-1317-4ca5-aab7-60dc9fa11531 req-8f962582-876c-45ce-b6c7-38bc25bdaaf7 service nova] Creating event network-changed:9f060390-c538-4ca5-a4da-a0ff281045f1 for instance 184f7c82-c8b4-45cf-ba43-b6f17794e153 on hv-cinder-77819 Jun 20 07:07:51.043062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-06bbda37-1317-4ca5-aab7-60dc9fa11531 req-8f962582-876c-45ce-b6c7-38bc25bdaaf7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029465 Jun 20 07:07:51.043655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 66/132] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:07:51.545874 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2ec3fbf7-4713-4799-a924-f08bbe397c30 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:51.546408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2ec3fbf7-4713-4799-a924-f08bbe397c30 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:51.552279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ec3fbf7-4713-4799-a924-f08bbe397c30 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:51.552717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ec3fbf7-4713-4799-a924-f08bbe397c30 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:51.553464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ec3fbf7-4713-4799-a924-f08bbe397c30 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:51.553890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ec3fbf7-4713-4799-a924-f08bbe397c30 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:51.564072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c786436f-5b18-48a7-a4da-7225f4f460a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:51.564932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c786436f-5b18-48a7-a4da-7225f4f460a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:51.571862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c786436f-5b18-48a7-a4da-7225f4f460a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:51.572135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:51.572716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c786436f-5b18-48a7-a4da-7225f4f460a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:51.573719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c786436f-5b18-48a7-a4da-7225f4f460a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:51.574209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c786436f-5b18-48a7-a4da-7225f4f460a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:51.578627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:51.758772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2ec3fbf7-4713-4799-a924-f08bbe397c30 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:51.766176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c786436f-5b18-48a7-a4da-7225f4f460a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:51.767072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2ec3fbf7-4713-4799-a924-f08bbe397c30 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.225272 Jun 20 07:07:51.767733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 67/133] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:51 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:51.775751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c786436f-5b18-48a7-a4da-7225f4f460a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:51.777510 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c786436f-5b18-48a7-a4da-7225f4f460a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:51.779574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c786436f-5b18-48a7-a4da-7225f4f460a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.220246 Jun 20 07:07:51.780372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 67/134] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:51 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:07:51.930825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8bf53b20-56f7-40f1-beb2-c0b7ebc5fbcc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:51.931439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8bf53b20-56f7-40f1-beb2-c0b7ebc5fbcc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:51.938066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bf53b20-56f7-40f1-beb2-c0b7ebc5fbcc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:51.938518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bf53b20-56f7-40f1-beb2-c0b7ebc5fbcc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:51.939284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bf53b20-56f7-40f1-beb2-c0b7ebc5fbcc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:51.939715 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bf53b20-56f7-40f1-beb2-c0b7ebc5fbcc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:52.085209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8bf53b20-56f7-40f1-beb2-c0b7ebc5fbcc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:52.094043 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8bf53b20-56f7-40f1-beb2-c0b7ebc5fbcc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.166952 Jun 20 07:07:52.094644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 68/135] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:51 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:52.784438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1503ad58-2868-41c9-bfbf-33d461f7a9fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:52.785047 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1503ad58-2868-41c9-bfbf-33d461f7a9fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:52.791156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1503ad58-2868-41c9-bfbf-33d461f7a9fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:52.791701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1503ad58-2868-41c9-bfbf-33d461f7a9fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:52.792490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1503ad58-2868-41c9-bfbf-33d461f7a9fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:52.792922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1503ad58-2868-41c9-bfbf-33d461f7a9fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:52.797727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2751bb5c-daa5-41ca-9748-78b67d435f10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:52.798582 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2751bb5c-daa5-41ca-9748-78b67d435f10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:52.807301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2751bb5c-daa5-41ca-9748-78b67d435f10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:52.807815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2751bb5c-daa5-41ca-9748-78b67d435f10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:52.808776 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2751bb5c-daa5-41ca-9748-78b67d435f10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:52.809204 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2751bb5c-daa5-41ca-9748-78b67d435f10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:52.997645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1503ad58-2868-41c9-bfbf-33d461f7a9fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:53.006319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1503ad58-2868-41c9-bfbf-33d461f7a9fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.225600 Jun 20 07:07:53.006903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 68/136] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:52 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:53.023614 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2751bb5c-daa5-41ca-9748-78b67d435f10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:53.033031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2751bb5c-daa5-41ca-9748-78b67d435f10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:53.035361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2751bb5c-daa5-41ca-9748-78b67d435f10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:53.036497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2751bb5c-daa5-41ca-9748-78b67d435f10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.242989 Jun 20 07:07:53.037052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 69/137] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:52 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:07:53.111384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bcf870b4-a055-4302-a912-301aecbdf081 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:53.111996 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bcf870b4-a055-4302-a912-301aecbdf081 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:53.115464 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=89 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:53.119320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bcf870b4-a055-4302-a912-301aecbdf081 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:53.119766 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bcf870b4-a055-4302-a912-301aecbdf081 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:53.120551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bcf870b4-a055-4302-a912-301aecbdf081 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:53.120981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bcf870b4-a055-4302-a912-301aecbdf081 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:53.259748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bcf870b4-a055-4302-a912-301aecbdf081 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:53.268227 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bcf870b4-a055-4302-a912-301aecbdf081 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1321 microversion: 2.1 time: 0.160642 Jun 20 07:07:53.268801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 69/138] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:53 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:54.023586 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b4227146-eb11-4aad-a802-930bca80022d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:54.024229 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b4227146-eb11-4aad-a802-930bca80022d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:54.030464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4227146-eb11-4aad-a802-930bca80022d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:54.030892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4227146-eb11-4aad-a802-930bca80022d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:54.031647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4227146-eb11-4aad-a802-930bca80022d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:54.032354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4227146-eb11-4aad-a802-930bca80022d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:54.056816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f387a341-c85f-4648-baa7-1a478f258c27 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:54.057425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f387a341-c85f-4648-baa7-1a478f258c27 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:54.064178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f387a341-c85f-4648-baa7-1a478f258c27 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:54.064751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f387a341-c85f-4648-baa7-1a478f258c27 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:54.065519 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f387a341-c85f-4648-baa7-1a478f258c27 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:54.065957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f387a341-c85f-4648-baa7-1a478f258c27 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:54.258710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b4227146-eb11-4aad-a802-930bca80022d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:54.263051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f387a341-c85f-4648-baa7-1a478f258c27 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:54.268644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b4227146-eb11-4aad-a802-930bca80022d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.249209 Jun 20 07:07:54.279005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f387a341-c85f-4648-baa7-1a478f258c27 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:54.279005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f387a341-c85f-4648-baa7-1a478f258c27 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:54.279005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f387a341-c85f-4648-baa7-1a478f258c27 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.221957 Jun 20 07:07:54.279291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 70/139] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:54 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:54.280214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 70/140] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:54 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:54.285156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5707d6c2-1861-4230-a7e3-3fabd4cd86f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:54.285835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5707d6c2-1861-4230-a7e3-3fabd4cd86f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:54.292322 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5707d6c2-1861-4230-a7e3-3fabd4cd86f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:54.292788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5707d6c2-1861-4230-a7e3-3fabd4cd86f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:54.293597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5707d6c2-1861-4230-a7e3-3fabd4cd86f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:54.294748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5707d6c2-1861-4230-a7e3-3fabd4cd86f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:54.430237 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5707d6c2-1861-4230-a7e3-3fabd4cd86f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:54.438541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5707d6c2-1861-4230-a7e3-3fabd4cd86f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1516 microversion: 2.1 time: 0.157547 Jun 20 07:07:54.439100 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 71/141] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:54 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:54.455519 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1a8c0593-3983-41a5-8e56-d52b04680d93 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:54.456567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1a8c0593-3983-41a5-8e56-d52b04680d93 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:54.462494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a8c0593-3983-41a5-8e56-d52b04680d93 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:54.462943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a8c0593-3983-41a5-8e56-d52b04680d93 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:54.463690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a8c0593-3983-41a5-8e56-d52b04680d93 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:54.464146 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a8c0593-3983-41a5-8e56-d52b04680d93 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:54.487459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-1a8c0593-3983-41a5-8e56-d52b04680d93 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'flavor' on Instance uuid 6c3378a3-113f-4381-91ac-4478c0a3371d {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:07:54.607828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1a8c0593-3983-41a5-8e56-d52b04680d93 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "POST /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d/action" status: 200 len: 32 microversion: 2.1 time: 0.155645 Jun 20 07:07:54.608468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 71/142] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:07:54 2022] POST /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 07:07:54.617637 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e211e13f-2238-4c2f-a674-b1bc03b8d266 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:54.618245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e211e13f-2238-4c2f-a674-b1bc03b8d266 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:54.624346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e211e13f-2238-4c2f-a674-b1bc03b8d266 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:54.624822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e211e13f-2238-4c2f-a674-b1bc03b8d266 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:54.625575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e211e13f-2238-4c2f-a674-b1bc03b8d266 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:54.626006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e211e13f-2238-4c2f-a674-b1bc03b8d266 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:54.751733 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e211e13f-2238-4c2f-a674-b1bc03b8d266 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:54.759093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e211e13f-2238-4c2f-a674-b1bc03b8d266 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.145419 Jun 20 07:07:54.759658 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 72/143] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:54 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:55.286957 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-893d97ed-2514-448b-9dc9-daedff13e797 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:55.287654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-893d97ed-2514-448b-9dc9-daedff13e797 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:55.292349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8079903d-fdc1-4863-823a-ff7af6e43071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:55.292969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8079903d-fdc1-4863-823a-ff7af6e43071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:55.295059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893d97ed-2514-448b-9dc9-daedff13e797 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:55.295501 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893d97ed-2514-448b-9dc9-daedff13e797 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:55.296425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893d97ed-2514-448b-9dc9-daedff13e797 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:55.296854 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893d97ed-2514-448b-9dc9-daedff13e797 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:55.299326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8079903d-fdc1-4863-823a-ff7af6e43071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:55.299770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8079903d-fdc1-4863-823a-ff7af6e43071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:55.300567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8079903d-fdc1-4863-823a-ff7af6e43071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:55.301003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8079903d-fdc1-4863-823a-ff7af6e43071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:55.490071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-893d97ed-2514-448b-9dc9-daedff13e797 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:55.493953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8079903d-fdc1-4863-823a-ff7af6e43071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:55.497595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-893d97ed-2514-448b-9dc9-daedff13e797 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.214869 Jun 20 07:07:55.498160 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 72/144] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:55 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:55.501692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8079903d-fdc1-4863-823a-ff7af6e43071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:55.503167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8079903d-fdc1-4863-823a-ff7af6e43071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:55.504292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8079903d-fdc1-4863-823a-ff7af6e43071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.215878 Jun 20 07:07:55.504977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 73/145] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:55 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:07:55.775394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-30247976-2353-4c5f-b3f5-ec7864756cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:55.776007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-30247976-2353-4c5f-b3f5-ec7864756cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:55.782600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30247976-2353-4c5f-b3f5-ec7864756cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:55.783044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30247976-2353-4c5f-b3f5-ec7864756cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:55.783795 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30247976-2353-4c5f-b3f5-ec7864756cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:55.784255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30247976-2353-4c5f-b3f5-ec7864756cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:55.908522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-30247976-2353-4c5f-b3f5-ec7864756cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:55.915837 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-30247976-2353-4c5f-b3f5-ec7864756cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.144276 Jun 20 07:07:55.916436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 73/146] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:55 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:56.514167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d1243c7e-9731-4c71-a67b-a2ac8f43feef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:56.514775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d1243c7e-9731-4c71-a67b-a2ac8f43feef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:56.522101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1243c7e-9731-4c71-a67b-a2ac8f43feef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:56.522545 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1243c7e-9731-4c71-a67b-a2ac8f43feef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:56.522660 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3735b959-5a6c-4940-a896-eb01b5c7bb85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:56.523294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3735b959-5a6c-4940-a896-eb01b5c7bb85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:56.523400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1243c7e-9731-4c71-a67b-a2ac8f43feef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:56.523741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1243c7e-9731-4c71-a67b-a2ac8f43feef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:56.529216 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3735b959-5a6c-4940-a896-eb01b5c7bb85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:56.529664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3735b959-5a6c-4940-a896-eb01b5c7bb85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:56.530425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3735b959-5a6c-4940-a896-eb01b5c7bb85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:56.530860 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3735b959-5a6c-4940-a896-eb01b5c7bb85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:56.893747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d1243c7e-9731-4c71-a67b-a2ac8f43feef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:56.900619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3735b959-5a6c-4940-a896-eb01b5c7bb85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:56.901275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d1243c7e-9731-4c71-a67b-a2ac8f43feef tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.390928 Jun 20 07:07:56.901975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 74/147] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:56 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:56.910087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3735b959-5a6c-4940-a896-eb01b5c7bb85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:56.911586 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3735b959-5a6c-4940-a896-eb01b5c7bb85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:56.912728 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3735b959-5a6c-4940-a896-eb01b5c7bb85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1405 microversion: 2.20 time: 0.394193 Jun 20 07:07:56.913283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 74/148] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:56 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:07:56.932989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fda6d598-6533-487d-b623-10355ac19f68 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:56.933864 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fda6d598-6533-487d-b623-10355ac19f68 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:56.940344 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda6d598-6533-487d-b623-10355ac19f68 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:56.940789 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda6d598-6533-487d-b623-10355ac19f68 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:56.941551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda6d598-6533-487d-b623-10355ac19f68 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:56.941985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda6d598-6533-487d-b623-10355ac19f68 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:57.072993 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fda6d598-6533-487d-b623-10355ac19f68 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:57.080382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fda6d598-6533-487d-b623-10355ac19f68 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.151689 Jun 20 07:07:57.080978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 75/149] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:56 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:57.918905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-22d43961-6479-4b02-bd75-76359fcc69b6 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:57.919605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-22d43961-6479-4b02-bd75-76359fcc69b6 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:57.921784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=89 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:07:57.927446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22d43961-6479-4b02-bd75-76359fcc69b6 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:57.928389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22d43961-6479-4b02-bd75-76359fcc69b6 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:57.928870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22d43961-6479-4b02-bd75-76359fcc69b6 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:57.929301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-22d43961-6479-4b02-bd75-76359fcc69b6 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:57.931105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8c498af7-9ecc-4902-8a06-37b68e9bbbf6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:57.931827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8c498af7-9ecc-4902-8a06-37b68e9bbbf6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:57.939567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c498af7-9ecc-4902-8a06-37b68e9bbbf6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:57.940021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c498af7-9ecc-4902-8a06-37b68e9bbbf6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:57.940978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c498af7-9ecc-4902-8a06-37b68e9bbbf6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:57.941557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c498af7-9ecc-4902-8a06-37b68e9bbbf6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:58.128749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-22d43961-6479-4b02-bd75-76359fcc69b6 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:58.135790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8c498af7-9ecc-4902-8a06-37b68e9bbbf6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:58.136945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-22d43961-6479-4b02-bd75-76359fcc69b6 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1314 microversion: 2.1 time: 0.222027 Jun 20 07:07:58.137536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 75/150] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:57 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:58.142754 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6c27e9d-f8fd-4aee-8610-7a8091051420 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:58.143343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e6c27e9d-f8fd-4aee-8610-7a8091051420 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:58.144522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8c498af7-9ecc-4902-8a06-37b68e9bbbf6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:58.146996 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8c498af7-9ecc-4902-8a06-37b68e9bbbf6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:58.147331 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8c498af7-9ecc-4902-8a06-37b68e9bbbf6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1597 microversion: 2.20 time: 0.220341 Jun 20 07:07:58.147923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 76/151] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:07:57 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1597 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:07:58.157739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6c27e9d-f8fd-4aee-8610-7a8091051420 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:58.158181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6c27e9d-f8fd-4aee-8610-7a8091051420 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:58.158935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6c27e9d-f8fd-4aee-8610-7a8091051420 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:58.159362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6c27e9d-f8fd-4aee-8610-7a8091051420 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:58.165548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7aaca58a-0c16-488c-8b7c-85375f70c791 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:58.166118 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7aaca58a-0c16-488c-8b7c-85375f70c791 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:58.172889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7aaca58a-0c16-488c-8b7c-85375f70c791 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:58.173337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7aaca58a-0c16-488c-8b7c-85375f70c791 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:58.174094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7aaca58a-0c16-488c-8b7c-85375f70c791 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:58.174529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7aaca58a-0c16-488c-8b7c-85375f70c791 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:58.308863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7aaca58a-0c16-488c-8b7c-85375f70c791 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146789 Jun 20 07:07:58.311762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 77/152] 10.222.0.23 () {60 vars in 1315 bytes} [Mon Jun 20 07:07:58 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:07:58.331023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6c27e9d-f8fd-4aee-8610-7a8091051420 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:58.339518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e6c27e9d-f8fd-4aee-8610-7a8091051420 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.200742 Jun 20 07:07:58.340142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 76/153] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:58 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:59.155294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9da15672-6fbe-4a68-9b2b-94970e5d298a tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:59.155906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9da15672-6fbe-4a68-9b2b-94970e5d298a tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:59.162346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9da15672-6fbe-4a68-9b2b-94970e5d298a tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:59.163032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9da15672-6fbe-4a68-9b2b-94970e5d298a tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:59.163803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9da15672-6fbe-4a68-9b2b-94970e5d298a tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:59.164259 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9da15672-6fbe-4a68-9b2b-94970e5d298a tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:59.303567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9da15672-6fbe-4a68-9b2b-94970e5d298a tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:59.311871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9da15672-6fbe-4a68-9b2b-94970e5d298a tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1501 microversion: 2.1 time: 0.160530 Jun 20 07:07:59.312492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 78/154] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:59 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:07:59.358627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-34ecf800-05c9-4279-835d-82ece42a0f5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:07:59.359415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-34ecf800-05c9-4279-835d-82ece42a0f5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:07:59.366577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34ecf800-05c9-4279-835d-82ece42a0f5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:59.367147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34ecf800-05c9-4279-835d-82ece42a0f5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:59.368018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34ecf800-05c9-4279-835d-82ece42a0f5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:59.368632 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34ecf800-05c9-4279-835d-82ece42a0f5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:59.522300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-34ecf800-05c9-4279-835d-82ece42a0f5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:07:59.540733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-34ecf800-05c9-4279-835d-82ece42a0f5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.187051 Jun 20 07:07:59.541748 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 77/155] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:07:59 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:07:59.622119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-d7d54749-c33b-4b6d-b211-2184d2e97be5 req-0f990288-b46c-4bc2-853b-26ef2265ad1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e214060-f046-41a1-b243-020c88edde42", "tag": "316c2317-90c4-4b27-bb5e-34a3153b065e"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:07:59.634592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d7d54749-c33b-4b6d-b211-2184d2e97be5 req-0f990288-b46c-4bc2-853b-26ef2265ad1a service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:07:59.635094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d7d54749-c33b-4b6d-b211-2184d2e97be5 req-0f990288-b46c-4bc2-853b-26ef2265ad1a service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:07:59.673338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-d7d54749-c33b-4b6d-b211-2184d2e97be5 req-0f990288-b46c-4bc2-853b-26ef2265ad1a service nova] Creating event network-changed:316c2317-90c4-4b27-bb5e-34a3153b065e for instance 0e214060-f046-41a1-b243-020c88edde42 on hv-cinder-77819 Jun 20 07:07:59.679193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-d7d54749-c33b-4b6d-b211-2184d2e97be5 req-0f990288-b46c-4bc2-853b-26ef2265ad1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061938 Jun 20 07:07:59.680833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 79/156] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:08:00.557942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-844f3fcc-e05f-4744-96b4-7f16a13e4b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:00.558555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-844f3fcc-e05f-4744-96b4-7f16a13e4b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:00.564701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-844f3fcc-e05f-4744-96b4-7f16a13e4b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:00.565268 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-844f3fcc-e05f-4744-96b4-7f16a13e4b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:00.566040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-844f3fcc-e05f-4744-96b4-7f16a13e4b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:00.566474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-844f3fcc-e05f-4744-96b4-7f16a13e4b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:00.705385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-844f3fcc-e05f-4744-96b4-7f16a13e4b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:00.716308 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-844f3fcc-e05f-4744-96b4-7f16a13e4b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.161953 Jun 20 07:08:00.718385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 78/157] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:00 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:01.735732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5b3d8aa1-b552-46a2-972b-701cacda2fbb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:01.736489 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5b3d8aa1-b552-46a2-972b-701cacda2fbb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:01.743253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b3d8aa1-b552-46a2-972b-701cacda2fbb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:01.743714 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b3d8aa1-b552-46a2-972b-701cacda2fbb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:01.744509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b3d8aa1-b552-46a2-972b-701cacda2fbb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:01.744951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b3d8aa1-b552-46a2-972b-701cacda2fbb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:01.878967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5b3d8aa1-b552-46a2-972b-701cacda2fbb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:01.886695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5b3d8aa1-b552-46a2-972b-701cacda2fbb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.155967 Jun 20 07:08:01.887264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 80/158] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:01 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:02.904653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-498401ac-05ee-4ea9-8a1d-07ec1429282e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:02.905269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-498401ac-05ee-4ea9-8a1d-07ec1429282e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:02.911232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-498401ac-05ee-4ea9-8a1d-07ec1429282e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:02.911686 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-498401ac-05ee-4ea9-8a1d-07ec1429282e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:02.912475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-498401ac-05ee-4ea9-8a1d-07ec1429282e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:02.912918 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-498401ac-05ee-4ea9-8a1d-07ec1429282e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:03.051838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-498401ac-05ee-4ea9-8a1d-07ec1429282e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:03.059148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-498401ac-05ee-4ea9-8a1d-07ec1429282e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.158873 Jun 20 07:08:03.059800 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 79/159] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:02 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:03.919747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b0360c75-4901-4665-9783-9664a5b98db8 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39bf5736-101b-484f-b208-f8fc71c9417b"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:03.920881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b0360c75-4901-4665-9783-9664a5b98db8 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:03.926806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0360c75-4901-4665-9783-9664a5b98db8 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:03.927254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0360c75-4901-4665-9783-9664a5b98db8 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:03.928024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0360c75-4901-4665-9783-9664a5b98db8 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:03.928495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0360c75-4901-4665-9783-9664a5b98db8 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:04.076172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9cbc5932-cca4-4f7e-a9b9-e041bca0dde6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:04.076818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9cbc5932-cca4-4f7e-a9b9-e041bca0dde6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:04.082759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cbc5932-cca4-4f7e-a9b9-e041bca0dde6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:04.083209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cbc5932-cca4-4f7e-a9b9-e041bca0dde6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:04.083965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cbc5932-cca4-4f7e-a9b9-e041bca0dde6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:04.084425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cbc5932-cca4-4f7e-a9b9-e041bca0dde6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:04.251081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9cbc5932-cca4-4f7e-a9b9-e041bca0dde6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:04.259118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9cbc5932-cca4-4f7e-a9b9-e041bca0dde6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.186898 Jun 20 07:08:04.259694 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 80/160] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:04 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:05.016942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b0360c75-4901-4665-9783-9664a5b98db8 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "POST /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.100718 Jun 20 07:08:05.020188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 81/161] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 07:08:03 2022] POST /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5/os-volume_attachments => generated 194 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:08:05.276704 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1007a485-40d8-44c1-8a35-15306bce687f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:05.277316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1007a485-40d8-44c1-8a35-15306bce687f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:05.283368 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1007a485-40d8-44c1-8a35-15306bce687f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:05.283810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1007a485-40d8-44c1-8a35-15306bce687f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:05.284601 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1007a485-40d8-44c1-8a35-15306bce687f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:05.285026 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1007a485-40d8-44c1-8a35-15306bce687f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:05.453985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1007a485-40d8-44c1-8a35-15306bce687f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:05.476432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1007a485-40d8-44c1-8a35-15306bce687f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.203534 Jun 20 07:08:05.483219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 81/162] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:05 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:06.496942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4bd587ca-c465-49ad-b741-8cc2c633f4dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:06.497669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4bd587ca-c465-49ad-b741-8cc2c633f4dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:06.504354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bd587ca-c465-49ad-b741-8cc2c633f4dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:06.504800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bd587ca-c465-49ad-b741-8cc2c633f4dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:06.505559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bd587ca-c465-49ad-b741-8cc2c633f4dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:06.505991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bd587ca-c465-49ad-b741-8cc2c633f4dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:06.817394 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4bd587ca-c465-49ad-b741-8cc2c633f4dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:06.832834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4bd587ca-c465-49ad-b741-8cc2c633f4dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.338890 Jun 20 07:08:06.834869 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 82/163] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:06 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:07.850838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db7f7b9d-e3f0-4b10-8bde-aa4de052c97a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:07.851454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-db7f7b9d-e3f0-4b10-8bde-aa4de052c97a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:07.858757 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db7f7b9d-e3f0-4b10-8bde-aa4de052c97a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:07.859210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db7f7b9d-e3f0-4b10-8bde-aa4de052c97a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:07.860029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db7f7b9d-e3f0-4b10-8bde-aa4de052c97a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:07.860421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db7f7b9d-e3f0-4b10-8bde-aa4de052c97a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:07.875727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:07.994563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db7f7b9d-e3f0-4b10-8bde-aa4de052c97a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:08.002455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db7f7b9d-e3f0-4b10-8bde-aa4de052c97a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.155466 Jun 20 07:08:08.003011 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 82/164] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:07 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:09.018992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-624c5903-d8b4-4c27-b659-0842abf4421e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:09.019607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-624c5903-d8b4-4c27-b659-0842abf4421e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:09.026113 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-624c5903-d8b4-4c27-b659-0842abf4421e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:09.026561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-624c5903-d8b4-4c27-b659-0842abf4421e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:09.027323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-624c5903-d8b4-4c27-b659-0842abf4421e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:09.027754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-624c5903-d8b4-4c27-b659-0842abf4421e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:09.047098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:09.157834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-624c5903-d8b4-4c27-b659-0842abf4421e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:09.165269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-624c5903-d8b4-4c27-b659-0842abf4421e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.150411 Jun 20 07:08:09.165840 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 83/165] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:09 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:10.183155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f7bd8e65-38c2-495c-bf4b-82ad70acaa91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:10.183719 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f7bd8e65-38c2-495c-bf4b-82ad70acaa91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:10.190079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f7bd8e65-38c2-495c-bf4b-82ad70acaa91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:10.190525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f7bd8e65-38c2-495c-bf4b-82ad70acaa91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:10.191282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f7bd8e65-38c2-495c-bf4b-82ad70acaa91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:10.191713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f7bd8e65-38c2-495c-bf4b-82ad70acaa91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:10.325327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f7bd8e65-38c2-495c-bf4b-82ad70acaa91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:10.333835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f7bd8e65-38c2-495c-bf4b-82ad70acaa91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.154613 Jun 20 07:08:10.334385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 83/166] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:10 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:11.350697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f6bc69d4-5071-491c-9bee-b2fdcb85339c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:11.351431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f6bc69d4-5071-491c-9bee-b2fdcb85339c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:11.357793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6bc69d4-5071-491c-9bee-b2fdcb85339c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:11.358237 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6bc69d4-5071-491c-9bee-b2fdcb85339c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:11.358990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6bc69d4-5071-491c-9bee-b2fdcb85339c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:11.359418 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6bc69d4-5071-491c-9bee-b2fdcb85339c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:11.485024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f6bc69d4-5071-491c-9bee-b2fdcb85339c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:11.492355 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f6bc69d4-5071-491c-9bee-b2fdcb85339c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.145472 Jun 20 07:08:11.492913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 84/167] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:11 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:12.509095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d4b1fa5d-09a6-4e57-bcf0-e48b0850b244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:12.509820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d4b1fa5d-09a6-4e57-bcf0-e48b0850b244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:12.515916 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4b1fa5d-09a6-4e57-bcf0-e48b0850b244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:12.516394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4b1fa5d-09a6-4e57-bcf0-e48b0850b244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:12.517411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4b1fa5d-09a6-4e57-bcf0-e48b0850b244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:12.518021 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4b1fa5d-09a6-4e57-bcf0-e48b0850b244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:12.645707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d4b1fa5d-09a6-4e57-bcf0-e48b0850b244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:12.653314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d4b1fa5d-09a6-4e57-bcf0-e48b0850b244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.148380 Jun 20 07:08:12.653905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 84/168] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:12 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:13.670698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1fb68b2e-5483-426d-8d52-a61e36d62c57 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:13.671300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1fb68b2e-5483-426d-8d52-a61e36d62c57 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:13.677680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1fb68b2e-5483-426d-8d52-a61e36d62c57 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:13.678116 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1fb68b2e-5483-426d-8d52-a61e36d62c57 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:13.678862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1fb68b2e-5483-426d-8d52-a61e36d62c57 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:13.679287 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1fb68b2e-5483-426d-8d52-a61e36d62c57 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:13.804073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1fb68b2e-5483-426d-8d52-a61e36d62c57 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:13.811367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1fb68b2e-5483-426d-8d52-a61e36d62c57 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.145100 Jun 20 07:08:13.811928 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 85/169] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:13 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:14.828485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cf669728-02dc-43f1-bcc1-0b342250e4c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:14.829097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cf669728-02dc-43f1-bcc1-0b342250e4c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:14.835044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf669728-02dc-43f1-bcc1-0b342250e4c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:14.835485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf669728-02dc-43f1-bcc1-0b342250e4c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:14.836275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf669728-02dc-43f1-bcc1-0b342250e4c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:14.836698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf669728-02dc-43f1-bcc1-0b342250e4c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:14.963031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cf669728-02dc-43f1-bcc1-0b342250e4c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:14.971590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cf669728-02dc-43f1-bcc1-0b342250e4c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.147166 Jun 20 07:08:14.972178 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 85/170] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:14 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:15.988826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f4265f72-de10-4af4-8590-51834c75d3da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:15.989338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f4265f72-de10-4af4-8590-51834c75d3da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:15.995737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4265f72-de10-4af4-8590-51834c75d3da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:15.996207 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4265f72-de10-4af4-8590-51834c75d3da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:15.996948 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4265f72-de10-4af4-8590-51834c75d3da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:15.997372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4265f72-de10-4af4-8590-51834c75d3da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:16.123977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f4265f72-de10-4af4-8590-51834c75d3da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:16.131372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f4265f72-de10-4af4-8590-51834c75d3da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.146384 Jun 20 07:08:16.131932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 86/171] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:15 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:17.148577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63a00c9c-a00a-4610-a044-c4eaa1626514 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:17.149285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63a00c9c-a00a-4610-a044-c4eaa1626514 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:17.155903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63a00c9c-a00a-4610-a044-c4eaa1626514 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:17.156319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63a00c9c-a00a-4610-a044-c4eaa1626514 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:17.157072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63a00c9c-a00a-4610-a044-c4eaa1626514 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:17.157501 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63a00c9c-a00a-4610-a044-c4eaa1626514 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:17.281439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-63a00c9c-a00a-4610-a044-c4eaa1626514 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:17.288828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63a00c9c-a00a-4610-a044-c4eaa1626514 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.144124 Jun 20 07:08:17.289388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 86/172] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:17 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:18.305430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7b69035e-cac0-4949-82eb-0eff5d1496a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:18.306054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7b69035e-cac0-4949-82eb-0eff5d1496a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:18.312677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b69035e-cac0-4949-82eb-0eff5d1496a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:18.313131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b69035e-cac0-4949-82eb-0eff5d1496a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:18.313972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b69035e-cac0-4949-82eb-0eff5d1496a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:18.314411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b69035e-cac0-4949-82eb-0eff5d1496a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:18.448233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b69035e-cac0-4949-82eb-0eff5d1496a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:18.455651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7b69035e-cac0-4949-82eb-0eff5d1496a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.154120 Jun 20 07:08:18.456235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 87/173] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:18 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:19.472908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a46db2e6-fb8f-4937-a6b9-3b354382bcbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:19.473514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a46db2e6-fb8f-4937-a6b9-3b354382bcbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:19.479483 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a46db2e6-fb8f-4937-a6b9-3b354382bcbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:19.479921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a46db2e6-fb8f-4937-a6b9-3b354382bcbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:19.480693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a46db2e6-fb8f-4937-a6b9-3b354382bcbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:19.481125 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a46db2e6-fb8f-4937-a6b9-3b354382bcbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:19.611188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a46db2e6-fb8f-4937-a6b9-3b354382bcbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:19.618596 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a46db2e6-fb8f-4937-a6b9-3b354382bcbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.149442 Jun 20 07:08:19.619140 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 87/174] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:19 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:20.634972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6951a976-f706-478f-b123-778b2c706959 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:20.635578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6951a976-f706-478f-b123-778b2c706959 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:20.642641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6951a976-f706-478f-b123-778b2c706959 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:20.643088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6951a976-f706-478f-b123-778b2c706959 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:20.643849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6951a976-f706-478f-b123-778b2c706959 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:20.644345 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6951a976-f706-478f-b123-778b2c706959 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:20.789538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6951a976-f706-478f-b123-778b2c706959 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:20.797795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6951a976-f706-478f-b123-778b2c706959 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.166702 Jun 20 07:08:20.802340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 88/175] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:20 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:21.113297 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7be71d40-8a2e-4170-bfcc-08fac8c6e889 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:21.113932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7be71d40-8a2e-4170-bfcc-08fac8c6e889 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:21.119975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7be71d40-8a2e-4170-bfcc-08fac8c6e889 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:21.120623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7be71d40-8a2e-4170-bfcc-08fac8c6e889 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:21.121394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7be71d40-8a2e-4170-bfcc-08fac8c6e889 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:21.121965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7be71d40-8a2e-4170-bfcc-08fac8c6e889 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:21.151201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7be71d40-8a2e-4170-bfcc-08fac8c6e889 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:08:21.259255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7be71d40-8a2e-4170-bfcc-08fac8c6e889 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 204 len: 0 microversion: 2.1 time: 0.149444 Jun 20 07:08:21.260385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 88/176] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:08:21 2022] DELETE /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:08:21.269678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-01d8a60e-8d5a-4210-9503-1fa0704cce26 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:21.270299 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-01d8a60e-8d5a-4210-9503-1fa0704cce26 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:21.276235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01d8a60e-8d5a-4210-9503-1fa0704cce26 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:21.276665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01d8a60e-8d5a-4210-9503-1fa0704cce26 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:21.277604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01d8a60e-8d5a-4210-9503-1fa0704cce26 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:21.278038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01d8a60e-8d5a-4210-9503-1fa0704cce26 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:21.413156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-01d8a60e-8d5a-4210-9503-1fa0704cce26 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:21.421635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-01d8a60e-8d5a-4210-9503-1fa0704cce26 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1553 microversion: 2.1 time: 0.156767 Jun 20 07:08:21.422214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 89/177] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:21 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:21.815308 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6c13bb08-3557-48f6-af37-1bccac3ea09c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:21.816007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6c13bb08-3557-48f6-af37-1bccac3ea09c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:21.822291 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c13bb08-3557-48f6-af37-1bccac3ea09c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:21.822759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c13bb08-3557-48f6-af37-1bccac3ea09c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:21.823505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c13bb08-3557-48f6-af37-1bccac3ea09c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:21.823941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c13bb08-3557-48f6-af37-1bccac3ea09c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:21.963022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6c13bb08-3557-48f6-af37-1bccac3ea09c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:21.970873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6c13bb08-3557-48f6-af37-1bccac3ea09c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.160377 Jun 20 07:08:21.971413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 89/178] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:21 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:22.438773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7c3db8e7-26a0-4f70-a505-c867ddb3e6d9 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:22.439391 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7c3db8e7-26a0-4f70-a505-c867ddb3e6d9 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:22.446412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c3db8e7-26a0-4f70-a505-c867ddb3e6d9 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:22.446873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c3db8e7-26a0-4f70-a505-c867ddb3e6d9 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:22.447639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c3db8e7-26a0-4f70-a505-c867ddb3e6d9 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:22.448075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c3db8e7-26a0-4f70-a505-c867ddb3e6d9 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:22.613792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7c3db8e7-26a0-4f70-a505-c867ddb3e6d9 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:22.626471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7c3db8e7-26a0-4f70-a505-c867ddb3e6d9 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1553 microversion: 2.1 time: 0.191473 Jun 20 07:08:22.627802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 90/179] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:22 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:22.987906 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a3b683dd-4920-49f2-810b-edce7018b81a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:22.988494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a3b683dd-4920-49f2-810b-edce7018b81a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:22.994243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3b683dd-4920-49f2-810b-edce7018b81a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:22.994688 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3b683dd-4920-49f2-810b-edce7018b81a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:22.995458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3b683dd-4920-49f2-810b-edce7018b81a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:22.995891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3b683dd-4920-49f2-810b-edce7018b81a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:23.125201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a3b683dd-4920-49f2-810b-edce7018b81a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:23.132625 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a3b683dd-4920-49f2-810b-edce7018b81a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.148688 Jun 20 07:08:23.133192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 90/180] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:22 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:23.645938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0c6ee9b2-ce08-4bf8-b63e-3128f7adac41 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:23.646608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0c6ee9b2-ce08-4bf8-b63e-3128f7adac41 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:23.649551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=44 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:23.656318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c6ee9b2-ce08-4bf8-b63e-3128f7adac41 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:23.656768 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c6ee9b2-ce08-4bf8-b63e-3128f7adac41 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:23.657991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c6ee9b2-ce08-4bf8-b63e-3128f7adac41 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:23.658450 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c6ee9b2-ce08-4bf8-b63e-3128f7adac41 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:23.819111 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0c6ee9b2-ce08-4bf8-b63e-3128f7adac41 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:23.829132 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0c6ee9b2-ce08-4bf8-b63e-3128f7adac41 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1553 microversion: 2.1 time: 0.189085 Jun 20 07:08:23.832282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 91/181] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:23 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:24.052053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1262173142", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:24.101250 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] validate_networks() for None {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:08:24.151882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c68d053d-8aa2-46a5-acbe-8d22516430de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:24.152813 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c68d053d-8aa2-46a5-acbe-8d22516430de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:24.159990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c68d053d-8aa2-46a5-acbe-8d22516430de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:24.161365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c68d053d-8aa2-46a5-acbe-8d22516430de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:24.163822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c68d053d-8aa2-46a5-acbe-8d22516430de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:24.164316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c68d053d-8aa2-46a5-acbe-8d22516430de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:24.636118 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c68d053d-8aa2-46a5-acbe-8d22516430de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:24.645652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c68d053d-8aa2-46a5-acbe-8d22516430de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.498754 Jun 20 07:08:24.646362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 92/182] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:24 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:24.671286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:08:24.671791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:08:24.672376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:08:24.672863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:08:24.673348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:08:24.682676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:24.683126 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:24.683924 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:24.684391 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:24.701163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Getting quotas for project 20a5d413451c4fe79fb8a521ddf29326. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:08:24.705235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Getting quotas for user fc02ed62c23443ab9f968a71c2c674bf and project 20a5d413451c4fe79fb8a521ddf29326. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:08:24.716275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:08:24.719096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:08:24.767241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-31a2b18e-c6e5-44d2-a3bc-c653f7ed4162 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718560 Jun 20 07:08:24.768489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 91/183] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:08:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:08:24.778337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eacf3509-5dcc-4f43-9d5d-afa4f87ded81 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:24.779141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eacf3509-5dcc-4f43-9d5d-afa4f87ded81 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:24.836128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eacf3509-5dcc-4f43-9d5d-afa4f87ded81 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:24.846238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eacf3509-5dcc-4f43-9d5d-afa4f87ded81 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1215 microversion: 2.1 time: 0.071034 Jun 20 07:08:24.847144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 93/184] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:24 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:24.847748 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1552c1af-7104-4a13-bc36-afbb644ba2fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:24.848527 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1552c1af-7104-4a13-bc36-afbb644ba2fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:24.855916 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1552c1af-7104-4a13-bc36-afbb644ba2fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:24.856584 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1552c1af-7104-4a13-bc36-afbb644ba2fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:24.857354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1552c1af-7104-4a13-bc36-afbb644ba2fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:24.858360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1552c1af-7104-4a13-bc36-afbb644ba2fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:25.007533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1552c1af-7104-4a13-bc36-afbb644ba2fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:25.016242 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1552c1af-7104-4a13-bc36-afbb644ba2fb tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1553 microversion: 2.1 time: 0.173901 Jun 20 07:08:25.017068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 92/185] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:24 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:25.663110 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b7c54fc-e2ac-4613-beaf-a1a16cad874a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:25.663722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6b7c54fc-e2ac-4613-beaf-a1a16cad874a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:25.671587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b7c54fc-e2ac-4613-beaf-a1a16cad874a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:25.672041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b7c54fc-e2ac-4613-beaf-a1a16cad874a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:25.672835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b7c54fc-e2ac-4613-beaf-a1a16cad874a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:25.673274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b7c54fc-e2ac-4613-beaf-a1a16cad874a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:25.808741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6b7c54fc-e2ac-4613-beaf-a1a16cad874a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:25.816740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6b7c54fc-e2ac-4613-beaf-a1a16cad874a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.157355 Jun 20 07:08:25.817305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 94/186] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:25 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:25.863093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-84eda61d-4858-4ba5-8c4a-925b5bf2ec0e tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:25.863743 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-84eda61d-4858-4ba5-8c4a-925b5bf2ec0e tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:25.869605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84eda61d-4858-4ba5-8c4a-925b5bf2ec0e tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:25.870050 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84eda61d-4858-4ba5-8c4a-925b5bf2ec0e tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:25.870803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84eda61d-4858-4ba5-8c4a-925b5bf2ec0e tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:25.871232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84eda61d-4858-4ba5-8c4a-925b5bf2ec0e tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:25.934301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-84eda61d-4858-4ba5-8c4a-925b5bf2ec0e tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:25.942244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-84eda61d-4858-4ba5-8c4a-925b5bf2ec0e tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1219 microversion: 2.1 time: 0.082927 Jun 20 07:08:25.942796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 93/187] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:25 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:26.034139 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-45f801ac-9bfb-40d6-9e7c-f193e4698f98 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:26.034751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-45f801ac-9bfb-40d6-9e7c-f193e4698f98 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:26.040807 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45f801ac-9bfb-40d6-9e7c-f193e4698f98 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:26.041266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45f801ac-9bfb-40d6-9e7c-f193e4698f98 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:26.042058 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45f801ac-9bfb-40d6-9e7c-f193e4698f98 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:26.042499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45f801ac-9bfb-40d6-9e7c-f193e4698f98 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:26.176251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-45f801ac-9bfb-40d6-9e7c-f193e4698f98 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:26.184539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-45f801ac-9bfb-40d6-9e7c-f193e4698f98 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1553 microversion: 2.1 time: 0.154923 Jun 20 07:08:26.185108 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 95/188] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:26 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:26.833320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f29e4e9e-339d-41e7-994e-537627d34171 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:26.833932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f29e4e9e-339d-41e7-994e-537627d34171 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:26.839809 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f29e4e9e-339d-41e7-994e-537627d34171 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:26.840491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f29e4e9e-339d-41e7-994e-537627d34171 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:26.841234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f29e4e9e-339d-41e7-994e-537627d34171 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:26.841665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f29e4e9e-339d-41e7-994e-537627d34171 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:26.960436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e1107385-0616-4229-b61f-410dd8ecd4d4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:26.961044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e1107385-0616-4229-b61f-410dd8ecd4d4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:26.967650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1107385-0616-4229-b61f-410dd8ecd4d4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:26.968100 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1107385-0616-4229-b61f-410dd8ecd4d4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:26.968889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1107385-0616-4229-b61f-410dd8ecd4d4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:26.969522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1107385-0616-4229-b61f-410dd8ecd4d4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:26.982738 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f29e4e9e-339d-41e7-994e-537627d34171 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:26.993040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f29e4e9e-339d-41e7-994e-537627d34171 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.163113 Jun 20 07:08:26.993627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 94/189] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:26 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:27.047881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e1107385-0616-4229-b61f-410dd8ecd4d4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:27.055237 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e1107385-0616-4229-b61f-410dd8ecd4d4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1219 microversion: 2.1 time: 0.100266 Jun 20 07:08:27.055805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 96/190] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:26 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:27.201600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-334d6905-df83-4def-b073-194164db00f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:27.202345 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-334d6905-df83-4def-b073-194164db00f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:27.208597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-334d6905-df83-4def-b073-194164db00f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:27.209046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-334d6905-df83-4def-b073-194164db00f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:27.209812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-334d6905-df83-4def-b073-194164db00f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:27.210247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-334d6905-df83-4def-b073-194164db00f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:27.367514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-334d6905-df83-4def-b073-194164db00f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:27.377093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-334d6905-df83-4def-b073-194164db00f4 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1553 microversion: 2.1 time: 0.178755 Jun 20 07:08:27.386524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 95/191] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:27 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:28.010414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a8805ae8-7159-453c-aa71-5b58deab186e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:28.011210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a8805ae8-7159-453c-aa71-5b58deab186e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:28.018336 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8805ae8-7159-453c-aa71-5b58deab186e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:28.018915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8805ae8-7159-453c-aa71-5b58deab186e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:28.019799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8805ae8-7159-453c-aa71-5b58deab186e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:28.020326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8805ae8-7159-453c-aa71-5b58deab186e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:28.072225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4bdfcdbe-008c-4cbb-8b3b-460c5ef292de tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:28.072847 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4bdfcdbe-008c-4cbb-8b3b-460c5ef292de tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:28.074981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:28.086512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bdfcdbe-008c-4cbb-8b3b-460c5ef292de tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:28.086973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bdfcdbe-008c-4cbb-8b3b-460c5ef292de tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:28.087749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bdfcdbe-008c-4cbb-8b3b-460c5ef292de tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:28.088214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bdfcdbe-008c-4cbb-8b3b-460c5ef292de tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:28.168297 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4bdfcdbe-008c-4cbb-8b3b-460c5ef292de tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:28.176662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4bdfcdbe-008c-4cbb-8b3b-460c5ef292de tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1219 microversion: 2.1 time: 0.108163 Jun 20 07:08:28.177228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 96/192] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:28 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:28.196784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a8805ae8-7159-453c-aa71-5b58deab186e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:28.205184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a8805ae8-7159-453c-aa71-5b58deab186e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.198478 Jun 20 07:08:28.205798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 97/193] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:28 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:28.395217 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-586d9f31-8d68-43c2-87f3-4777b5745caa tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:28.396070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-586d9f31-8d68-43c2-87f3-4777b5745caa tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:28.402450 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-586d9f31-8d68-43c2-87f3-4777b5745caa tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:28.402898 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-586d9f31-8d68-43c2-87f3-4777b5745caa tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:28.403836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-586d9f31-8d68-43c2-87f3-4777b5745caa tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:28.404999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-586d9f31-8d68-43c2-87f3-4777b5745caa tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:28.427623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-de0ad2fa-092b-446f-b197-b7a1054dafeb req-a74631a6-c57e-4d40-80a5-5dbf028c28df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd99d933-7d4d-429a-9de4-d589c69c89c5", "name": "network-vif-unplugged", "status": "completed", "tag": "c9d59064-4403-4327-b155-afc400b0b340"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:28.437301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-de0ad2fa-092b-446f-b197-b7a1054dafeb req-a74631a6-c57e-4d40-80a5-5dbf028c28df service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:28.438369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-de0ad2fa-092b-446f-b197-b7a1054dafeb req-a74631a6-c57e-4d40-80a5-5dbf028c28df service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:28.455218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-de0ad2fa-092b-446f-b197-b7a1054dafeb req-a74631a6-c57e-4d40-80a5-5dbf028c28df service nova] Creating event network-vif-unplugged:c9d59064-4403-4327-b155-afc400b0b340 for instance fd99d933-7d4d-429a-9de4-d589c69c89c5 on hv-cinder-77819 Jun 20 07:08:28.461538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-de0ad2fa-092b-446f-b197-b7a1054dafeb req-a74631a6-c57e-4d40-80a5-5dbf028c28df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037244 Jun 20 07:08:28.464319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 98/194] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:08:28.545721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-586d9f31-8d68-43c2-87f3-4777b5745caa tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:28.549294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:28.554700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-586d9f31-8d68-43c2-87f3-4777b5745caa tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1553 microversion: 2.1 time: 0.164138 Jun 20 07:08:28.555272 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 97/195] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:28 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:29.194624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4ed43ac9-6e84-4fc8-9ce5-12c7124f62b4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:29.195312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4ed43ac9-6e84-4fc8-9ce5-12c7124f62b4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:29.201974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ed43ac9-6e84-4fc8-9ce5-12c7124f62b4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:29.202415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ed43ac9-6e84-4fc8-9ce5-12c7124f62b4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:29.203167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ed43ac9-6e84-4fc8-9ce5-12c7124f62b4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:29.203589 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4ed43ac9-6e84-4fc8-9ce5-12c7124f62b4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:29.223370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-94e2b65a-7ee4-427b-8d5d-8e31ed7e0549 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:29.224238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-94e2b65a-7ee4-427b-8d5d-8e31ed7e0549 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:29.231405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94e2b65a-7ee4-427b-8d5d-8e31ed7e0549 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:29.232221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94e2b65a-7ee4-427b-8d5d-8e31ed7e0549 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:29.233833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94e2b65a-7ee4-427b-8d5d-8e31ed7e0549 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:29.234150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94e2b65a-7ee4-427b-8d5d-8e31ed7e0549 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:29.272574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4ed43ac9-6e84-4fc8-9ce5-12c7124f62b4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:29.284403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4ed43ac9-6e84-4fc8-9ce5-12c7124f62b4 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1219 microversion: 2.1 time: 0.094097 Jun 20 07:08:29.285131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 99/196] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:29 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:29.368012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-94e2b65a-7ee4-427b-8d5d-8e31ed7e0549 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:29.376530 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-94e2b65a-7ee4-427b-8d5d-8e31ed7e0549 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.157625 Jun 20 07:08:29.377085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 98/197] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:29 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:29.572306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dcc63686-394a-43ca-b6ec-ccd008729d86 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:29.572827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dcc63686-394a-43ca-b6ec-ccd008729d86 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:29.579693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dcc63686-394a-43ca-b6ec-ccd008729d86 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:29.580167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dcc63686-394a-43ca-b6ec-ccd008729d86 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:29.580927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dcc63686-394a-43ca-b6ec-ccd008729d86 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:29.581361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dcc63686-394a-43ca-b6ec-ccd008729d86 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:29.718150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dcc63686-394a-43ca-b6ec-ccd008729d86 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:29.726110 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dcc63686-394a-43ca-b6ec-ccd008729d86 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1553 microversion: 2.1 time: 0.158002 Jun 20 07:08:29.726661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 100/198] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:29 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:30.301026 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-42eb718d-5937-4997-bd02-473acabf9287 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:30.301635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-42eb718d-5937-4997-bd02-473acabf9287 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:30.307560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42eb718d-5937-4997-bd02-473acabf9287 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:30.307998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42eb718d-5937-4997-bd02-473acabf9287 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:30.308777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42eb718d-5937-4997-bd02-473acabf9287 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:30.309208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42eb718d-5937-4997-bd02-473acabf9287 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:30.368783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-42eb718d-5937-4997-bd02-473acabf9287 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:30.375895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-42eb718d-5937-4997-bd02-473acabf9287 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1219 microversion: 2.1 time: 0.078713 Jun 20 07:08:30.376478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 99/199] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:30 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:30.395241 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3e4e94c8-fa53-4147-b6e7-660145d64f0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:30.395848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3e4e94c8-fa53-4147-b6e7-660145d64f0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:30.402749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e4e94c8-fa53-4147-b6e7-660145d64f0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:30.403205 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e4e94c8-fa53-4147-b6e7-660145d64f0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:30.403974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e4e94c8-fa53-4147-b6e7-660145d64f0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:30.405037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e4e94c8-fa53-4147-b6e7-660145d64f0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:30.531716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3e4e94c8-fa53-4147-b6e7-660145d64f0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:30.535425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:30.540022 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3e4e94c8-fa53-4147-b6e7-660145d64f0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.148750 Jun 20 07:08:30.540649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 101/200] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:30 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:30.743953 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e4bc725f-7081-46b4-b1ce-afab9de19237 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:30.744590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e4bc725f-7081-46b4-b1ce-afab9de19237 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:30.751116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4bc725f-7081-46b4-b1ce-afab9de19237 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:30.751559 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4bc725f-7081-46b4-b1ce-afab9de19237 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:30.752337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4bc725f-7081-46b4-b1ce-afab9de19237 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:30.752774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4bc725f-7081-46b4-b1ce-afab9de19237 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:30.880049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e4bc725f-7081-46b4-b1ce-afab9de19237 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:30.887937 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e4bc725f-7081-46b4-b1ce-afab9de19237 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1553 microversion: 2.1 time: 0.147808 Jun 20 07:08:30.888533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 100/201] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:30 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:31.392664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-77e22c0e-1653-4c00-b498-b87beb38afd1 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:31.393195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-77e22c0e-1653-4c00-b498-b87beb38afd1 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:31.399672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77e22c0e-1653-4c00-b498-b87beb38afd1 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:31.400260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77e22c0e-1653-4c00-b498-b87beb38afd1 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:31.401044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77e22c0e-1653-4c00-b498-b87beb38afd1 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:31.401491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77e22c0e-1653-4c00-b498-b87beb38afd1 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:31.459629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-77e22c0e-1653-4c00-b498-b87beb38afd1 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:31.467415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-77e22c0e-1653-4c00-b498-b87beb38afd1 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1219 microversion: 2.1 time: 0.078847 Jun 20 07:08:31.468016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 102/202] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:31 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:31.557057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-49943c76-465c-4f46-8532-2cc911f72095 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:31.557539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-49943c76-465c-4f46-8532-2cc911f72095 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:31.563562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49943c76-465c-4f46-8532-2cc911f72095 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:31.564011 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49943c76-465c-4f46-8532-2cc911f72095 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:31.564812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49943c76-465c-4f46-8532-2cc911f72095 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:31.565245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49943c76-465c-4f46-8532-2cc911f72095 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:31.778746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-49943c76-465c-4f46-8532-2cc911f72095 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:31.790108 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-49943c76-465c-4f46-8532-2cc911f72095 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.237236 Jun 20 07:08:31.792533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 101/203] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:31 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:31.906817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dd31f877-e5c0-494c-a350-519a6ac36cac tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:31.907461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dd31f877-e5c0-494c-a350-519a6ac36cac tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:31.913395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd31f877-e5c0-494c-a350-519a6ac36cac tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:31.913842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd31f877-e5c0-494c-a350-519a6ac36cac tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:31.914637 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd31f877-e5c0-494c-a350-519a6ac36cac tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:31.915071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd31f877-e5c0-494c-a350-519a6ac36cac tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:32.145311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dd31f877-e5c0-494c-a350-519a6ac36cac tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:32.154610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dd31f877-e5c0-494c-a350-519a6ac36cac tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1553 microversion: 2.1 time: 0.252179 Jun 20 07:08:32.155151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 103/204] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:31 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:32.376364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-120f1bb1-d333-4649-9a5c-a0154f2bb717 req-2a7dba97-15e9-4063-8b33-a1faf78f211b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd99d933-7d4d-429a-9de4-d589c69c89c5", "name": "network-vif-deleted", "tag": "c9d59064-4403-4327-b155-afc400b0b340"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:32.389370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-120f1bb1-d333-4649-9a5c-a0154f2bb717 req-2a7dba97-15e9-4063-8b33-a1faf78f211b service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:32.390061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-120f1bb1-d333-4649-9a5c-a0154f2bb717 req-2a7dba97-15e9-4063-8b33-a1faf78f211b service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:32.404302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-120f1bb1-d333-4649-9a5c-a0154f2bb717 req-2a7dba97-15e9-4063-8b33-a1faf78f211b service nova] Creating event network-vif-deleted:c9d59064-4403-4327-b155-afc400b0b340 for instance fd99d933-7d4d-429a-9de4-d589c69c89c5 on hv-cinder-77819 Jun 20 07:08:32.411426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-120f1bb1-d333-4649-9a5c-a0154f2bb717 req-2a7dba97-15e9-4063-8b33-a1faf78f211b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040190 Jun 20 07:08:32.416569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 102/205] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:08:32.486073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d13c2ec4-7987-4548-ac39-f864b813dca2 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:32.487062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d13c2ec4-7987-4548-ac39-f864b813dca2 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:32.495318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d13c2ec4-7987-4548-ac39-f864b813dca2 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:32.495766 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d13c2ec4-7987-4548-ac39-f864b813dca2 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:32.496564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d13c2ec4-7987-4548-ac39-f864b813dca2 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:32.497285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d13c2ec4-7987-4548-ac39-f864b813dca2 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:32.570699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d13c2ec4-7987-4548-ac39-f864b813dca2 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:32.578477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d13c2ec4-7987-4548-ac39-f864b813dca2 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1273 microversion: 2.1 time: 0.098354 Jun 20 07:08:32.579058 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 104/206] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:32 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:32.807474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-18eb4a53-3f9a-45cb-826e-cd6ea6285b06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:32.808346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-18eb4a53-3f9a-45cb-826e-cd6ea6285b06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:32.815833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18eb4a53-3f9a-45cb-826e-cd6ea6285b06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:32.816414 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18eb4a53-3f9a-45cb-826e-cd6ea6285b06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:32.817411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18eb4a53-3f9a-45cb-826e-cd6ea6285b06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:32.818640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18eb4a53-3f9a-45cb-826e-cd6ea6285b06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:32.978187 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-18eb4a53-3f9a-45cb-826e-cd6ea6285b06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:32.986939 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-18eb4a53-3f9a-45cb-826e-cd6ea6285b06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.183643 Jun 20 07:08:32.987811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 103/207] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:32 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:33.173523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fc4474be-96e5-428b-9829-a1c0d889a23d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:33.174758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fc4474be-96e5-428b-9829-a1c0d889a23d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:33.181123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4474be-96e5-428b-9829-a1c0d889a23d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:33.182261 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4474be-96e5-428b-9829-a1c0d889a23d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:33.183172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4474be-96e5-428b-9829-a1c0d889a23d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:33.183710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4474be-96e5-428b-9829-a1c0d889a23d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:33.219560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4474be-96e5-428b-9829-a1c0d889a23d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:33.219934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4474be-96e5-428b-9829-a1c0d889a23d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:33.220405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-fc4474be-96e5-428b-9829-a1c0d889a23d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lazy-loading 'fault' on Instance uuid fd99d933-7d4d-429a-9de4-d589c69c89c5 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:08:33.271211 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fc4474be-96e5-428b-9829-a1c0d889a23d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b974bab2e7934b57ab79128210c439a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ee20ba4bcd469097e1a8815eee16e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:33.284031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fc4474be-96e5-428b-9829-a1c0d889a23d tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 200 len: 1350 microversion: 2.1 time: 0.116247 Jun 20 07:08:33.284661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 105/208] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:33 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 1350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:33.595351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ec598ff8-b681-4a23-a769-7b81fdbaf55d tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:33.600025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ec598ff8-b681-4a23-a769-7b81fdbaf55d tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:33.610009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec598ff8-b681-4a23-a769-7b81fdbaf55d tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:33.610680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec598ff8-b681-4a23-a769-7b81fdbaf55d tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:33.612496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec598ff8-b681-4a23-a769-7b81fdbaf55d tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:33.613027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec598ff8-b681-4a23-a769-7b81fdbaf55d tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:33.790964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ec598ff8-b681-4a23-a769-7b81fdbaf55d tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:33.798589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ec598ff8-b681-4a23-a769-7b81fdbaf55d tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1315 microversion: 2.1 time: 0.207615 Jun 20 07:08:33.799163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 104/209] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:33 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:34.005246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b35258a5-68b9-4a32-9215-9b7658de7ef6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:34.005864 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b35258a5-68b9-4a32-9215-9b7658de7ef6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:34.014018 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b35258a5-68b9-4a32-9215-9b7658de7ef6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:34.014734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b35258a5-68b9-4a32-9215-9b7658de7ef6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:34.015674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b35258a5-68b9-4a32-9215-9b7658de7ef6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:34.016293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b35258a5-68b9-4a32-9215-9b7658de7ef6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:34.179716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b35258a5-68b9-4a32-9215-9b7658de7ef6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:34.189102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b35258a5-68b9-4a32-9215-9b7658de7ef6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.187648 Jun 20 07:08:34.189775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 106/210] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:34 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:34.301722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d5d75661-2835-46f4-bd2a-d6cbab3dec1c tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:34.302501 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d5d75661-2835-46f4-bd2a-d6cbab3dec1c tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:34.308734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5d75661-2835-46f4-bd2a-d6cbab3dec1c tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:34.309261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5d75661-2835-46f4-bd2a-d6cbab3dec1c tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:34.310103 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5d75661-2835-46f4-bd2a-d6cbab3dec1c tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:34.311213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5d75661-2835-46f4-bd2a-d6cbab3dec1c tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:34.325035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-d5d75661-2835-46f4-bd2a-d6cbab3dec1c tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] HTTP exception thrown: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d5d75661-2835-46f4-bd2a-d6cbab3dec1c tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Request method failure captured: Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 HTTP/1.1 Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisBye1Ru5WUDXeLlggJGQNbKJpaTq9zBq-41TWY2SyBBDlRHvBPfwnI-fAtmWJUPeuSvkl2pq-87YK4tx9dFVz4tuTzftUXjpwkKpqkui4DdeaAGjk_Kf2KWTqC8zEXI48x-J4KK0OPlYKB3x6yBEwljUfrd2NJhOxz78zpymKNPhV0g Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 96ee20ba4bcd469097e1a8815eee16e6 Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-DeleteServersTestJSON-826619827 Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:08:34.329707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:08:34.331165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:08:34.331165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-DeleteServersTestJSON-826619827 Jun 20 07:08:34.331165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 96ee20ba4bcd469097e1a8815eee16e6 Jun 20 07:08:34.331165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-DeleteServersTestJSON-826619827 Jun 20 07:08:34.331165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-DeleteServersTestJSON-826619827-project Jun 20 07:08:34.331165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:08:34.331165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:08:34.331165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: b974bab2e7934b57ab79128210c439a7 Jun 20 07:08:34.331165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-DeleteServersTestJSON-826619827-project Jun 20 07:08:34.331165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:08:34.331165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:34.331165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': 'fd99d933-7d4d-429a-9de4-d589c69c89c5'} Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:08:34.332027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:34.333347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:34.334551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d5d75661-2835-46f4-bd2a-d6cbab3dec1c tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Returning 404 to user: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:08:34.334551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d5d75661-2835-46f4-bd2a-d6cbab3dec1c tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 404 len: 111 microversion: 2.1 time: 0.033432 Jun 20 07:08:34.334551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 105/211] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:34 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:08:34.391797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-66b0fc44-2e0e-44ac-adcc-3bb2746a0c07 req-273b9923-59ad-4c21-9bcb-4caeffc8dd54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56f8812-496d-4fb7-a2da-ac6cb57456a5", "tag": "ae9eae3d-d89d-4d67-b352-56d581b40d34"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:34.406470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-66b0fc44-2e0e-44ac-adcc-3bb2746a0c07 req-273b9923-59ad-4c21-9bcb-4caeffc8dd54 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:34.407150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-66b0fc44-2e0e-44ac-adcc-3bb2746a0c07 req-273b9923-59ad-4c21-9bcb-4caeffc8dd54 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:34.421788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-66b0fc44-2e0e-44ac-adcc-3bb2746a0c07 req-273b9923-59ad-4c21-9bcb-4caeffc8dd54 service nova] Creating event network-changed:ae9eae3d-d89d-4d67-b352-56d581b40d34 for instance c56f8812-496d-4fb7-a2da-ac6cb57456a5 on hv-cinder-77819 Jun 20 07:08:34.426642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-66b0fc44-2e0e-44ac-adcc-3bb2746a0c07 req-273b9923-59ad-4c21-9bcb-4caeffc8dd54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050560 Jun 20 07:08:34.428308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 107/212] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:08:34.477136 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-53c33275-dd3c-4a34-bf96-a32b0a9c69cf tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:34.478211 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-53c33275-dd3c-4a34-bf96-a32b0a9c69cf tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:34.485432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53c33275-dd3c-4a34-bf96-a32b0a9c69cf tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:34.486145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53c33275-dd3c-4a34-bf96-a32b0a9c69cf tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:34.486922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53c33275-dd3c-4a34-bf96-a32b0a9c69cf tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:34.487362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53c33275-dd3c-4a34-bf96-a32b0a9c69cf tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:34.500808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-53c33275-dd3c-4a34-bf96-a32b0a9c69cf tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] HTTP exception thrown: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-53c33275-dd3c-4a34-bf96-a32b0a9c69cf tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Request method failure captured: Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5/os-volume_attachments HTTP/1.1 Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisBye1Ru5WUDXeLlggJGQNbKJpaTq9zBq-41TWY2SyBBDlRHvBPfwnI-fAtmWJUPeuSvkl2pq-87YK4tx9dFVz4tuTzftUXjpwkKpqkui4DdeaAGjk_Kf2KWTqC8zEXI48x-J4KK0OPlYKB3x6yBEwljUfrd2NJhOxz78zpymKNPhV0g Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 96ee20ba4bcd469097e1a8815eee16e6 Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-DeleteServersTestJSON-826619827 Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:08:34.502589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:08:34.503985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:08:34.503985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-DeleteServersTestJSON-826619827 Jun 20 07:08:34.503985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 96ee20ba4bcd469097e1a8815eee16e6 Jun 20 07:08:34.503985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-DeleteServersTestJSON-826619827 Jun 20 07:08:34.503985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-DeleteServersTestJSON-826619827-project Jun 20 07:08:34.503985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:08:34.503985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:08:34.503985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: b974bab2e7934b57ab79128210c439a7 Jun 20 07:08:34.503985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-DeleteServersTestJSON-826619827-project Jun 20 07:08:34.503985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:08:34.503985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:34.503985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'server_id': 'fd99d933-7d4d-429a-9de4-d589c69c89c5'} Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:08:34.504816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:34.506106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:34.507441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-53c33275-dd3c-4a34-bf96-a32b0a9c69cf tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Returning 404 to user: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:08:34.507441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-53c33275-dd3c-4a34-bf96-a32b0a9c69cf tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031081 Jun 20 07:08:34.507441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 106/213] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:08:34 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:08:34.816516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dc6f3768-621b-4897-a7eb-71314635fa87 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:34.817330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dc6f3768-621b-4897-a7eb-71314635fa87 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:34.823848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc6f3768-621b-4897-a7eb-71314635fa87 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:34.824404 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc6f3768-621b-4897-a7eb-71314635fa87 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:34.825269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc6f3768-621b-4897-a7eb-71314635fa87 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:34.825807 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc6f3768-621b-4897-a7eb-71314635fa87 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:34.845143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:34.970266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dc6f3768-621b-4897-a7eb-71314635fa87 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:34.977858 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dc6f3768-621b-4897-a7eb-71314635fa87 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1315 microversion: 2.1 time: 0.166840 Jun 20 07:08:34.978429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 108/214] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:34 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:35.206520 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-84b6d310-b7c2-40e3-80aa-09e617fc5ea9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:35.207132 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-84b6d310-b7c2-40e3-80aa-09e617fc5ea9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:35.209116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:35.209776 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:35.215998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84b6d310-b7c2-40e3-80aa-09e617fc5ea9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:35.216456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84b6d310-b7c2-40e3-80aa-09e617fc5ea9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:35.217246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84b6d310-b7c2-40e3-80aa-09e617fc5ea9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:35.217682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84b6d310-b7c2-40e3-80aa-09e617fc5ea9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:35.350355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-84b6d310-b7c2-40e3-80aa-09e617fc5ea9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:35.357809 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-84b6d310-b7c2-40e3-80aa-09e617fc5ea9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.155146 Jun 20 07:08:35.358370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 107/215] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:35 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:35.709111 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f97dffe1-44bd-4168-bd92-342e6b5112d0 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:35.709584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f97dffe1-44bd-4168-bd92-342e6b5112d0 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:35.716009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f97dffe1-44bd-4168-bd92-342e6b5112d0 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:35.716530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f97dffe1-44bd-4168-bd92-342e6b5112d0 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:35.717286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f97dffe1-44bd-4168-bd92-342e6b5112d0 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:35.717720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f97dffe1-44bd-4168-bd92-342e6b5112d0 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:35.730862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-f97dffe1-44bd-4168-bd92-342e6b5112d0 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] HTTP exception thrown: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f97dffe1-44bd-4168-bd92-342e6b5112d0 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Request method failure captured: Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 HTTP/1.1 Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisBye1Ru5WUDXeLlggJGQNbKJpaTq9zBq-41TWY2SyBBDlRHvBPfwnI-fAtmWJUPeuSvkl2pq-87YK4tx9dFVz4tuTzftUXjpwkKpqkui4DdeaAGjk_Kf2KWTqC8zEXI48x-J4KK0OPlYKB3x6yBEwljUfrd2NJhOxz78zpymKNPhV0g Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 96ee20ba4bcd469097e1a8815eee16e6 Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-DeleteServersTestJSON-826619827 Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:08:35.736365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:08:35.737896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:08:35.737896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-DeleteServersTestJSON-826619827 Jun 20 07:08:35.737896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 96ee20ba4bcd469097e1a8815eee16e6 Jun 20 07:08:35.737896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-DeleteServersTestJSON-826619827 Jun 20 07:08:35.737896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-DeleteServersTestJSON-826619827-project Jun 20 07:08:35.737896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:08:35.737896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:08:35.737896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: b974bab2e7934b57ab79128210c439a7 Jun 20 07:08:35.737896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-DeleteServersTestJSON-826619827-project Jun 20 07:08:35.737896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:08:35.737896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:35.737896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': 'fd99d933-7d4d-429a-9de4-d589c69c89c5'} Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:08:35.738743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:35.740167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:08:35.746641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f97dffe1-44bd-4168-bd92-342e6b5112d0 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Returning 404 to user: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:08:35.746641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f97dffe1-44bd-4168-bd92-342e6b5112d0 tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 404 len: 111 microversion: 2.1 time: 0.032607 Jun 20 07:08:35.746641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 109/216] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:08:35 2022] DELETE /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:08:35.747315 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e5c444d6-438d-4c21-bc5d-8a2fd579e53f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:35.749049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e5c444d6-438d-4c21-bc5d-8a2fd579e53f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] [instance: fd99d933-7d4d-429a-9de4-d589c69c89c5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:35.755962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5c444d6-438d-4c21-bc5d-8a2fd579e53f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:35.756660 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5c444d6-438d-4c21-bc5d-8a2fd579e53f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:35.757436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5c444d6-438d-4c21-bc5d-8a2fd579e53f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:35.757877 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5c444d6-438d-4c21-bc5d-8a2fd579e53f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:35.771280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-e5c444d6-438d-4c21-bc5d-8a2fd579e53f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] HTTP exception thrown: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e5c444d6-438d-4c21-bc5d-8a2fd579e53f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Request method failure captured: Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 HTTP/1.1 Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisBye1Ru5WUDXeLlggJGQNbKJpaTq9zBq-41TWY2SyBBDlRHvBPfwnI-fAtmWJUPeuSvkl2pq-87YK4tx9dFVz4tuTzftUXjpwkKpqkui4DdeaAGjk_Kf2KWTqC8zEXI48x-J4KK0OPlYKB3x6yBEwljUfrd2NJhOxz78zpymKNPhV0g Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 96ee20ba4bcd469097e1a8815eee16e6 Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-DeleteServersTestJSON-826619827 Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:08:35.772824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:08:35.774214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ee20ba4bcd469097e1a8815eee16e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:08:35.774214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-DeleteServersTestJSON-826619827 Jun 20 07:08:35.774214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 96ee20ba4bcd469097e1a8815eee16e6 Jun 20 07:08:35.774214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-DeleteServersTestJSON-826619827 Jun 20 07:08:35.774214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-DeleteServersTestJSON-826619827-project Jun 20 07:08:35.774214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:08:35.774214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:08:35.774214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: b974bab2e7934b57ab79128210c439a7 Jun 20 07:08:35.774214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-DeleteServersTestJSON-826619827-project Jun 20 07:08:35.774214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:08:35.774214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:35.774214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': 'fd99d933-7d4d-429a-9de4-d589c69c89c5'} Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:08:35.775069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. Jun 20 07:08:35.776420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:35.777763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e5c444d6-438d-4c21-bc5d-8a2fd579e53f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] Returning 404 to user: Instance fd99d933-7d4d-429a-9de4-d589c69c89c5 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:08:35.777763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e5c444d6-438d-4c21-bc5d-8a2fd579e53f tempest-DeleteServersTestJSON-826619827 tempest-DeleteServersTestJSON-826619827-project] 10.222.0.23 "GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5" status: 404 len: 111 microversion: 2.1 time: 0.031907 Jun 20 07:08:35.777763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 108/217] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:35 2022] GET /compute/v2.1/servers/fd99d933-7d4d-429a-9de4-d589c69c89c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 07:08:35.994651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-53d42330-3e18-4a49-93e7-c6a748a1a62f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:35.995316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-53d42330-3e18-4a49-93e7-c6a748a1a62f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:36.001546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53d42330-3e18-4a49-93e7-c6a748a1a62f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:36.001990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53d42330-3e18-4a49-93e7-c6a748a1a62f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:36.002745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53d42330-3e18-4a49-93e7-c6a748a1a62f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:36.003236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53d42330-3e18-4a49-93e7-c6a748a1a62f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:36.385304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-59e396ac-2346-4850-bd10-d6d11abbb8ea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:36.387023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-59e396ac-2346-4850-bd10-d6d11abbb8ea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:36.396043 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59e396ac-2346-4850-bd10-d6d11abbb8ea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:36.396820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59e396ac-2346-4850-bd10-d6d11abbb8ea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:36.397693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59e396ac-2346-4850-bd10-d6d11abbb8ea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:36.398232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59e396ac-2346-4850-bd10-d6d11abbb8ea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:36.541384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-53d42330-3e18-4a49-93e7-c6a748a1a62f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:36.549811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-53d42330-3e18-4a49-93e7-c6a748a1a62f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1315 microversion: 2.1 time: 0.558993 Jun 20 07:08:36.550434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 110/218] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:35 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:36.726883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-59e396ac-2346-4850-bd10-d6d11abbb8ea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:36.736508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-59e396ac-2346-4850-bd10-d6d11abbb8ea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.358632 Jun 20 07:08:36.737089 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 109/219] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:36 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:37.570827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-73ae8e4a-19f4-453e-8f90-4c82d75e0b1f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:37.571880 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-73ae8e4a-19f4-453e-8f90-4c82d75e0b1f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:37.578281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73ae8e4a-19f4-453e-8f90-4c82d75e0b1f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:37.578761 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73ae8e4a-19f4-453e-8f90-4c82d75e0b1f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:37.579594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73ae8e4a-19f4-453e-8f90-4c82d75e0b1f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:37.580032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73ae8e4a-19f4-453e-8f90-4c82d75e0b1f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:37.754018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6b2e8575-1f20-4dc7-986b-949d456f5444 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:37.755391 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6b2e8575-1f20-4dc7-986b-949d456f5444 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:37.763060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b2e8575-1f20-4dc7-986b-949d456f5444 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:37.764381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b2e8575-1f20-4dc7-986b-949d456f5444 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:37.765456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b2e8575-1f20-4dc7-986b-949d456f5444 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:37.766112 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b2e8575-1f20-4dc7-986b-949d456f5444 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:37.789003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-73ae8e4a-19f4-453e-8f90-4c82d75e0b1f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:37.800953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-73ae8e4a-19f4-453e-8f90-4c82d75e0b1f tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1315 microversion: 2.1 time: 0.236970 Jun 20 07:08:37.801543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 111/220] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:37 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:37.940811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6b2e8575-1f20-4dc7-986b-949d456f5444 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:37.950006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6b2e8575-1f20-4dc7-986b-949d456f5444 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.200386 Jun 20 07:08:37.960163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 110/221] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:37 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:38.818487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-53340b54-fa69-437a-9d69-f6405f581932 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:38.819109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-53340b54-fa69-437a-9d69-f6405f581932 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:38.825582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53340b54-fa69-437a-9d69-f6405f581932 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:38.826088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53340b54-fa69-437a-9d69-f6405f581932 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:38.826845 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53340b54-fa69-437a-9d69-f6405f581932 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:38.827279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53340b54-fa69-437a-9d69-f6405f581932 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:38.972673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-02a006d6-529e-4ae1-acf4-0edc53390ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:38.975070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-02a006d6-529e-4ae1-acf4-0edc53390ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:38.989424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-53340b54-fa69-437a-9d69-f6405f581932 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:38.990067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02a006d6-529e-4ae1-acf4-0edc53390ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:38.991205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02a006d6-529e-4ae1-acf4-0edc53390ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:38.994092 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02a006d6-529e-4ae1-acf4-0edc53390ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:38.994840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02a006d6-529e-4ae1-acf4-0edc53390ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:39.010807 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-53340b54-fa69-437a-9d69-f6405f581932 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1315 microversion: 2.1 time: 0.196726 Jun 20 07:08:39.012656 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 112/222] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:38 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:39.178538 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-02a006d6-529e-4ae1-acf4-0edc53390ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:39.189864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-02a006d6-529e-4ae1-acf4-0edc53390ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.225957 Jun 20 07:08:39.190976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 111/223] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:38 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:40.029821 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-27d38b0e-31e8-45e2-854f-25eb54fdaf37 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:40.030404 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-27d38b0e-31e8-45e2-854f-25eb54fdaf37 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:40.037307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27d38b0e-31e8-45e2-854f-25eb54fdaf37 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:40.039297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27d38b0e-31e8-45e2-854f-25eb54fdaf37 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:40.040497 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27d38b0e-31e8-45e2-854f-25eb54fdaf37 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:40.041058 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27d38b0e-31e8-45e2-854f-25eb54fdaf37 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:40.222704 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-571392b5-a4e3-49db-bf38-a7af0445ac30 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:40.226042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-571392b5-a4e3-49db-bf38-a7af0445ac30 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:40.233291 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-571392b5-a4e3-49db-bf38-a7af0445ac30 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:40.234127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-571392b5-a4e3-49db-bf38-a7af0445ac30 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:40.235340 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-571392b5-a4e3-49db-bf38-a7af0445ac30 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:40.235944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-571392b5-a4e3-49db-bf38-a7af0445ac30 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:40.255114 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-27d38b0e-31e8-45e2-854f-25eb54fdaf37 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:40.266034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-27d38b0e-31e8-45e2-854f-25eb54fdaf37 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1315 microversion: 2.1 time: 0.240510 Jun 20 07:08:40.277298 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 113/224] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:40 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:40.433223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-571392b5-a4e3-49db-bf38-a7af0445ac30 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:40.441849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-571392b5-a4e3-49db-bf38-a7af0445ac30 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.234402 Jun 20 07:08:40.442420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 112/225] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:40 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:40.602228 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-7459ae81-65a3-4e4b-8aa0-7c8cb4047e3a req-ff0372d0-5a43-44c0-801c-810c595958f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56f8812-496d-4fb7-a2da-ac6cb57456a5", "name": "network-vif-plugged", "status": "completed", "tag": "ae9eae3d-d89d-4d67-b352-56d581b40d34"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:40.610885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-7459ae81-65a3-4e4b-8aa0-7c8cb4047e3a req-ff0372d0-5a43-44c0-801c-810c595958f2 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:40.611526 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-7459ae81-65a3-4e4b-8aa0-7c8cb4047e3a req-ff0372d0-5a43-44c0-801c-810c595958f2 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:40.627468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-7459ae81-65a3-4e4b-8aa0-7c8cb4047e3a req-ff0372d0-5a43-44c0-801c-810c595958f2 service nova] Creating event network-vif-plugged:ae9eae3d-d89d-4d67-b352-56d581b40d34 for instance c56f8812-496d-4fb7-a2da-ac6cb57456a5 on hv-cinder-77819 Jun 20 07:08:40.634420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-7459ae81-65a3-4e4b-8aa0-7c8cb4047e3a req-ff0372d0-5a43-44c0-801c-810c595958f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041331 Jun 20 07:08:40.635588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 114/226] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:08:41.283035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-44e8bf68-ae54-45fe-a76a-21cfc6f421a3 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:41.283653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-44e8bf68-ae54-45fe-a76a-21cfc6f421a3 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:41.290082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44e8bf68-ae54-45fe-a76a-21cfc6f421a3 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:41.290638 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44e8bf68-ae54-45fe-a76a-21cfc6f421a3 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:41.291409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44e8bf68-ae54-45fe-a76a-21cfc6f421a3 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:41.291995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44e8bf68-ae54-45fe-a76a-21cfc6f421a3 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:41.422120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-44e8bf68-ae54-45fe-a76a-21cfc6f421a3 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:41.429541 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-44e8bf68-ae54-45fe-a76a-21cfc6f421a3 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1315 microversion: 2.1 time: 0.150886 Jun 20 07:08:41.430186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 113/227] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:41 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:41.461982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d53a7575-2dab-4e75-9e55-f705d6722f18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:41.462685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d53a7575-2dab-4e75-9e55-f705d6722f18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:41.469349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d53a7575-2dab-4e75-9e55-f705d6722f18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:41.469800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d53a7575-2dab-4e75-9e55-f705d6722f18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:41.470557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d53a7575-2dab-4e75-9e55-f705d6722f18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:41.470988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d53a7575-2dab-4e75-9e55-f705d6722f18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:41.613705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d53a7575-2dab-4e75-9e55-f705d6722f18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:41.619212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d53a7575-2dab-4e75-9e55-f705d6722f18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.161951 Jun 20 07:08:41.619941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 115/228] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:41 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:41.998622 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2488897", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "networks": [{"uuid": "1d69be69-f5b1-49b8-b0ff-8267bcc521f1"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:42.050714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] validate_networks() for [('1d69be69-f5b1-49b8-b0ff-8267bcc521f1', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:08:42.403574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:08:42.404636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:08:42.405074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:08:42.405481 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:08:42.405906 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:08:42.414509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:42.414943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:42.415721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:42.416232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:42.432957 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Getting quotas for project 1583bd5823544e54b32e1eaf308cd261. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:08:42.436863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Getting quotas for user 0dbf681122194384812c2eb96d1adfbc and project 1583bd5823544e54b32e1eaf308cd261. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:08:42.446903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-18271bbc-c6ce-4d50-adac-49283ad70033 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:42.447558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-18271bbc-c6ce-4d50-adac-49283ad70033 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:42.448858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:08:42.452006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:08:42.458117 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18271bbc-c6ce-4d50-adac-49283ad70033 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:42.458569 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18271bbc-c6ce-4d50-adac-49283ad70033 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:42.459366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18271bbc-c6ce-4d50-adac-49283ad70033 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:42.459797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18271bbc-c6ce-4d50-adac-49283ad70033 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:42.496969 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-acc570c4-8ae6-4597-b08d-158c73b48659 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502572 Jun 20 07:08:42.502684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 114/229] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:08:42.507882 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b71934fc-54f5-439d-8578-2f2e8851f225 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:42.508522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b71934fc-54f5-439d-8578-2f2e8851f225 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:42.586474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b71934fc-54f5-439d-8578-2f2e8851f225 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:42.603952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b71934fc-54f5-439d-8578-2f2e8851f225 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1216 microversion: 2.1 time: 0.095606 Jun 20 07:08:42.604600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 115/230] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:42 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1216 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:42.619837 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-18271bbc-c6ce-4d50-adac-49283ad70033 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:42.630035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-18271bbc-c6ce-4d50-adac-49283ad70033 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1315 microversion: 2.1 time: 0.187157 Jun 20 07:08:42.630645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 116/231] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:42 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:42.640682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-57b87414-e508-4d36-8deb-5e194a45e8c4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:42.641310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-57b87414-e508-4d36-8deb-5e194a45e8c4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:42.647674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57b87414-e508-4d36-8deb-5e194a45e8c4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:42.648160 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57b87414-e508-4d36-8deb-5e194a45e8c4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:42.649098 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57b87414-e508-4d36-8deb-5e194a45e8c4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:42.649543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57b87414-e508-4d36-8deb-5e194a45e8c4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:42.798425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-57b87414-e508-4d36-8deb-5e194a45e8c4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:42.806418 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-57b87414-e508-4d36-8deb-5e194a45e8c4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.173882 Jun 20 07:08:42.807126 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 116/232] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:42 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:43.620494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-452b9423-70ba-4ad2-b192-72f0d7f8aff7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:43.621104 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-452b9423-70ba-4ad2-b192-72f0d7f8aff7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:43.627516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-452b9423-70ba-4ad2-b192-72f0d7f8aff7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:43.627902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-452b9423-70ba-4ad2-b192-72f0d7f8aff7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:43.628694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-452b9423-70ba-4ad2-b192-72f0d7f8aff7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:43.629127 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-452b9423-70ba-4ad2-b192-72f0d7f8aff7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:43.647948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b040f8d7-1d2b-43b6-89a9-1b7b5d436389 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:43.648633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b040f8d7-1d2b-43b6-89a9-1b7b5d436389 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:43.655156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b040f8d7-1d2b-43b6-89a9-1b7b5d436389 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:43.655607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b040f8d7-1d2b-43b6-89a9-1b7b5d436389 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:43.656410 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b040f8d7-1d2b-43b6-89a9-1b7b5d436389 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:43.656850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b040f8d7-1d2b-43b6-89a9-1b7b5d436389 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:43.689826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-452b9423-70ba-4ad2-b192-72f0d7f8aff7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:43.697563 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-452b9423-70ba-4ad2-b192-72f0d7f8aff7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1220 microversion: 2.1 time: 0.080826 Jun 20 07:08:43.698235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 117/233] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:43 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:43.785866 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b040f8d7-1d2b-43b6-89a9-1b7b5d436389 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:43.793398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b040f8d7-1d2b-43b6-89a9-1b7b5d436389 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1465 microversion: 2.1 time: 0.149297 Jun 20 07:08:43.793959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 117/234] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:43 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1465 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:43.823860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6bc1c389-d083-4d93-b714-4bc8c850a0cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:43.824501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6bc1c389-d083-4d93-b714-4bc8c850a0cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:43.833275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c751de19-0ebb-47ed-a198-340c26752335 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:43.833774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c751de19-0ebb-47ed-a198-340c26752335 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:43.834053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6bc1c389-d083-4d93-b714-4bc8c850a0cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:43.834517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6bc1c389-d083-4d93-b714-4bc8c850a0cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:43.835262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6bc1c389-d083-4d93-b714-4bc8c850a0cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:43.835697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6bc1c389-d083-4d93-b714-4bc8c850a0cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:43.839714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c751de19-0ebb-47ed-a198-340c26752335 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:43.840184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c751de19-0ebb-47ed-a198-340c26752335 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:43.840958 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c751de19-0ebb-47ed-a198-340c26752335 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:43.842044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c751de19-0ebb-47ed-a198-340c26752335 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:43.867149 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c751de19-0ebb-47ed-a198-340c26752335 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:08:43.870247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:43.968825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c751de19-0ebb-47ed-a198-340c26752335 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 204 len: 0 microversion: 2.1 time: 0.138852 Jun 20 07:08:43.971594 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 118/235] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:08:43 2022] DELETE /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 07:08:43.982098 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-018ad672-5b94-4a6b-b614-5b9f625d35e9 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:43.982870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-018ad672-5b94-4a6b-b614-5b9f625d35e9 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:43.990554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-018ad672-5b94-4a6b-b614-5b9f625d35e9 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:43.991010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-018ad672-5b94-4a6b-b614-5b9f625d35e9 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:43.991783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-018ad672-5b94-4a6b-b614-5b9f625d35e9 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:43.992701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-018ad672-5b94-4a6b-b614-5b9f625d35e9 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:43.995650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6bc1c389-d083-4d93-b714-4bc8c850a0cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:44.003886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6bc1c389-d083-4d93-b714-4bc8c850a0cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.183802 Jun 20 07:08:44.004522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 118/236] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:43 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:44.142919 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-018ad672-5b94-4a6b-b614-5b9f625d35e9 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:44.150363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-018ad672-5b94-4a6b-b614-5b9f625d35e9 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1471 microversion: 2.1 time: 0.173136 Jun 20 07:08:44.150956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 119/237] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:43 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:44.716705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4a152fc0-c24e-4935-ba7d-a76367ca341e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:44.716705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4a152fc0-c24e-4935-ba7d-a76367ca341e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:44.723871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a152fc0-c24e-4935-ba7d-a76367ca341e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:44.724604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a152fc0-c24e-4935-ba7d-a76367ca341e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:44.725645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a152fc0-c24e-4935-ba7d-a76367ca341e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:44.726198 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a152fc0-c24e-4935-ba7d-a76367ca341e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:44.795539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4a152fc0-c24e-4935-ba7d-a76367ca341e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:44.802998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4a152fc0-c24e-4935-ba7d-a76367ca341e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1212 microversion: 2.1 time: 0.092083 Jun 20 07:08:44.803558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 119/238] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:44 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:45.022187 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b962142-4055-4fd6-8c25-18ed6d6ba755 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:45.022718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b962142-4055-4fd6-8c25-18ed6d6ba755 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:45.028789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b962142-4055-4fd6-8c25-18ed6d6ba755 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:45.029749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b962142-4055-4fd6-8c25-18ed6d6ba755 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:45.030506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b962142-4055-4fd6-8c25-18ed6d6ba755 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:45.030944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b962142-4055-4fd6-8c25-18ed6d6ba755 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:45.160910 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b962142-4055-4fd6-8c25-18ed6d6ba755 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:45.166520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-75034eb4-9a59-4ca5-9357-873e7f1d8a16 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:45.167129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-75034eb4-9a59-4ca5-9357-873e7f1d8a16 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:45.168391 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b962142-4055-4fd6-8c25-18ed6d6ba755 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.150145 Jun 20 07:08:45.169114 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 120/239] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:45 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:45.173807 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75034eb4-9a59-4ca5-9357-873e7f1d8a16 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:45.174252 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75034eb4-9a59-4ca5-9357-873e7f1d8a16 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:45.175011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75034eb4-9a59-4ca5-9357-873e7f1d8a16 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:45.175447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75034eb4-9a59-4ca5-9357-873e7f1d8a16 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:45.179553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:45.301433 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-75034eb4-9a59-4ca5-9357-873e7f1d8a16 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:45.308802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-75034eb4-9a59-4ca5-9357-873e7f1d8a16 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1471 microversion: 2.1 time: 0.146039 Jun 20 07:08:45.309363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 120/240] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:45 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:45.820243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dfe78810-ad83-44cb-a0e8-1eec462ff98d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:45.820863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dfe78810-ad83-44cb-a0e8-1eec462ff98d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:45.826828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfe78810-ad83-44cb-a0e8-1eec462ff98d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:45.827275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfe78810-ad83-44cb-a0e8-1eec462ff98d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:45.828037 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfe78810-ad83-44cb-a0e8-1eec462ff98d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:45.828499 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfe78810-ad83-44cb-a0e8-1eec462ff98d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:45.888194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dfe78810-ad83-44cb-a0e8-1eec462ff98d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:45.895716 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dfe78810-ad83-44cb-a0e8-1eec462ff98d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1212 microversion: 2.1 time: 0.079326 Jun 20 07:08:45.896304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 121/241] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:45 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:46.185591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c3c85b16-e7f5-45a7-96ae-0668197c7e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:46.186199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c3c85b16-e7f5-45a7-96ae-0668197c7e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:46.193504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3c85b16-e7f5-45a7-96ae-0668197c7e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:46.193950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3c85b16-e7f5-45a7-96ae-0668197c7e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:46.194705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3c85b16-e7f5-45a7-96ae-0668197c7e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:46.195137 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3c85b16-e7f5-45a7-96ae-0668197c7e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:46.325265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c3c85b16-e7f5-45a7-96ae-0668197c7e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:46.326481 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7836a350-0264-457f-b82a-7e12d8036c73 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:46.327179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7836a350-0264-457f-b82a-7e12d8036c73 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:46.333229 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7836a350-0264-457f-b82a-7e12d8036c73 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:46.333363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c3c85b16-e7f5-45a7-96ae-0668197c7e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.151542 Jun 20 07:08:46.333802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7836a350-0264-457f-b82a-7e12d8036c73 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:46.333936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 121/242] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:46 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:46.334646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7836a350-0264-457f-b82a-7e12d8036c73 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:46.335148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7836a350-0264-457f-b82a-7e12d8036c73 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:46.458532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7836a350-0264-457f-b82a-7e12d8036c73 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:46.466455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7836a350-0264-457f-b82a-7e12d8036c73 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1471 microversion: 2.1 time: 0.144220 Jun 20 07:08:46.467025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 122/243] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:46 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:46.912755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7adaf803-69a7-4252-9339-28b118ca1664 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:46.913368 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7adaf803-69a7-4252-9339-28b118ca1664 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:46.919877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7adaf803-69a7-4252-9339-28b118ca1664 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:46.920354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7adaf803-69a7-4252-9339-28b118ca1664 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:46.921109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7adaf803-69a7-4252-9339-28b118ca1664 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:46.921540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7adaf803-69a7-4252-9339-28b118ca1664 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:47.113577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7adaf803-69a7-4252-9339-28b118ca1664 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:47.120862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7adaf803-69a7-4252-9339-28b118ca1664 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1212 microversion: 2.1 time: 0.211894 Jun 20 07:08:47.121419 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 122/244] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:46 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1212 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:47.350135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-25245578-0e6e-4d7e-9c76-b35df0226229 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:47.350744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-25245578-0e6e-4d7e-9c76-b35df0226229 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:47.356772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25245578-0e6e-4d7e-9c76-b35df0226229 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:47.357213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25245578-0e6e-4d7e-9c76-b35df0226229 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:47.357954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25245578-0e6e-4d7e-9c76-b35df0226229 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:47.358380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25245578-0e6e-4d7e-9c76-b35df0226229 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:47.484462 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e2293689-49f9-4b41-9df1-4e40e8e596ec tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:47.485084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e2293689-49f9-4b41-9df1-4e40e8e596ec tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:47.492390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2293689-49f9-4b41-9df1-4e40e8e596ec tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:47.492837 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2293689-49f9-4b41-9df1-4e40e8e596ec tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:47.493616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2293689-49f9-4b41-9df1-4e40e8e596ec tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:47.494047 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2293689-49f9-4b41-9df1-4e40e8e596ec tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:47.762823 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-25245578-0e6e-4d7e-9c76-b35df0226229 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:47.770580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e2293689-49f9-4b41-9df1-4e40e8e596ec tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:47.771066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-25245578-0e6e-4d7e-9c76-b35df0226229 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.424766 Jun 20 07:08:47.771647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 123/245] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:47 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:47.776208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4185daa3-5cd6-4521-b6f6-f48b987c9438 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:47.776623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4185daa3-5cd6-4521-b6f6-f48b987c9438 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:47.778488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e2293689-49f9-4b41-9df1-4e40e8e596ec tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1471 microversion: 2.1 time: 0.299498 Jun 20 07:08:47.781240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 123/246] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:47 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1471 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:47.783065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4185daa3-5cd6-4521-b6f6-f48b987c9438 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:47.783498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4185daa3-5cd6-4521-b6f6-f48b987c9438 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:47.784296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4185daa3-5cd6-4521-b6f6-f48b987c9438 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:47.784734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4185daa3-5cd6-4521-b6f6-f48b987c9438 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:47.807084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4185daa3-5cd6-4521-b6f6-f48b987c9438 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/ips" status: 200 len: 149 microversion: 2.1 time: 0.034433 Jun 20 07:08:47.807643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 124/247] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 07:08:47 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/ips => generated 149 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:08:48.137329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d02fb9b6-a496-4a6a-b9fa-ee4f3e0017bd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:48.137947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d02fb9b6-a496-4a6a-b9fa-ee4f3e0017bd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:48.144817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d02fb9b6-a496-4a6a-b9fa-ee4f3e0017bd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:48.145265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d02fb9b6-a496-4a6a-b9fa-ee4f3e0017bd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:48.146036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d02fb9b6-a496-4a6a-b9fa-ee4f3e0017bd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:48.146470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d02fb9b6-a496-4a6a-b9fa-ee4f3e0017bd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:48.209639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d02fb9b6-a496-4a6a-b9fa-ee4f3e0017bd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:48.217566 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d02fb9b6-a496-4a6a-b9fa-ee4f3e0017bd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1268 microversion: 2.1 time: 0.084035 Jun 20 07:08:48.218154 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 124/248] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:48 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1268 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:48.788465 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fc852361-8a59-4e5c-98fe-dede45301b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:48.789073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fc852361-8a59-4e5c-98fe-dede45301b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:48.795041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2cd66661-05cf-46e9-b7e9-2b82775590d8 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:48.795597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc852361-8a59-4e5c-98fe-dede45301b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:48.795737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2cd66661-05cf-46e9-b7e9-2b82775590d8 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:48.796035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc852361-8a59-4e5c-98fe-dede45301b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:48.796810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc852361-8a59-4e5c-98fe-dede45301b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:48.797241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc852361-8a59-4e5c-98fe-dede45301b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:48.802491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2cd66661-05cf-46e9-b7e9-2b82775590d8 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:48.802943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2cd66661-05cf-46e9-b7e9-2b82775590d8 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:48.803709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2cd66661-05cf-46e9-b7e9-2b82775590d8 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:48.804172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2cd66661-05cf-46e9-b7e9-2b82775590d8 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:48.988939 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fc852361-8a59-4e5c-98fe-dede45301b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:48.994536 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2cd66661-05cf-46e9-b7e9-2b82775590d8 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:49.000801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fc852361-8a59-4e5c-98fe-dede45301b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.216079 Jun 20 07:08:49.002385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 125/249] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:48 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:49.019818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2cd66661-05cf-46e9-b7e9-2b82775590d8 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1471 microversion: 2.1 time: 0.229084 Jun 20 07:08:49.030529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 125/250] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:48 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:49.229841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-352c0f44-e816-4eaa-81ae-596f5181cdb3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e16eaeed-7bc9-4197-8190-4863c7c5c28b"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:49.231191 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-352c0f44-e816-4eaa-81ae-596f5181cdb3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:49.240042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4b979a3a-8d0d-4efb-aa85-47d513ef5160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:49.241343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-352c0f44-e816-4eaa-81ae-596f5181cdb3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:49.242121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-352c0f44-e816-4eaa-81ae-596f5181cdb3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:49.243781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-352c0f44-e816-4eaa-81ae-596f5181cdb3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:49.244461 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-352c0f44-e816-4eaa-81ae-596f5181cdb3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:49.245991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4b979a3a-8d0d-4efb-aa85-47d513ef5160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:49.258400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b979a3a-8d0d-4efb-aa85-47d513ef5160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:49.258852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b979a3a-8d0d-4efb-aa85-47d513ef5160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:49.260525 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b979a3a-8d0d-4efb-aa85-47d513ef5160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:49.261181 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b979a3a-8d0d-4efb-aa85-47d513ef5160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:49.390738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4b979a3a-8d0d-4efb-aa85-47d513ef5160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:49.402637 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4b979a3a-8d0d-4efb-aa85-47d513ef5160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1286 microversion: 2.1 time: 0.171552 Jun 20 07:08:49.404455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 126/251] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:49 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1286 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:49.635595 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-d688dd76-774c-454b-a30b-84cb8c47d0f5 req-c11e3021-f162-47a6-bb59-63c8fe874271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56f8812-496d-4fb7-a2da-ac6cb57456a5", "name": "network-vif-deleted", "tag": "ae9eae3d-d89d-4d67-b352-56d581b40d34"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:49.646388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d688dd76-774c-454b-a30b-84cb8c47d0f5 req-c11e3021-f162-47a6-bb59-63c8fe874271 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:49.647050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d688dd76-774c-454b-a30b-84cb8c47d0f5 req-c11e3021-f162-47a6-bb59-63c8fe874271 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:49.663562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-d688dd76-774c-454b-a30b-84cb8c47d0f5 req-c11e3021-f162-47a6-bb59-63c8fe874271 service nova] Creating event network-vif-deleted:ae9eae3d-d89d-4d67-b352-56d581b40d34 for instance c56f8812-496d-4fb7-a2da-ac6cb57456a5 on hv-cinder-77819 Jun 20 07:08:49.669987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-d688dd76-774c-454b-a30b-84cb8c47d0f5 req-c11e3021-f162-47a6-bb59-63c8fe874271 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037586 Jun 20 07:08:49.673410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 127/252] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:08:50.019310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f5a5573a-402d-4303-8454-14dbedc217e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:50.020004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f5a5573a-402d-4303-8454-14dbedc217e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:50.026142 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5a5573a-402d-4303-8454-14dbedc217e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:50.026588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5a5573a-402d-4303-8454-14dbedc217e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:50.027353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5a5573a-402d-4303-8454-14dbedc217e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:50.027790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5a5573a-402d-4303-8454-14dbedc217e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:50.210717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f5a5573a-402d-4303-8454-14dbedc217e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:50.219424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f5a5573a-402d-4303-8454-14dbedc217e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1522 microversion: 2.1 time: 0.205001 Jun 20 07:08:50.220169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 128/253] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:50 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:50.224700 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c991e802-5fd1-4be7-82cc-151eb24e1d08 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:50.225434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c991e802-5fd1-4be7-82cc-151eb24e1d08 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:50.231430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c991e802-5fd1-4be7-82cc-151eb24e1d08 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:50.232492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c991e802-5fd1-4be7-82cc-151eb24e1d08 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:50.233445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c991e802-5fd1-4be7-82cc-151eb24e1d08 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:50.233885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c991e802-5fd1-4be7-82cc-151eb24e1d08 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:50.264040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c991e802-5fd1-4be7-82cc-151eb24e1d08 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:50.264524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c991e802-5fd1-4be7-82cc-151eb24e1d08 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:50.265212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-c991e802-5fd1-4be7-82cc-151eb24e1d08 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lazy-loading 'fault' on Instance uuid c56f8812-496d-4fb7-a2da-ac6cb57456a5 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:08:50.329961 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c991e802-5fd1-4be7-82cc-151eb24e1d08 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02ed62c23443ab9f968a71c2c674bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a5d413451c4fe79fb8a521ddf29326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:50.338469 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c991e802-5fd1-4be7-82cc-151eb24e1d08 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 200 len: 1305 microversion: 2.1 time: 0.117010 Jun 20 07:08:50.339215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 129/254] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:50 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 1305 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:50.421983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-352c0f44-e816-4eaa-81ae-596f5181cdb3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "POST /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.195932 Jun 20 07:08:50.422572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-93b38930-a632-4274-93e1-ab613246b704 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:50.422810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 126/255] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 07:08:49 2022] POST /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/os-volume_attachments => generated 194 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:08:50.423785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-93b38930-a632-4274-93e1-ab613246b704 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:50.430648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-93b38930-a632-4274-93e1-ab613246b704 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:50.431367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-93b38930-a632-4274-93e1-ab613246b704 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:50.432523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-93b38930-a632-4274-93e1-ab613246b704 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:50.433785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-93b38930-a632-4274-93e1-ab613246b704 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:50.650812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-93b38930-a632-4274-93e1-ab613246b704 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:50.660617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-93b38930-a632-4274-93e1-ab613246b704 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1316 microversion: 2.1 time: 0.243693 Jun 20 07:08:50.661485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 130/256] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:50 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:50.946980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-b4177942-2b1e-4166-a99d-8754f1cb2d98 req-30b270d8-7780-48dd-9da8-3c6474c083c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8beaf201-621c-45d2-beb4-4a93cae72cce", "tag": "1d338244-3c45-4515-9a94-733bf4910333"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:50.958218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-b4177942-2b1e-4166-a99d-8754f1cb2d98 req-30b270d8-7780-48dd-9da8-3c6474c083c9 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:50.958887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-b4177942-2b1e-4166-a99d-8754f1cb2d98 req-30b270d8-7780-48dd-9da8-3c6474c083c9 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:50.971325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-b4177942-2b1e-4166-a99d-8754f1cb2d98 req-30b270d8-7780-48dd-9da8-3c6474c083c9 service nova] Creating event network-changed:1d338244-3c45-4515-9a94-733bf4910333 for instance 8beaf201-621c-45d2-beb4-4a93cae72cce on hv-cinder-77819 Jun 20 07:08:50.976043 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-b4177942-2b1e-4166-a99d-8754f1cb2d98 req-30b270d8-7780-48dd-9da8-3c6474c083c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033843 Jun 20 07:08:50.976916 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 127/257] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:08:51.236871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8f95b09f-7e10-46e4-9218-daf0b48ae860 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:51.237478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8f95b09f-7e10-46e4-9218-daf0b48ae860 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:51.244593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f95b09f-7e10-46e4-9218-daf0b48ae860 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:51.245036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f95b09f-7e10-46e4-9218-daf0b48ae860 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:51.245805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f95b09f-7e10-46e4-9218-daf0b48ae860 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:51.246232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f95b09f-7e10-46e4-9218-daf0b48ae860 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:51.357390 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-deafaa84-ff14-47fb-9d99-deb8d7583958 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:51.358321 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-deafaa84-ff14-47fb-9d99-deb8d7583958 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] [instance: c56f8812-496d-4fb7-a2da-ac6cb57456a5] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:51.364726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-deafaa84-ff14-47fb-9d99-deb8d7583958 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:51.365224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-deafaa84-ff14-47fb-9d99-deb8d7583958 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:51.365978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-deafaa84-ff14-47fb-9d99-deb8d7583958 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:51.366424 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-deafaa84-ff14-47fb-9d99-deb8d7583958 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:51.380918 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-deafaa84-ff14-47fb-9d99-deb8d7583958 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] HTTP exception thrown: Instance c56f8812-496d-4fb7-a2da-ac6cb57456a5 could not be found. Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-deafaa84-ff14-47fb-9d99-deb8d7583958 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Request method failure captured: Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 HTTP/1.1 Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisBzmFetjd-nC9SIqvDlX4z79SNT_AyLE2UQOa9xFB-oIIMjBSp6buCSJxCEU2Jf72Uva6-980clriFWLRle4Kn-2MHIZq0nh93kpxPwbE23MQyahIL4rNEGO8CABlFvcQ1seXm239UfSi5pUQCxVzdbf3aMap7VlsFdUhMcetalXkyU Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 20a5d413451c4fe79fb8a521ddf29326 Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-1105928984 Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:08:51.382557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:08:51.384180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20a5d413451c4fe79fb8a521ddf29326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20a5d413451c4fe79fb8a521ddf29326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20a5d413451c4fe79fb8a521ddf29326"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20a5d413451c4fe79fb8a521ddf29326"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:08:51.384180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-1105928984 Jun 20 07:08:51.384180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 20a5d413451c4fe79fb8a521ddf29326 Jun 20 07:08:51.384180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-1105928984 Jun 20 07:08:51.384180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-1105928984-project Jun 20 07:08:51.384180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:08:51.384180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:08:51.384180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: fc02ed62c23443ab9f968a71c2c674bf Jun 20 07:08:51.384180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-1105928984-project Jun 20 07:08:51.384180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:08:51.384180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance c56f8812-496d-4fb7-a2da-ac6cb57456a5 could not be found. Jun 20 07:08:51.384180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': 'c56f8812-496d-4fb7-a2da-ac6cb57456a5'} Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56f8812-496d-4fb7-a2da-ac6cb57456a5 could not be found. Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:08:51.385033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56f8812-496d-4fb7-a2da-ac6cb57456a5 could not be found. Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56f8812-496d-4fb7-a2da-ac6cb57456a5 could not be found. Jun 20 07:08:51.387302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:08:51.388955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-deafaa84-ff14-47fb-9d99-deb8d7583958 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] Returning 404 to user: Instance c56f8812-496d-4fb7-a2da-ac6cb57456a5 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:08:51.388955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-deafaa84-ff14-47fb-9d99-deb8d7583958 tempest-VolumesNegativeTest-1105928984 tempest-VolumesNegativeTest-1105928984-project] 10.222.0.23 "GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5" status: 404 len: 111 microversion: 2.1 time: 0.031731 Jun 20 07:08:51.388955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 128/258] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:51 2022] GET /compute/v2.1/servers/c56f8812-496d-4fb7-a2da-ac6cb57456a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 07:08:51.456594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8f95b09f-7e10-46e4-9218-daf0b48ae860 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:51.465013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8f95b09f-7e10-46e4-9218-daf0b48ae860 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1502 microversion: 2.1 time: 0.231970 Jun 20 07:08:51.465591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 131/259] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:51 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:51.483288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8132f4f2-8d5f-4561-8e3e-ae2a8a788415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:51.483914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8132f4f2-8d5f-4561-8e3e-ae2a8a788415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:51.490422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8132f4f2-8d5f-4561-8e3e-ae2a8a788415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:51.490948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8132f4f2-8d5f-4561-8e3e-ae2a8a788415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:51.491869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8132f4f2-8d5f-4561-8e3e-ae2a8a788415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:51.492546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8132f4f2-8d5f-4561-8e3e-ae2a8a788415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:51.678027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4a1275ca-2460-4b42-aed4-c57c7d26e4aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:51.678623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4a1275ca-2460-4b42-aed4-c57c7d26e4aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:51.685178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a1275ca-2460-4b42-aed4-c57c7d26e4aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:51.685492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a1275ca-2460-4b42-aed4-c57c7d26e4aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:51.686264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a1275ca-2460-4b42-aed4-c57c7d26e4aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:51.686828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a1275ca-2460-4b42-aed4-c57c7d26e4aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:51.862950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8132f4f2-8d5f-4561-8e3e-ae2a8a788415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:51.872781 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4a1275ca-2460-4b42-aed4-c57c7d26e4aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:51.875550 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8132f4f2-8d5f-4561-8e3e-ae2a8a788415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1517 microversion: 2.1 time: 0.396322 Jun 20 07:08:51.880965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4a1275ca-2460-4b42-aed4-c57c7d26e4aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1316 microversion: 2.1 time: 0.206953 Jun 20 07:08:51.881722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 129/260] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:51 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1517 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:51.881975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 132/261] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:51 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:52.898327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a78f6deb-ee28-41d3-ab9d-5371a9c62aea tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:52.898950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a78f6deb-ee28-41d3-ab9d-5371a9c62aea tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:52.902388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:52.905141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=8 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:52.910525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a78f6deb-ee28-41d3-ab9d-5371a9c62aea tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:52.910977 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a78f6deb-ee28-41d3-ab9d-5371a9c62aea tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:52.911748 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a78f6deb-ee28-41d3-ab9d-5371a9c62aea tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:52.912213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a78f6deb-ee28-41d3-ab9d-5371a9c62aea tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:53.112385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a78f6deb-ee28-41d3-ab9d-5371a9c62aea tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:53.120232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a78f6deb-ee28-41d3-ab9d-5371a9c62aea tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1316 microversion: 2.1 time: 0.226367 Jun 20 07:08:53.120800 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 130/262] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:52 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:53.259262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cb4e96ca-ce01-4341-a926-115a572641c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:53.261601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cb4e96ca-ce01-4341-a926-115a572641c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:53.272308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb4e96ca-ce01-4341-a926-115a572641c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:53.273143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb4e96ca-ce01-4341-a926-115a572641c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:53.274223 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb4e96ca-ce01-4341-a926-115a572641c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:53.274971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb4e96ca-ce01-4341-a926-115a572641c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:53.307990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-cb4e96ca-ce01-4341-a926-115a572641c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'flavor' on Instance uuid 63d6b982-e069-44bd-8110-df44d83d451c {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:08:53.461101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cb4e96ca-ce01-4341-a926-115a572641c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "POST /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c/action" status: 200 len: 32 microversion: 2.1 time: 0.205455 Jun 20 07:08:53.477267 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-481eee44-19b0-4079-99c3-94ee394daf99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:53.478257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-481eee44-19b0-4079-99c3-94ee394daf99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:53.482317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 133/263] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:08:53 2022] POST /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 07:08:53.486262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-481eee44-19b0-4079-99c3-94ee394daf99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:53.488005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-481eee44-19b0-4079-99c3-94ee394daf99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:53.489143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-481eee44-19b0-4079-99c3-94ee394daf99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:53.490879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-481eee44-19b0-4079-99c3-94ee394daf99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:53.769548 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-481eee44-19b0-4079-99c3-94ee394daf99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:53.782016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-481eee44-19b0-4079-99c3-94ee394daf99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.308434 Jun 20 07:08:53.782016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 131/264] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:53 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:54.138617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-79904eda-0cc2-4799-8477-76772f4abec8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:54.139503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-79904eda-0cc2-4799-8477-76772f4abec8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:54.143069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=92 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:54.147446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79904eda-0cc2-4799-8477-76772f4abec8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:54.147893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79904eda-0cc2-4799-8477-76772f4abec8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:54.149005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79904eda-0cc2-4799-8477-76772f4abec8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:54.149444 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79904eda-0cc2-4799-8477-76772f4abec8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:54.291474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-79904eda-0cc2-4799-8477-76772f4abec8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:54.299879 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-79904eda-0cc2-4799-8477-76772f4abec8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1316 microversion: 2.1 time: 0.166687 Jun 20 07:08:54.300479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 134/265] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:54 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:54.798151 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3dea6f75-9c29-4aea-8711-7172fd867d02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:54.798765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3dea6f75-9c29-4aea-8711-7172fd867d02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:54.805246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3dea6f75-9c29-4aea-8711-7172fd867d02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:54.805698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3dea6f75-9c29-4aea-8711-7172fd867d02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:54.806701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3dea6f75-9c29-4aea-8711-7172fd867d02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:54.807142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3dea6f75-9c29-4aea-8711-7172fd867d02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:54.939591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3dea6f75-9c29-4aea-8711-7172fd867d02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:54.947041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3dea6f75-9c29-4aea-8711-7172fd867d02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.153316 Jun 20 07:08:54.947606 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 132/266] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:54 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:55.317134 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e9a05444-b4c9-4f71-839a-05a0c8391736 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:55.317748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e9a05444-b4c9-4f71-839a-05a0c8391736 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:55.324478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9a05444-b4c9-4f71-839a-05a0c8391736 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:55.324925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9a05444-b4c9-4f71-839a-05a0c8391736 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:55.326333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9a05444-b4c9-4f71-839a-05a0c8391736 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:55.326771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9a05444-b4c9-4f71-839a-05a0c8391736 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:55.330758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:55.458121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e9a05444-b4c9-4f71-839a-05a0c8391736 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:55.465397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e9a05444-b4c9-4f71-839a-05a0c8391736 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1316 microversion: 2.1 time: 0.152240 Jun 20 07:08:55.465943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 135/267] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:55 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:08:55.964598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3c0f6702-26e0-4f55-b29e-074b8d781072 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:55.965212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3c0f6702-26e0-4f55-b29e-074b8d781072 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:55.971591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c0f6702-26e0-4f55-b29e-074b8d781072 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:55.972041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c0f6702-26e0-4f55-b29e-074b8d781072 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:55.972839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c0f6702-26e0-4f55-b29e-074b8d781072 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:55.973276 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c0f6702-26e0-4f55-b29e-074b8d781072 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:56.099091 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c0f6702-26e0-4f55-b29e-074b8d781072 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:56.106415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3c0f6702-26e0-4f55-b29e-074b8d781072 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.145697 Jun 20 07:08:56.107630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 133/268] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:55 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:56.482982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5dd62a9b-4382-4461-862b-aafb9332a0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:56.483593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5dd62a9b-4382-4461-862b-aafb9332a0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:56.490036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5dd62a9b-4382-4461-862b-aafb9332a0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:56.490553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5dd62a9b-4382-4461-862b-aafb9332a0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:56.491319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5dd62a9b-4382-4461-862b-aafb9332a0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:56.491752 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5dd62a9b-4382-4461-862b-aafb9332a0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:56.617694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5dd62a9b-4382-4461-862b-aafb9332a0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:56.626445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5dd62a9b-4382-4461-862b-aafb9332a0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1316 microversion: 2.1 time: 0.147748 Jun 20 07:08:56.627016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 136/269] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:56 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1316 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:57.123819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5962f358-09e7-4b24-8016-6a6f4042ecdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:57.124476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5962f358-09e7-4b24-8016-6a6f4042ecdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:57.130927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5962f358-09e7-4b24-8016-6a6f4042ecdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:57.131380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5962f358-09e7-4b24-8016-6a6f4042ecdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:57.132170 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5962f358-09e7-4b24-8016-6a6f4042ecdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:57.132612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5962f358-09e7-4b24-8016-6a6f4042ecdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:57.136562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:57.271173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5962f358-09e7-4b24-8016-6a6f4042ecdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:57.278663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5962f358-09e7-4b24-8016-6a6f4042ecdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.159077 Jun 20 07:08:57.279238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 134/270] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:57 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:57.643854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a2648e0a-beac-45a6-8600-604fe06515d3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:57.644501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a2648e0a-beac-45a6-8600-604fe06515d3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:57.650952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2648e0a-beac-45a6-8600-604fe06515d3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:57.651401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2648e0a-beac-45a6-8600-604fe06515d3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:57.652180 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2648e0a-beac-45a6-8600-604fe06515d3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:57.652616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2648e0a-beac-45a6-8600-604fe06515d3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:57.780798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a2648e0a-beac-45a6-8600-604fe06515d3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:57.788008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a2648e0a-beac-45a6-8600-604fe06515d3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1316 microversion: 2.1 time: 0.148661 Jun 20 07:08:57.788596 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 137/271] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:57 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:58.091915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4c74dd9c-bbc3-4f3a-9d49-9cc2c58f51df tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Action: 'create', calling method: .version_select at 0x7ffa1fdb1670>, body: {"keypair": {"name": "tempest-keypair-1487374024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQJ+oNAiVC3BnFPULWux0GBKJFK6jSz6XgQ+caGgpnHN3GoxdNKy7+BBi1NUWViGRPuE4yKM+L3xN+OCXj4oxiGEGRKP8fhdrRmPY9zKTJsElgHQTTUaBXrD7dkc8i5ZA=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:58.095865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:08:58.108353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-4c74dd9c-bbc3-4f3a-9d49-9cc2c58f51df tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:08:58.112039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-4c74dd9c-bbc3-4f3a-9d49-9cc2c58f51df tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for user f66183ca9d884f43befaace02099c7f2 and project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:08:58.132729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4c74dd9c-bbc3-4f3a-9d49-9cc2c58f51df tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045262 Jun 20 07:08:58.133297 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 135/272] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 07:08:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:08:58.297535 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7ca1116b-4c18-447d-a14d-0e5fd8585165 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:58.298296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7ca1116b-4c18-447d-a14d-0e5fd8585165 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:58.305168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ca1116b-4c18-447d-a14d-0e5fd8585165 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:58.305614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ca1116b-4c18-447d-a14d-0e5fd8585165 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:58.306434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ca1116b-4c18-447d-a14d-0e5fd8585165 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:58.307363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ca1116b-4c18-447d-a14d-0e5fd8585165 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:58.482056 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7ca1116b-4c18-447d-a14d-0e5fd8585165 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:58.490360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7ca1116b-4c18-447d-a14d-0e5fd8585165 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.197914 Jun 20 07:08:58.490934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 138/273] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:58 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:58.806995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4435c5d6-6905-4296-89cc-c169c07f39d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:58.807636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4435c5d6-6905-4296-89cc-c169c07f39d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:58.814561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4435c5d6-6905-4296-89cc-c169c07f39d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:58.815094 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4435c5d6-6905-4296-89cc-c169c07f39d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:58.816156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4435c5d6-6905-4296-89cc-c169c07f39d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:58.817543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4435c5d6-6905-4296-89cc-c169c07f39d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:59.038034 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4435c5d6-6905-4296-89cc-c169c07f39d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:59.048643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4435c5d6-6905-4296-89cc-c169c07f39d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1316 microversion: 2.1 time: 0.246203 Jun 20 07:08:59.049322 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 136/274] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:58 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:08:59.296518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2520a12f-ab75-4b5c-868c-103b2cce13b3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:59.297530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2520a12f-ab75-4b5c-868c-103b2cce13b3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:59.305039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2520a12f-ab75-4b5c-868c-103b2cce13b3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:59.305660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2520a12f-ab75-4b5c-868c-103b2cce13b3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:59.306633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2520a12f-ab75-4b5c-868c-103b2cce13b3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:59.307219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2520a12f-ab75-4b5c-868c-103b2cce13b3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:59.308436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-97b016b0-eeee-44d1-9776-27df3984f317 req-a39cd94a-a0e5-4655-9b06-6bdde2b54ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8beaf201-621c-45d2-beb4-4a93cae72cce", "name": "network-vif-plugged", "status": "completed", "tag": "1d338244-3c45-4515-9a94-733bf4910333"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:08:59.323578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-97b016b0-eeee-44d1-9776-27df3984f317 req-a39cd94a-a0e5-4655-9b06-6bdde2b54ec6 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:59.324025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-97b016b0-eeee-44d1-9776-27df3984f317 req-a39cd94a-a0e5-4655-9b06-6bdde2b54ec6 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:59.337527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2520a12f-ab75-4b5c-868c-103b2cce13b3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/ips" status: 200 len: 145 microversion: 2.1 time: 0.046625 Jun 20 07:08:59.338805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 139/275] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 07:08:59 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:08:59.344218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-97b016b0-eeee-44d1-9776-27df3984f317 req-a39cd94a-a0e5-4655-9b06-6bdde2b54ec6 service nova] Creating event network-vif-plugged:1d338244-3c45-4515-9a94-733bf4910333 for instance 8beaf201-621c-45d2-beb4-4a93cae72cce on hv-cinder-77819 Jun 20 07:08:59.348102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-97b016b0-eeee-44d1-9776-27df3984f317 req-a39cd94a-a0e5-4655-9b06-6bdde2b54ec6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047431 Jun 20 07:08:59.348831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 137/276] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:08:59.509777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-276c8657-cbd8-43e0-8418-f94c197ef9cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:08:59.510492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-276c8657-cbd8-43e0-8418-f94c197ef9cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:08:59.519431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-276c8657-cbd8-43e0-8418-f94c197ef9cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:59.520470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-276c8657-cbd8-43e0-8418-f94c197ef9cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:59.521551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-276c8657-cbd8-43e0-8418-f94c197ef9cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:08:59.522341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-276c8657-cbd8-43e0-8418-f94c197ef9cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:08:59.925957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-276c8657-cbd8-43e0-8418-f94c197ef9cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:08:59.933409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-276c8657-cbd8-43e0-8418-f94c197ef9cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.428635 Jun 20 07:08:59.933972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 140/277] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:08:59 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:00.006187 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-103982036", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "882e9092-6971-4957-9705-059b858de12f"}], "security_groups": [{"name": "tempest-securitygroup--1308454882"}], "key_name": "tempest-keypair-1487374024", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:00.066663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-96eb868a-08f1-4ebe-8f59-593d353fcd57 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:00.067763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-96eb868a-08f1-4ebe-8f59-593d353fcd57 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:00.076215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96eb868a-08f1-4ebe-8f59-593d353fcd57 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:00.076834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96eb868a-08f1-4ebe-8f59-593d353fcd57 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:00.078171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96eb868a-08f1-4ebe-8f59-593d353fcd57 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:00.079029 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96eb868a-08f1-4ebe-8f59-593d353fcd57 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:00.126541 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] validate_networks() for [('882e9092-6971-4957-9705-059b858de12f', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:09:00.554430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-96eb868a-08f1-4ebe-8f59-593d353fcd57 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:00.563749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-96eb868a-08f1-4ebe-8f59-593d353fcd57 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1316 microversion: 2.1 time: 0.501583 Jun 20 07:09:00.564361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 141/278] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:00 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:00.854535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:09:00.854903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:09:00.855220 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:09:00.855635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:09:00.856046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:09:00.867517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:00.868007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:00.869653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:00.870089 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:00.898353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:09:00.904759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for user f66183ca9d884f43befaace02099c7f2 and project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:09:00.920205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:09:00.923036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:09:00.952434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0cf63475-b677-4b87-b4af-ab3c0ff288e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:00.953203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0cf63475-b677-4b87-b4af-ab3c0ff288e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:00.960733 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cf63475-b677-4b87-b4af-ab3c0ff288e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:00.961432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cf63475-b677-4b87-b4af-ab3c0ff288e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:00.963699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cf63475-b677-4b87-b4af-ab3c0ff288e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:00.964677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cf63475-b677-4b87-b4af-ab3c0ff288e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:00.987908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-02d6fd2c-d26a-48fc-b360-c70b25077856 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.986217 Jun 20 07:09:00.989268 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 138/279] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:08:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:09:01.001853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-12bc4ac7-71a1-4c31-877c-6dbed100faa7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:01.006645 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-12bc4ac7-71a1-4c31-877c-6dbed100faa7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:01.179324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-12bc4ac7-71a1-4c31-877c-6dbed100faa7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:01.194540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-12bc4ac7-71a1-4c31-877c-6dbed100faa7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1241 microversion: 2.1 time: 0.199319 Jun 20 07:09:01.201864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 139/280] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:00 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1241 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:01.258048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0cf63475-b677-4b87-b4af-ab3c0ff288e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:01.273057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0cf63475-b677-4b87-b4af-ab3c0ff288e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.325842 Jun 20 07:09:01.287348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 142/281] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:00 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:01.582180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d802fa1e-c126-4b1b-84bd-c899f56ad0dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:01.582904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d802fa1e-c126-4b1b-84bd-c899f56ad0dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:01.598878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d802fa1e-c126-4b1b-84bd-c899f56ad0dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:01.601010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d802fa1e-c126-4b1b-84bd-c899f56ad0dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:01.602245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d802fa1e-c126-4b1b-84bd-c899f56ad0dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:01.605358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d802fa1e-c126-4b1b-84bd-c899f56ad0dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:01.804869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d802fa1e-c126-4b1b-84bd-c899f56ad0dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:01.814166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d802fa1e-c126-4b1b-84bd-c899f56ad0dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1316 microversion: 2.1 time: 0.236323 Jun 20 07:09:01.814826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 140/282] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:01 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:02.216503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-964bfd6a-58cd-4113-b64b-3c88b42bd0d9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:02.218064 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-964bfd6a-58cd-4113-b64b-3c88b42bd0d9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:02.227517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-964bfd6a-58cd-4113-b64b-3c88b42bd0d9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:02.228296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-964bfd6a-58cd-4113-b64b-3c88b42bd0d9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:02.231323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-964bfd6a-58cd-4113-b64b-3c88b42bd0d9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:02.232239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-964bfd6a-58cd-4113-b64b-3c88b42bd0d9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:02.300856 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7a281de7-e08e-4abf-b9cb-c3fa17ef4527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:02.301598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7a281de7-e08e-4abf-b9cb-c3fa17ef4527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:02.312426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a281de7-e08e-4abf-b9cb-c3fa17ef4527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:02.313172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a281de7-e08e-4abf-b9cb-c3fa17ef4527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:02.314131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a281de7-e08e-4abf-b9cb-c3fa17ef4527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:02.314873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a281de7-e08e-4abf-b9cb-c3fa17ef4527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:02.332327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-964bfd6a-58cd-4113-b64b-3c88b42bd0d9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:02.338992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-964bfd6a-58cd-4113-b64b-3c88b42bd0d9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1245 microversion: 2.1 time: 0.126283 Jun 20 07:09:02.339652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 143/283] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:02 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1245 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:02.460434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7a281de7-e08e-4abf-b9cb-c3fa17ef4527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:02.467956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7a281de7-e08e-4abf-b9cb-c3fa17ef4527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.180506 Jun 20 07:09:02.468544 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 141/284] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:02 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:02.831121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9181d380-fc03-4907-87d3-bb1911e0c296 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:02.831736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9181d380-fc03-4907-87d3-bb1911e0c296 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:02.838115 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9181d380-fc03-4907-87d3-bb1911e0c296 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:02.838571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9181d380-fc03-4907-87d3-bb1911e0c296 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:02.839359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9181d380-fc03-4907-87d3-bb1911e0c296 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:02.839801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9181d380-fc03-4907-87d3-bb1911e0c296 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:02.983756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9181d380-fc03-4907-87d3-bb1911e0c296 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:02.991460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9181d380-fc03-4907-87d3-bb1911e0c296 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1316 microversion: 2.1 time: 0.164320 Jun 20 07:09:03.000195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 144/285] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:02 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:03.355828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-878cfbf5-dbf5-4746-81b1-390dc39f8958 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:03.357133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-878cfbf5-dbf5-4746-81b1-390dc39f8958 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:03.364434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-878cfbf5-dbf5-4746-81b1-390dc39f8958 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:03.365055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-878cfbf5-dbf5-4746-81b1-390dc39f8958 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:03.366136 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-878cfbf5-dbf5-4746-81b1-390dc39f8958 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:03.366870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-878cfbf5-dbf5-4746-81b1-390dc39f8958 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:03.451765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-878cfbf5-dbf5-4746-81b1-390dc39f8958 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:03.462083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-878cfbf5-dbf5-4746-81b1-390dc39f8958 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1245 microversion: 2.1 time: 0.109920 Jun 20 07:09:03.462840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 142/286] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:03 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:03.486266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7ce6ece9-dd04-4832-9f08-d6c58acd17d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:03.487565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7ce6ece9-dd04-4832-9f08-d6c58acd17d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:03.498631 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ce6ece9-dd04-4832-9f08-d6c58acd17d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:03.499849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ce6ece9-dd04-4832-9f08-d6c58acd17d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:03.501532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ce6ece9-dd04-4832-9f08-d6c58acd17d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:03.502165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ce6ece9-dd04-4832-9f08-d6c58acd17d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:03.688892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7ce6ece9-dd04-4832-9f08-d6c58acd17d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:03.708236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7ce6ece9-dd04-4832-9f08-d6c58acd17d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.222198 Jun 20 07:09:03.708236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 145/287] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:03 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:04.008220 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-669056f7-d142-47cd-9e65-5f3b74663040 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:04.009208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-669056f7-d142-47cd-9e65-5f3b74663040 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:04.015863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-669056f7-d142-47cd-9e65-5f3b74663040 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:04.016446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-669056f7-d142-47cd-9e65-5f3b74663040 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:04.017572 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-669056f7-d142-47cd-9e65-5f3b74663040 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:04.018202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-669056f7-d142-47cd-9e65-5f3b74663040 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:04.209050 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-669056f7-d142-47cd-9e65-5f3b74663040 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:04.217825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-669056f7-d142-47cd-9e65-5f3b74663040 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1316 microversion: 2.1 time: 0.213352 Jun 20 07:09:04.218516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 143/288] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:04 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:04.480344 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-09b59e3e-80db-46cc-aebe-8e003dc74d7c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:04.480992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-09b59e3e-80db-46cc-aebe-8e003dc74d7c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:04.491634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09b59e3e-80db-46cc-aebe-8e003dc74d7c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:04.497303 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09b59e3e-80db-46cc-aebe-8e003dc74d7c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:04.498448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09b59e3e-80db-46cc-aebe-8e003dc74d7c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:04.499033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09b59e3e-80db-46cc-aebe-8e003dc74d7c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:04.606434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-09b59e3e-80db-46cc-aebe-8e003dc74d7c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:04.619946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-09b59e3e-80db-46cc-aebe-8e003dc74d7c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1245 microversion: 2.1 time: 0.143305 Jun 20 07:09:04.621155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 146/289] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:04 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1245 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:04.721195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-36e72290-b288-40c2-aef1-ce77e5627c43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:04.722353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-36e72290-b288-40c2-aef1-ce77e5627c43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:04.732565 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36e72290-b288-40c2-aef1-ce77e5627c43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:04.733324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36e72290-b288-40c2-aef1-ce77e5627c43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:04.734348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36e72290-b288-40c2-aef1-ce77e5627c43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:04.742637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36e72290-b288-40c2-aef1-ce77e5627c43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:05.014258 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-36e72290-b288-40c2-aef1-ce77e5627c43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:05.022888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-36e72290-b288-40c2-aef1-ce77e5627c43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.305653 Jun 20 07:09:05.023462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 144/290] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:04 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:05.238012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-667d3332-2fb6-4ef7-883d-ca8cd093928f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:05.239032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-667d3332-2fb6-4ef7-883d-ca8cd093928f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:05.247589 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-667d3332-2fb6-4ef7-883d-ca8cd093928f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:05.248227 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-667d3332-2fb6-4ef7-883d-ca8cd093928f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:05.249327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-667d3332-2fb6-4ef7-883d-ca8cd093928f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:05.249910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-667d3332-2fb6-4ef7-883d-ca8cd093928f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:05.645173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6cc98c10-9a9d-4c7f-9558-eed048496172 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:05.645756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6cc98c10-9a9d-4c7f-9558-eed048496172 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:05.660584 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cc98c10-9a9d-4c7f-9558-eed048496172 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:05.661247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cc98c10-9a9d-4c7f-9558-eed048496172 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:05.662288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cc98c10-9a9d-4c7f-9558-eed048496172 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:05.662885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cc98c10-9a9d-4c7f-9558-eed048496172 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:05.801404 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-667d3332-2fb6-4ef7-883d-ca8cd093928f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:05.806193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6cc98c10-9a9d-4c7f-9558-eed048496172 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:05.813321 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-667d3332-2fb6-4ef7-883d-ca8cd093928f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1506 microversion: 2.1 time: 0.581764 Jun 20 07:09:05.816681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6cc98c10-9a9d-4c7f-9558-eed048496172 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1299 microversion: 2.1 time: 0.183392 Jun 20 07:09:05.818726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 145/291] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:05 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:05.819169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 147/292] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:05 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1506 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:05.921993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-15052b35-9e73-4b4c-bc7d-dba6b4255d97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05455fe2-2e36-4c3a-a39a-6de007f437d1"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:05.923131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-15052b35-9e73-4b4c-bc7d-dba6b4255d97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:05.940976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15052b35-9e73-4b4c-bc7d-dba6b4255d97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:05.942671 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15052b35-9e73-4b4c-bc7d-dba6b4255d97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:05.943878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15052b35-9e73-4b4c-bc7d-dba6b4255d97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:05.944807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15052b35-9e73-4b4c-bc7d-dba6b4255d97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:06.040736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f65c13a3-0473-463c-8569-0b75f3a235aa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:06.041366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f65c13a3-0473-463c-8569-0b75f3a235aa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:06.049574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f65c13a3-0473-463c-8569-0b75f3a235aa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:06.050027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f65c13a3-0473-463c-8569-0b75f3a235aa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:06.050790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f65c13a3-0473-463c-8569-0b75f3a235aa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:06.067572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f65c13a3-0473-463c-8569-0b75f3a235aa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:06.378052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-15052b35-9e73-4b4c-bc7d-dba6b4255d97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "POST /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.460442 Jun 20 07:09:06.379431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f65c13a3-0473-463c-8569-0b75f3a235aa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:06.381339 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 146/293] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 07:09:05 2022] POST /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 194 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:06.390277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f65c13a3-0473-463c-8569-0b75f3a235aa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.353127 Jun 20 07:09:06.393171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 148/294] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:06 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:06.835393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-05c2a310-d15a-450f-94e1-34c1571a8698 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:06.836291 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-05c2a310-d15a-450f-94e1-34c1571a8698 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:06.865228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05c2a310-d15a-450f-94e1-34c1571a8698 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:06.869108 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05c2a310-d15a-450f-94e1-34c1571a8698 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:06.870020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05c2a310-d15a-450f-94e1-34c1571a8698 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:06.870906 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05c2a310-d15a-450f-94e1-34c1571a8698 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:07.193638 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-05c2a310-d15a-450f-94e1-34c1571a8698 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:07.201866 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-05c2a310-d15a-450f-94e1-34c1571a8698 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1367 microversion: 2.1 time: 0.371250 Jun 20 07:09:07.202456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 147/295] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:06 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:07.408745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e17d74e3-0000-40c1-a4c5-974051a76bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:07.409273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e17d74e3-0000-40c1-a4c5-974051a76bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:07.416407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e17d74e3-0000-40c1-a4c5-974051a76bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:07.417186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e17d74e3-0000-40c1-a4c5-974051a76bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:07.418207 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e17d74e3-0000-40c1-a4c5-974051a76bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:07.419543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e17d74e3-0000-40c1-a4c5-974051a76bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:07.690873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9618cea4-0428-409f-b760-24e4351644c3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:07.691713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9618cea4-0428-409f-b760-24e4351644c3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:07.712516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9618cea4-0428-409f-b760-24e4351644c3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:07.714585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9618cea4-0428-409f-b760-24e4351644c3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:07.718216 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9618cea4-0428-409f-b760-24e4351644c3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:07.719853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9618cea4-0428-409f-b760-24e4351644c3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:07.801810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9618cea4-0428-409f-b760-24e4351644c3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/ips" status: 200 len: 151 microversion: 2.20 time: 0.114961 Jun 20 07:09:07.802746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 148/296] 10.222.0.23 () {60 vars in 1288 bytes} [Mon Jun 20 07:09:07 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/ips => generated 151 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:09:07.974013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e17d74e3-0000-40c1-a4c5-974051a76bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:07.986165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e17d74e3-0000-40c1-a4c5-974051a76bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.580607 Jun 20 07:09:07.987186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 149/297] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:07 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:08.221552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0bf9b3aa-0a52-4c78-b274-15fdab73804b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:08.222716 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0bf9b3aa-0a52-4c78-b274-15fdab73804b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:08.233670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bf9b3aa-0a52-4c78-b274-15fdab73804b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:08.234534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bf9b3aa-0a52-4c78-b274-15fdab73804b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:08.236172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bf9b3aa-0a52-4c78-b274-15fdab73804b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:08.238871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bf9b3aa-0a52-4c78-b274-15fdab73804b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:08.697932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0bf9b3aa-0a52-4c78-b274-15fdab73804b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:08.711326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0bf9b3aa-0a52-4c78-b274-15fdab73804b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1367 microversion: 2.1 time: 0.493728 Jun 20 07:09:08.712818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 149/298] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:08 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1367 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:08.810496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-5289c7f6-733a-496c-93d5-9874feb4c553 req-9bbda90d-e8cb-47bd-99f5-fea70ef972be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53321809-7dd1-4d7b-b6b8-5a58b1e907f2", "tag": "aa136057-a2bf-4714-9bf0-13fed4a7b779"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:08.858548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-5289c7f6-733a-496c-93d5-9874feb4c553 req-9bbda90d-e8cb-47bd-99f5-fea70ef972be service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:08.861240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-5289c7f6-733a-496c-93d5-9874feb4c553 req-9bbda90d-e8cb-47bd-99f5-fea70ef972be service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:08.899772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-5289c7f6-733a-496c-93d5-9874feb4c553 req-9bbda90d-e8cb-47bd-99f5-fea70ef972be service nova] Creating event network-changed:aa136057-a2bf-4714-9bf0-13fed4a7b779 for instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 on hv-cinder-77819 Jun 20 07:09:08.915521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-5289c7f6-733a-496c-93d5-9874feb4c553 req-9bbda90d-e8cb-47bd-99f5-fea70ef972be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108893 Jun 20 07:09:08.918030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 150/299] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:09.008449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-933ccd94-de69-4467-9803-9c61c36fe11f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:09.009094 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-933ccd94-de69-4467-9803-9c61c36fe11f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:09.019200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-933ccd94-de69-4467-9803-9c61c36fe11f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:09.024415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-933ccd94-de69-4467-9803-9c61c36fe11f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:09.025887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-933ccd94-de69-4467-9803-9c61c36fe11f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:09.026639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-933ccd94-de69-4467-9803-9c61c36fe11f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:09.342807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-933ccd94-de69-4467-9803-9c61c36fe11f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:09.357163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-933ccd94-de69-4467-9803-9c61c36fe11f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.356171 Jun 20 07:09:09.359267 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 150/300] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:08 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:09.732540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-39f19df2-9d4d-440a-8114-66b30a09e129 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:09.733381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-39f19df2-9d4d-440a-8114-66b30a09e129 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:09.762911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39f19df2-9d4d-440a-8114-66b30a09e129 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:09.765446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39f19df2-9d4d-440a-8114-66b30a09e129 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:09.788571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39f19df2-9d4d-440a-8114-66b30a09e129 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:09.789131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39f19df2-9d4d-440a-8114-66b30a09e129 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:10.165212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-39f19df2-9d4d-440a-8114-66b30a09e129 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:10.178801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-39f19df2-9d4d-440a-8114-66b30a09e129 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1367 microversion: 2.1 time: 0.452955 Jun 20 07:09:10.180041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 151/301] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:09 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1367 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:10.383594 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-23e45eb1-b57e-488a-9f8d-0841c2ecf003 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:10.384918 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-23e45eb1-b57e-488a-9f8d-0841c2ecf003 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:10.413361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cf414d60-6991-48ff-a6c7-5baaf20f37c9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:10.414215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cf414d60-6991-48ff-a6c7-5baaf20f37c9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:10.420328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23e45eb1-b57e-488a-9f8d-0841c2ecf003 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:10.421227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23e45eb1-b57e-488a-9f8d-0841c2ecf003 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:10.425517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23e45eb1-b57e-488a-9f8d-0841c2ecf003 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:10.426256 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23e45eb1-b57e-488a-9f8d-0841c2ecf003 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:10.427722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf414d60-6991-48ff-a6c7-5baaf20f37c9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:10.428259 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf414d60-6991-48ff-a6c7-5baaf20f37c9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:10.429199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf414d60-6991-48ff-a6c7-5baaf20f37c9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:10.429905 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf414d60-6991-48ff-a6c7-5baaf20f37c9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:10.463333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-cf414d60-6991-48ff-a6c7-5baaf20f37c9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lazy-loading 'flavor' on Instance uuid 0e214060-f046-41a1-b243-020c88edde42 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:09:10.469790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:10.815164 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-23e45eb1-b57e-488a-9f8d-0841c2ecf003 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:10.827563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-23e45eb1-b57e-488a-9f8d-0841c2ecf003 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.456151 Jun 20 07:09:10.830975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 151/302] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:10 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:11.052084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cf414d60-6991-48ff-a6c7-5baaf20f37c9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "POST /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/action" status: 202 len: 0 microversion: 2.20 time: 0.652951 Jun 20 07:09:11.053064 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 152/303] 10.222.0.23 () {62 vars in 1318 bytes} [Mon Jun 20 07:09:10 2022] POST /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 20 07:09:11.061895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ce491f96-e99d-4129-8c4f-f6fda959b23d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:11.062600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ce491f96-e99d-4129-8c4f-f6fda959b23d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:11.074732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:11.076895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce491f96-e99d-4129-8c4f-f6fda959b23d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:11.077777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce491f96-e99d-4129-8c4f-f6fda959b23d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:11.078589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce491f96-e99d-4129-8c4f-f6fda959b23d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:11.079027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce491f96-e99d-4129-8c4f-f6fda959b23d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:11.184899 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=12 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:11.200973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-72d15073-f80c-43f3-8185-a94d3340274d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:11.202480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-72d15073-f80c-43f3-8185-a94d3340274d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:11.217245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72d15073-f80c-43f3-8185-a94d3340274d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:11.218109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72d15073-f80c-43f3-8185-a94d3340274d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:11.219105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72d15073-f80c-43f3-8185-a94d3340274d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:11.219735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72d15073-f80c-43f3-8185-a94d3340274d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:11.592199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce491f96-e99d-4129-8c4f-f6fda959b23d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:11.615719 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce491f96-e99d-4129-8c4f-f6fda959b23d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:11.619392 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce491f96-e99d-4129-8c4f-f6fda959b23d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:11.621363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ce491f96-e99d-4129-8c4f-f6fda959b23d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.563930 Jun 20 07:09:11.623365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 152/304] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:11 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:11.687664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-72d15073-f80c-43f3-8185-a94d3340274d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:11.696461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-72d15073-f80c-43f3-8185-a94d3340274d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1367 microversion: 2.1 time: 0.503954 Jun 20 07:09:11.706088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 153/305] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:11 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:11.848356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3aa0b52b-f6a3-43d3-8a4c-d17907e71d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:11.849427 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3aa0b52b-f6a3-43d3-8a4c-d17907e71d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:11.877628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3aa0b52b-f6a3-43d3-8a4c-d17907e71d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:11.878474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3aa0b52b-f6a3-43d3-8a4c-d17907e71d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:11.879507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3aa0b52b-f6a3-43d3-8a4c-d17907e71d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:11.881690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3aa0b52b-f6a3-43d3-8a4c-d17907e71d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:11.891256 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:12.369815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3aa0b52b-f6a3-43d3-8a4c-d17907e71d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:12.385420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3aa0b52b-f6a3-43d3-8a4c-d17907e71d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.541607 Jun 20 07:09:12.387698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 153/306] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:11 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:12.644461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e8cdade5-b684-41e5-8e06-7cce90d860ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:12.645255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e8cdade5-b684-41e5-8e06-7cce90d860ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:12.657191 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8cdade5-b684-41e5-8e06-7cce90d860ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:12.658089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8cdade5-b684-41e5-8e06-7cce90d860ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:12.659392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8cdade5-b684-41e5-8e06-7cce90d860ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:12.659995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8cdade5-b684-41e5-8e06-7cce90d860ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:12.726246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-21c3d024-2866-45e9-b54e-c2b63d61ba22 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:12.726878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-21c3d024-2866-45e9-b54e-c2b63d61ba22 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:12.735250 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21c3d024-2866-45e9-b54e-c2b63d61ba22 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:12.735820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21c3d024-2866-45e9-b54e-c2b63d61ba22 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:12.736648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21c3d024-2866-45e9-b54e-c2b63d61ba22 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:12.737089 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21c3d024-2866-45e9-b54e-c2b63d61ba22 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:13.194174 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e8cdade5-b684-41e5-8e06-7cce90d860ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:13.202824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e8cdade5-b684-41e5-8e06-7cce90d860ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:13.204353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e8cdade5-b684-41e5-8e06-7cce90d860ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:13.205516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e8cdade5-b684-41e5-8e06-7cce90d860ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.568121 Jun 20 07:09:13.206056 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 154/307] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:12 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:13.304301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-21c3d024-2866-45e9-b54e-c2b63d61ba22 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:13.320034 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-21c3d024-2866-45e9-b54e-c2b63d61ba22 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1367 microversion: 2.1 time: 0.601089 Jun 20 07:09:13.322703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 154/308] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:12 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1367 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:13.404415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2f75b421-366f-459f-a861-6a9be62d418f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:13.405405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2f75b421-366f-459f-a861-6a9be62d418f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:13.412929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f75b421-366f-459f-a861-6a9be62d418f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:13.413524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f75b421-366f-459f-a861-6a9be62d418f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:13.414409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f75b421-366f-459f-a861-6a9be62d418f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:13.415052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f75b421-366f-459f-a861-6a9be62d418f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:13.685099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2f75b421-366f-459f-a861-6a9be62d418f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:13.703243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2f75b421-366f-459f-a861-6a9be62d418f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.298520 Jun 20 07:09:13.704213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 155/309] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:13 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:14.229934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-32be6d9a-4b46-4b2e-8429-730a6b63fb7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:14.230697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-32be6d9a-4b46-4b2e-8429-730a6b63fb7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:14.243630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32be6d9a-4b46-4b2e-8429-730a6b63fb7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:14.247405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32be6d9a-4b46-4b2e-8429-730a6b63fb7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:14.248390 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32be6d9a-4b46-4b2e-8429-730a6b63fb7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:14.256015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32be6d9a-4b46-4b2e-8429-730a6b63fb7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:14.512234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32be6d9a-4b46-4b2e-8429-730a6b63fb7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:14.524478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1357a4b6-222e-4508-81a5-39ce63e3544f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Action: 'create', calling method: .version_select at 0x7ffa1fd87310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-278969032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEE06YmLMV5+IvuFFKtN1Pxl3LWT302TQn5MC2ooUTO+wthafk2QY6wRO26FaQQMGhLhx5TgAk2jrDer7ONHYXqc7lyHssqOHQHk7cMARUtlKD98kXfZnR94TRBrHY2dTw=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:14.536609 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32be6d9a-4b46-4b2e-8429-730a6b63fb7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:14.540407 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32be6d9a-4b46-4b2e-8429-730a6b63fb7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:14.545148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-32be6d9a-4b46-4b2e-8429-730a6b63fb7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.324818 Jun 20 07:09:14.556343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 155/310] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:14 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:14.561585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e352da7e-ed9e-4c02-a714-85f50a808a01 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:14.561926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-1357a4b6-222e-4508-81a5-39ce63e3544f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Getting quotas for project f5a98ee7cefc4c759c846f6cacb646a8. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:09:14.562252 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e352da7e-ed9e-4c02-a714-85f50a808a01 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:14.571778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-1357a4b6-222e-4508-81a5-39ce63e3544f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Getting quotas for user 1404717904a14000a11f06c6c8291105 and project f5a98ee7cefc4c759c846f6cacb646a8. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:09:14.592122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e352da7e-ed9e-4c02-a714-85f50a808a01 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:14.593061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e352da7e-ed9e-4c02-a714-85f50a808a01 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:14.594132 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e352da7e-ed9e-4c02-a714-85f50a808a01 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:14.594723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e352da7e-ed9e-4c02-a714-85f50a808a01 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:14.630085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1357a4b6-222e-4508-81a5-39ce63e3544f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.404754 Jun 20 07:09:14.636799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 156/311] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 07:09:14 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:14.721406 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3e53d5f9-77d0-47c0-8e3f-d7efa858874c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:14.722684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3e53d5f9-77d0-47c0-8e3f-d7efa858874c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:14.734532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e53d5f9-77d0-47c0-8e3f-d7efa858874c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:14.735387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e53d5f9-77d0-47c0-8e3f-d7efa858874c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:14.737796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e53d5f9-77d0-47c0-8e3f-d7efa858874c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:14.739208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e53d5f9-77d0-47c0-8e3f-d7efa858874c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:14.882783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e352da7e-ed9e-4c02-a714-85f50a808a01 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:14.892288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e352da7e-ed9e-4c02-a714-85f50a808a01 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1367 microversion: 2.1 time: 0.342129 Jun 20 07:09:14.897143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 156/312] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:14 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:14.951244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3e53d5f9-77d0-47c0-8e3f-d7efa858874c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:14.961570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3e53d5f9-77d0-47c0-8e3f-d7efa858874c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.244781 Jun 20 07:09:14.964197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 157/313] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:14 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:15.567164 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f8accc0d-1778-48af-9e5a-4816d56ce6f9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:15.568029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f8accc0d-1778-48af-9e5a-4816d56ce6f9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:15.574104 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8accc0d-1778-48af-9e5a-4816d56ce6f9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:15.574566 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8accc0d-1778-48af-9e5a-4816d56ce6f9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:15.575963 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8accc0d-1778-48af-9e5a-4816d56ce6f9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:15.576628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8accc0d-1778-48af-9e5a-4816d56ce6f9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:15.792850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f8accc0d-1778-48af-9e5a-4816d56ce6f9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:15.802630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f8accc0d-1778-48af-9e5a-4816d56ce6f9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:15.804726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f8accc0d-1778-48af-9e5a-4816d56ce6f9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:15.805977 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f8accc0d-1778-48af-9e5a-4816d56ce6f9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.242733 Jun 20 07:09:15.827036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 157/314] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:15 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:15.915849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-331ca480-68b6-4e33-8d3d-f34b2b6d052d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:15.916574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-331ca480-68b6-4e33-8d3d-f34b2b6d052d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:15.933673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-331ca480-68b6-4e33-8d3d-f34b2b6d052d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:15.934139 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-331ca480-68b6-4e33-8d3d-f34b2b6d052d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:15.936446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-331ca480-68b6-4e33-8d3d-f34b2b6d052d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:15.937027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-331ca480-68b6-4e33-8d3d-f34b2b6d052d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:15.978640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c8591c1c-2169-4232-8797-f8c8354358fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:15.979503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c8591c1c-2169-4232-8797-f8c8354358fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:15.988782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8591c1c-2169-4232-8797-f8c8354358fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:15.999906 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8591c1c-2169-4232-8797-f8c8354358fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:16.001026 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8591c1c-2169-4232-8797-f8c8354358fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:16.002249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8591c1c-2169-4232-8797-f8c8354358fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:16.256793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-331ca480-68b6-4e33-8d3d-f34b2b6d052d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:16.265244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-331ca480-68b6-4e33-8d3d-f34b2b6d052d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1367 microversion: 2.1 time: 0.359656 Jun 20 07:09:16.265822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 158/315] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:15 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:16.304147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c8591c1c-2169-4232-8797-f8c8354358fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:16.316712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c8591c1c-2169-4232-8797-f8c8354358fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.339571 Jun 20 07:09:16.319695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 158/316] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:15 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:16.825784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a53b9705-6250-4e7e-b3d1-20852a0ca0e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:16.826619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a53b9705-6250-4e7e-b3d1-20852a0ca0e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:16.841253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a53b9705-6250-4e7e-b3d1-20852a0ca0e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:16.842061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a53b9705-6250-4e7e-b3d1-20852a0ca0e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:16.843077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a53b9705-6250-4e7e-b3d1-20852a0ca0e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:16.843639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a53b9705-6250-4e7e-b3d1-20852a0ca0e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:16.989493 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a53b9705-6250-4e7e-b3d1-20852a0ca0e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:16.998240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a53b9705-6250-4e7e-b3d1-20852a0ca0e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:16.999722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a53b9705-6250-4e7e-b3d1-20852a0ca0e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:17.000895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a53b9705-6250-4e7e-b3d1-20852a0ca0e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.179814 Jun 20 07:09:17.001911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 159/317] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:16 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:17.282313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-87508c2b-68da-4e37-8f99-e0f2b761d46a tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:17.283061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-87508c2b-68da-4e37-8f99-e0f2b761d46a tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:17.289965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87508c2b-68da-4e37-8f99-e0f2b761d46a tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:17.290496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87508c2b-68da-4e37-8f99-e0f2b761d46a tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:17.291355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87508c2b-68da-4e37-8f99-e0f2b761d46a tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:17.291870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87508c2b-68da-4e37-8f99-e0f2b761d46a tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:17.335439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-992f7acc-3271-4a13-838b-e16420ce26e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:17.337477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-992f7acc-3271-4a13-838b-e16420ce26e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:17.345916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-992f7acc-3271-4a13-838b-e16420ce26e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:17.346553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-992f7acc-3271-4a13-838b-e16420ce26e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:17.347519 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-992f7acc-3271-4a13-838b-e16420ce26e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:17.348140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-992f7acc-3271-4a13-838b-e16420ce26e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:17.502255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87508c2b-68da-4e37-8f99-e0f2b761d46a tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:17.510547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-87508c2b-68da-4e37-8f99-e0f2b761d46a tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1367 microversion: 2.1 time: 0.232602 Jun 20 07:09:17.511380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 159/318] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:17 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:17.532927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-992f7acc-3271-4a13-838b-e16420ce26e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:17.545430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-992f7acc-3271-4a13-838b-e16420ce26e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.215159 Jun 20 07:09:17.546026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 160/319] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:17 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:18.019878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2efc743c-75a1-49a3-9ac2-93115b8ebc1b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:18.020534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2efc743c-75a1-49a3-9ac2-93115b8ebc1b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:18.026807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2efc743c-75a1-49a3-9ac2-93115b8ebc1b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:18.027263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2efc743c-75a1-49a3-9ac2-93115b8ebc1b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:18.028034 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2efc743c-75a1-49a3-9ac2-93115b8ebc1b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:18.028500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2efc743c-75a1-49a3-9ac2-93115b8ebc1b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:18.163401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2efc743c-75a1-49a3-9ac2-93115b8ebc1b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:18.171813 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2efc743c-75a1-49a3-9ac2-93115b8ebc1b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:18.173332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2efc743c-75a1-49a3-9ac2-93115b8ebc1b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:18.174469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2efc743c-75a1-49a3-9ac2-93115b8ebc1b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.158829 Jun 20 07:09:18.175027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 160/320] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:18 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:18.529193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac19a205-14c4-4e6c-864c-7daf2027ce2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:18.529805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ac19a205-14c4-4e6c-864c-7daf2027ce2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:18.536382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac19a205-14c4-4e6c-864c-7daf2027ce2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:18.536977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac19a205-14c4-4e6c-864c-7daf2027ce2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:18.537774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac19a205-14c4-4e6c-864c-7daf2027ce2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:18.538316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac19a205-14c4-4e6c-864c-7daf2027ce2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:18.562552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-36a4ff61-41ab-4811-87cf-53e3025b6ce5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:18.563268 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-36a4ff61-41ab-4811-87cf-53e3025b6ce5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:18.569731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36a4ff61-41ab-4811-87cf-53e3025b6ce5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:18.570182 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36a4ff61-41ab-4811-87cf-53e3025b6ce5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:18.570953 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36a4ff61-41ab-4811-87cf-53e3025b6ce5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:18.571393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36a4ff61-41ab-4811-87cf-53e3025b6ce5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:18.737699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ac19a205-14c4-4e6c-864c-7daf2027ce2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:18.745569 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ac19a205-14c4-4e6c-864c-7daf2027ce2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1367 microversion: 2.1 time: 0.220196 Jun 20 07:09:18.746147 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 161/321] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:18 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:18.747807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-36a4ff61-41ab-4811-87cf-53e3025b6ce5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:18.755471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-36a4ff61-41ab-4811-87cf-53e3025b6ce5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.197347 Jun 20 07:09:18.756027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 161/322] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:18 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:19.193229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cad1f06c-0c23-4593-bf0d-c65426157523 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:19.193836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cad1f06c-0c23-4593-bf0d-c65426157523 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:19.200291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cad1f06c-0c23-4593-bf0d-c65426157523 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:19.200961 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cad1f06c-0c23-4593-bf0d-c65426157523 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:19.201949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cad1f06c-0c23-4593-bf0d-c65426157523 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:19.202386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cad1f06c-0c23-4593-bf0d-c65426157523 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:19.342084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cad1f06c-0c23-4593-bf0d-c65426157523 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:19.350971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cad1f06c-0c23-4593-bf0d-c65426157523 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:19.352684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cad1f06c-0c23-4593-bf0d-c65426157523 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:19.353877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cad1f06c-0c23-4593-bf0d-c65426157523 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.164455 Jun 20 07:09:19.354437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 162/323] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:19 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:19.773533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-72a86fb7-1f72-4217-b799-06bef4296227 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:19.776079 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-72a86fb7-1f72-4217-b799-06bef4296227 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:19.783950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-028332b7-9f9a-4bff-99a2-5f147f774ea2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:19.785437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-028332b7-9f9a-4bff-99a2-5f147f774ea2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:19.792586 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-028332b7-9f9a-4bff-99a2-5f147f774ea2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:19.793108 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-028332b7-9f9a-4bff-99a2-5f147f774ea2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:19.793263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72a86fb7-1f72-4217-b799-06bef4296227 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:19.794305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72a86fb7-1f72-4217-b799-06bef4296227 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:19.794710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-028332b7-9f9a-4bff-99a2-5f147f774ea2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:19.795145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-028332b7-9f9a-4bff-99a2-5f147f774ea2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:19.795255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72a86fb7-1f72-4217-b799-06bef4296227 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:19.795664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72a86fb7-1f72-4217-b799-06bef4296227 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:20.107092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-72a86fb7-1f72-4217-b799-06bef4296227 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:20.119398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-72a86fb7-1f72-4217-b799-06bef4296227 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.350275 Jun 20 07:09:20.120451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 163/324] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:19 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:20.133072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-68515c9b-0eeb-4a91-a384-3b1fbfd2c636 req-ba775f49-12e5-4d03-b04c-9c6bfe317c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53321809-7dd1-4d7b-b6b8-5a58b1e907f2", "name": "network-vif-plugged", "status": "completed", "tag": "aa136057-a2bf-4714-9bf0-13fed4a7b779"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:20.152183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-68515c9b-0eeb-4a91-a384-3b1fbfd2c636 req-ba775f49-12e5-4d03-b04c-9c6bfe317c0a service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:20.153489 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-68515c9b-0eeb-4a91-a384-3b1fbfd2c636 req-ba775f49-12e5-4d03-b04c-9c6bfe317c0a service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:20.175651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-68515c9b-0eeb-4a91-a384-3b1fbfd2c636 req-ba775f49-12e5-4d03-b04c-9c6bfe317c0a service nova] Creating event network-vif-plugged:aa136057-a2bf-4714-9bf0-13fed4a7b779 for instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 on hv-cinder-77819 Jun 20 07:09:20.180995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-68515c9b-0eeb-4a91-a384-3b1fbfd2c636 req-ba775f49-12e5-4d03-b04c-9c6bfe317c0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059257 Jun 20 07:09:20.181773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 164/325] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:20.233357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-028332b7-9f9a-4bff-99a2-5f147f774ea2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:20.241394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-028332b7-9f9a-4bff-99a2-5f147f774ea2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1367 microversion: 2.1 time: 0.483316 Jun 20 07:09:20.242030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 162/326] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:19 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1367 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:20.372875 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ef966ad7-b653-4ee1-af23-30ac6ed59248 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:20.373609 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ef966ad7-b653-4ee1-af23-30ac6ed59248 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:20.379819 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef966ad7-b653-4ee1-af23-30ac6ed59248 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:20.380306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef966ad7-b653-4ee1-af23-30ac6ed59248 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:20.381072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef966ad7-b653-4ee1-af23-30ac6ed59248 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:20.381509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef966ad7-b653-4ee1-af23-30ac6ed59248 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:20.526659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ef966ad7-b653-4ee1-af23-30ac6ed59248 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:20.535247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ef966ad7-b653-4ee1-af23-30ac6ed59248 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:20.536869 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ef966ad7-b653-4ee1-af23-30ac6ed59248 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:20.538143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ef966ad7-b653-4ee1-af23-30ac6ed59248 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.169636 Jun 20 07:09:20.542085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 165/327] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:20 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:20.727812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-185d71be-43b8-4402-be48-6c0cfc8f7261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:20.734275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-185d71be-43b8-4402-be48-6c0cfc8f7261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:20.734772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-185d71be-43b8-4402-be48-6c0cfc8f7261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:20.798557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-185d71be-43b8-4402-be48-6c0cfc8f7261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Going to try to stop instance {{(pid=117606) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 07:09:20.850683 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-185d71be-43b8-4402-be48-6c0cfc8f7261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "POST /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/action" status: 202 len: 0 microversion: 2.1 time: 0.126416 Jun 20 07:09:20.851350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 163/328] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:09:20 2022] POST /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 07:09:20.860501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bdd16e82-16ef-485f-9ea0-d8635185fbde tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:20.861802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bdd16e82-16ef-485f-9ea0-d8635185fbde tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:20.878429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bdd16e82-16ef-485f-9ea0-d8635185fbde tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:20.878877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bdd16e82-16ef-485f-9ea0-d8635185fbde tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:20.879680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bdd16e82-16ef-485f-9ea0-d8635185fbde tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:20.880126 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bdd16e82-16ef-485f-9ea0-d8635185fbde tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:21.027922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bdd16e82-16ef-485f-9ea0-d8635185fbde tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:21.035867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bdd16e82-16ef-485f-9ea0-d8635185fbde tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.180270 Jun 20 07:09:21.036458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 166/329] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:20 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:21.137250 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad59a2a9-9499-4b32-82d3-7b6659997b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:21.138681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ad59a2a9-9499-4b32-82d3-7b6659997b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:21.145610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad59a2a9-9499-4b32-82d3-7b6659997b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:21.146063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad59a2a9-9499-4b32-82d3-7b6659997b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:21.146839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad59a2a9-9499-4b32-82d3-7b6659997b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:21.147275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad59a2a9-9499-4b32-82d3-7b6659997b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:21.259219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fdc71122-deba-41ea-a6eb-d470323776ca tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:21.259738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fdc71122-deba-41ea-a6eb-d470323776ca tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:21.266201 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdc71122-deba-41ea-a6eb-d470323776ca tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:21.266640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdc71122-deba-41ea-a6eb-d470323776ca tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:21.267676 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdc71122-deba-41ea-a6eb-d470323776ca tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:21.268134 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdc71122-deba-41ea-a6eb-d470323776ca tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:21.297288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad59a2a9-9499-4b32-82d3-7b6659997b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:21.305055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ad59a2a9-9499-4b32-82d3-7b6659997b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.172134 Jun 20 07:09:21.305648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 164/330] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:21 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:21.421297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fdc71122-deba-41ea-a6eb-d470323776ca tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:21.433007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fdc71122-deba-41ea-a6eb-d470323776ca tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1367 microversion: 2.1 time: 0.178791 Jun 20 07:09:21.433838 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 167/331] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:21 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:21.556360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d2ac6620-7c8d-452e-bf18-c2537bac8938 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:21.556993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d2ac6620-7c8d-452e-bf18-c2537bac8938 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:21.563533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2ac6620-7c8d-452e-bf18-c2537bac8938 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:21.563975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2ac6620-7c8d-452e-bf18-c2537bac8938 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:21.564756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2ac6620-7c8d-452e-bf18-c2537bac8938 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:21.565186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2ac6620-7c8d-452e-bf18-c2537bac8938 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:21.711215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d2ac6620-7c8d-452e-bf18-c2537bac8938 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:21.719841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d2ac6620-7c8d-452e-bf18-c2537bac8938 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:21.721373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d2ac6620-7c8d-452e-bf18-c2537bac8938 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:21.722533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d2ac6620-7c8d-452e-bf18-c2537bac8938 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.170013 Jun 20 07:09:21.723251 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 165/332] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:21 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:22.052967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4a350ac0-136f-49a7-bb2e-b7d838e6c65f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:22.053581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4a350ac0-136f-49a7-bb2e-b7d838e6c65f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:22.060010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a350ac0-136f-49a7-bb2e-b7d838e6c65f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.060501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a350ac0-136f-49a7-bb2e-b7d838e6c65f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.061262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a350ac0-136f-49a7-bb2e-b7d838e6c65f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.061704 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a350ac0-136f-49a7-bb2e-b7d838e6c65f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.193444 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4a350ac0-136f-49a7-bb2e-b7d838e6c65f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:22.202873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4a350ac0-136f-49a7-bb2e-b7d838e6c65f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.153669 Jun 20 07:09:22.203446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 168/333] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:22 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:22.322639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f42e53a3-c8b7-4d11-9141-bc48a98900b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:22.323259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f42e53a3-c8b7-4d11-9141-bc48a98900b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:22.331617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f42e53a3-c8b7-4d11-9141-bc48a98900b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.332133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f42e53a3-c8b7-4d11-9141-bc48a98900b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.332949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f42e53a3-c8b7-4d11-9141-bc48a98900b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.333394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f42e53a3-c8b7-4d11-9141-bc48a98900b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.453926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f104e9da-bd1a-46d3-b609-64c6a7b4681b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:22.455780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f104e9da-bd1a-46d3-b609-64c6a7b4681b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:22.462386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f104e9da-bd1a-46d3-b609-64c6a7b4681b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.462844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f104e9da-bd1a-46d3-b609-64c6a7b4681b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.463679 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f104e9da-bd1a-46d3-b609-64c6a7b4681b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.466418 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f104e9da-bd1a-46d3-b609-64c6a7b4681b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.473591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:22.488400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f42e53a3-c8b7-4d11-9141-bc48a98900b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:22.496163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f42e53a3-c8b7-4d11-9141-bc48a98900b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1503 microversion: 2.1 time: 0.177359 Jun 20 07:09:22.506987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 166/334] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:22 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:22.513210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11ee7c63-b36e-4b12-9f0b-d5a0f0fc7821 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dea7d248-3a0c-4c48-9bed-86e75a85274e"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:22.515036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-11ee7c63-b36e-4b12-9f0b-d5a0f0fc7821 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:22.521936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11ee7c63-b36e-4b12-9f0b-d5a0f0fc7821 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.522393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11ee7c63-b36e-4b12-9f0b-d5a0f0fc7821 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.523167 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11ee7c63-b36e-4b12-9f0b-d5a0f0fc7821 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.523606 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11ee7c63-b36e-4b12-9f0b-d5a0f0fc7821 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.550200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-11ee7c63-b36e-4b12-9f0b-d5a0f0fc7821 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] HTTP exception thrown: Cannot 'attach_volume' instance 63d6b982-e069-44bd-8110-df44d83d451c while it is in vm_state rescued Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11ee7c63-b36e-4b12-9f0b-d5a0f0fc7821 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Request method failure captured: Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c/os-volume_attachments HTTP/1.1 Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 74 Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisBydWR9hXTdRdgEMgIPM-1lAL620VtySsJQPtX3E4eETT6X1pqkxCAdBrQ05QM3sLf2M6w4suLslwDczM450U7T03NmXju7Tum6YsJN5wR3uh9QywM_y5Z98mk3Ttcwbp4tjIhwIlNWuRc740_x69DYuTSos87GlveyHMBK04lJyYJs Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:09:22.551811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:09:22.553449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:09:22.553449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:09:22.553449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:09:22.553449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:09:22.553449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:09:22.553449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:09:22.553449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:09:22.553449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: af0dee4e1dfb4f879dfe41622a9e23b1 Jun 20 07:09:22.553449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:09:22.553449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Jun 20 07:09:22.553449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {"volumeAttachment": {"volumeId": "dea7d248-3a0c-4c48-9bed-86e75a85274e"}} Jun 20 07:09:22.553449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Cannot 'attach_volume' instance 63d6b982-e069-44bd-8110-df44d83d451c while it is in vm_state rescued Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'server_id': '63d6b982-e069-44bd-8110-df44d83d451c', 'body': {'volumeAttachment': {'volumeId': 'dea7d248-3a0c-4c48-9bed-86e75a85274e'}}} Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63d6b982-e069-44bd-8110-df44d83d451c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:09:22.558227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 63d6b982-e069-44bd-8110-df44d83d451c while it is in vm_state rescued Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:09:22.559595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:09:22.562556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:09:22.562556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:09:22.562556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 63d6b982-e069-44bd-8110-df44d83d451c while it is in vm_state rescued Jun 20 07:09:22.562556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:09:22.562556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11ee7c63-b36e-4b12-9f0b-d5a0f0fc7821 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Returning 409 to user: Cannot 'attach_volume' instance 63d6b982-e069-44bd-8110-df44d83d451c while it is in vm_state rescued {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:09:22.562556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-11ee7c63-b36e-4b12-9f0b-d5a0f0fc7821 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "POST /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044083 Jun 20 07:09:22.562556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 167/335] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 07:09:22 2022] POST /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 07:09:22.563448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0476e26f-d1cf-45b5-9b71-0307e4b86790 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:22.563448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0476e26f-d1cf-45b5-9b71-0307e4b86790 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:22.569742 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0476e26f-d1cf-45b5-9b71-0307e4b86790 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.570195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0476e26f-d1cf-45b5-9b71-0307e4b86790 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.570971 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0476e26f-d1cf-45b5-9b71-0307e4b86790 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.571407 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0476e26f-d1cf-45b5-9b71-0307e4b86790 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.614683 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:22.615661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f104e9da-bd1a-46d3-b609-64c6a7b4681b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:22.623934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f104e9da-bd1a-46d3-b609-64c6a7b4681b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1367 microversion: 2.1 time: 0.173877 Jun 20 07:09:22.624448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 169/336] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:22 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:22.643396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0476e26f-d1cf-45b5-9b71-0307e4b86790 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "POST /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c/action" status: 202 len: 0 microversion: 2.1 time: 0.084818 Jun 20 07:09:22.645475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 168/337] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:09:22 2022] POST /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:09:22.651864 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d8c25051-98ed-4f89-8213-8a94c0f498ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:22.652513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d8c25051-98ed-4f89-8213-8a94c0f498ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:22.659116 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8c25051-98ed-4f89-8213-8a94c0f498ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.659559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8c25051-98ed-4f89-8213-8a94c0f498ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.660339 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8c25051-98ed-4f89-8213-8a94c0f498ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.660767 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d8c25051-98ed-4f89-8213-8a94c0f498ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.742654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe7c8f0b-c060-4207-bbb3-82f3fac90eec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:22.744300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe7c8f0b-c060-4207-bbb3-82f3fac90eec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:22.754833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe7c8f0b-c060-4207-bbb3-82f3fac90eec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.755410 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe7c8f0b-c060-4207-bbb3-82f3fac90eec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.756318 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe7c8f0b-c060-4207-bbb3-82f3fac90eec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:22.756974 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe7c8f0b-c060-4207-bbb3-82f3fac90eec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:22.884886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d8c25051-98ed-4f89-8213-8a94c0f498ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:22.897751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d8c25051-98ed-4f89-8213-8a94c0f498ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1511 microversion: 2.1 time: 0.249521 Jun 20 07:09:22.908169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 170/338] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:22 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:22.965144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe7c8f0b-c060-4207-bbb3-82f3fac90eec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:22.985374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe7c8f0b-c060-4207-bbb3-82f3fac90eec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:22.990558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe7c8f0b-c060-4207-bbb3-82f3fac90eec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:22.992077 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe7c8f0b-c060-4207-bbb3-82f3fac90eec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.254133 Jun 20 07:09:23.000563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 169/339] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:09:23.219682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cd5e3621-fdbd-45d7-832f-49d2aa73d2c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:23.220509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cd5e3621-fdbd-45d7-832f-49d2aa73d2c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:23.227031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd5e3621-fdbd-45d7-832f-49d2aa73d2c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:23.227554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd5e3621-fdbd-45d7-832f-49d2aa73d2c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:23.228423 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd5e3621-fdbd-45d7-832f-49d2aa73d2c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:23.228882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd5e3621-fdbd-45d7-832f-49d2aa73d2c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:23.368176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cd5e3621-fdbd-45d7-832f-49d2aa73d2c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:23.376927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cd5e3621-fdbd-45d7-832f-49d2aa73d2c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.161219 Jun 20 07:09:23.377501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 171/340] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:23 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:23.639837 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f55e5a4a-4c9c-4a08-9a69-125d13074f44 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:23.643342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f55e5a4a-4c9c-4a08-9a69-125d13074f44 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:23.649610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f55e5a4a-4c9c-4a08-9a69-125d13074f44 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:23.650052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f55e5a4a-4c9c-4a08-9a69-125d13074f44 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:23.650844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f55e5a4a-4c9c-4a08-9a69-125d13074f44 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:23.651294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f55e5a4a-4c9c-4a08-9a69-125d13074f44 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:23.862394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f55e5a4a-4c9c-4a08-9a69-125d13074f44 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:23.870925 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f55e5a4a-4c9c-4a08-9a69-125d13074f44 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1558 microversion: 2.1 time: 0.234838 Jun 20 07:09:23.871612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 170/341] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:23 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1558 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:23.890153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-45787f90-ffe8-4e69-b753-3bd7924c4d80 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:23.890857 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-45787f90-ffe8-4e69-b753-3bd7924c4d80 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:23.897536 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45787f90-ffe8-4e69-b753-3bd7924c4d80 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:23.897987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45787f90-ffe8-4e69-b753-3bd7924c4d80 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:23.898942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45787f90-ffe8-4e69-b753-3bd7924c4d80 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:23.899533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45787f90-ffe8-4e69-b753-3bd7924c4d80 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:23.917441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-45af303c-2f9d-46c4-82db-2e4761d011ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:23.918069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-45af303c-2f9d-46c4-82db-2e4761d011ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:23.927400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:23.929436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45af303c-2f9d-46c4-82db-2e4761d011ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:23.930080 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45af303c-2f9d-46c4-82db-2e4761d011ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:23.943866 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45af303c-2f9d-46c4-82db-2e4761d011ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:23.943866 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45af303c-2f9d-46c4-82db-2e4761d011ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:24.111592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-45787f90-ffe8-4e69-b753-3bd7924c4d80 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.225208 Jun 20 07:09:24.112712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 172/342] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 07:09:23 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2/os-interface => generated 285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:24.117694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-482d9d0b-efe5-4b95-9efc-a8ea0a95e396 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:24.127566 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-482d9d0b-efe5-4b95-9efc-a8ea0a95e396 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:24.145804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-482d9d0b-efe5-4b95-9efc-a8ea0a95e396 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:24.146459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-482d9d0b-efe5-4b95-9efc-a8ea0a95e396 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:24.147564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-482d9d0b-efe5-4b95-9efc-a8ea0a95e396 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:24.148172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-482d9d0b-efe5-4b95-9efc-a8ea0a95e396 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:24.399282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45af303c-2f9d-46c4-82db-2e4761d011ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:24.411946 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-45af303c-2f9d-46c4-82db-2e4761d011ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1511 microversion: 2.1 time: 0.499707 Jun 20 07:09:24.413907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 171/343] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:23 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1511 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:24.430270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01b34db8-e702-48da-bb41-0ede8292a184 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:24.431264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01b34db8-e702-48da-bb41-0ede8292a184 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:24.444507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01b34db8-e702-48da-bb41-0ede8292a184 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:24.445443 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01b34db8-e702-48da-bb41-0ede8292a184 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:24.448090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01b34db8-e702-48da-bb41-0ede8292a184 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:24.449646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01b34db8-e702-48da-bb41-0ede8292a184 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:24.584248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:24.602403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-482d9d0b-efe5-4b95-9efc-a8ea0a95e396 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:24.617768 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-482d9d0b-efe5-4b95-9efc-a8ea0a95e396 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:24.620520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-482d9d0b-efe5-4b95-9efc-a8ea0a95e396 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:24.621924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-482d9d0b-efe5-4b95-9efc-a8ea0a95e396 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.508119 Jun 20 07:09:24.623651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 173/344] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:24 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:24.743409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01b34db8-e702-48da-bb41-0ede8292a184 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:24.752986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-01b34db8-e702-48da-bb41-0ede8292a184 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.337763 Jun 20 07:09:24.753560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 172/345] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:24 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:25.431168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e30ae16e-4479-4b58-9958-cf385d08cc69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:25.431856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e30ae16e-4479-4b58-9958-cf385d08cc69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:25.434633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:25.440405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e30ae16e-4479-4b58-9958-cf385d08cc69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:25.440853 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e30ae16e-4479-4b58-9958-cf385d08cc69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:25.441921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e30ae16e-4479-4b58-9958-cf385d08cc69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:25.442353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e30ae16e-4479-4b58-9958-cf385d08cc69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:25.525964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-245a1a9f-0d9d-4210-b86f-0b980fc873f6 req-3c10bd73-11bb-4253-b766-caa29030261c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53321809-7dd1-4d7b-b6b8-5a58b1e907f2", "tag": "aa136057-a2bf-4714-9bf0-13fed4a7b779"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:25.536142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-245a1a9f-0d9d-4210-b86f-0b980fc873f6 req-3c10bd73-11bb-4253-b766-caa29030261c service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:25.536575 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-245a1a9f-0d9d-4210-b86f-0b980fc873f6 req-3c10bd73-11bb-4253-b766-caa29030261c service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:25.551361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-245a1a9f-0d9d-4210-b86f-0b980fc873f6 req-3c10bd73-11bb-4253-b766-caa29030261c service nova] Creating event network-changed:aa136057-a2bf-4714-9bf0-13fed4a7b779 for instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 on hv-cinder-77819 Jun 20 07:09:25.556668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-245a1a9f-0d9d-4210-b86f-0b980fc873f6 req-3c10bd73-11bb-4253-b766-caa29030261c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035249 Jun 20 07:09:25.557264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 173/346] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:09:25.588826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e30ae16e-4479-4b58-9958-cf385d08cc69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:25.597386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e30ae16e-4479-4b58-9958-cf385d08cc69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1511 microversion: 2.1 time: 0.170237 Jun 20 07:09:25.597945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 174/347] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:25 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:25.643175 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-94d2fc0f-f9d2-40e3-a347-c76117f78cd2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:25.643983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-94d2fc0f-f9d2-40e3-a347-c76117f78cd2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:25.651701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94d2fc0f-f9d2-40e3-a347-c76117f78cd2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:25.652299 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94d2fc0f-f9d2-40e3-a347-c76117f78cd2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:25.653159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94d2fc0f-f9d2-40e3-a347-c76117f78cd2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:25.653678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94d2fc0f-f9d2-40e3-a347-c76117f78cd2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:25.775393 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-abe2e571-8f98-41e1-b667-24342b1b3532 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:25.776256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-abe2e571-8f98-41e1-b667-24342b1b3532 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:25.786668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abe2e571-8f98-41e1-b667-24342b1b3532 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:25.792033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abe2e571-8f98-41e1-b667-24342b1b3532 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:25.793616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abe2e571-8f98-41e1-b667-24342b1b3532 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:25.794255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abe2e571-8f98-41e1-b667-24342b1b3532 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:25.830856 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-94d2fc0f-f9d2-40e3-a347-c76117f78cd2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:25.840492 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-94d2fc0f-f9d2-40e3-a347-c76117f78cd2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:25.842966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-94d2fc0f-f9d2-40e3-a347-c76117f78cd2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:25.844493 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-94d2fc0f-f9d2-40e3-a347-c76117f78cd2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.206452 Jun 20 07:09:25.845649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 174/348] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:25 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:25.969371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-abe2e571-8f98-41e1-b667-24342b1b3532 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:25.978448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-abe2e571-8f98-41e1-b667-24342b1b3532 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.206830 Jun 20 07:09:25.979337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 175/349] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:25 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:26.614734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-87cb6430-ea52-4f1b-85b5-71b4d6bff169 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:26.615457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-87cb6430-ea52-4f1b-85b5-71b4d6bff169 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:26.622032 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87cb6430-ea52-4f1b-85b5-71b4d6bff169 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:26.622387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87cb6430-ea52-4f1b-85b5-71b4d6bff169 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:26.623845 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87cb6430-ea52-4f1b-85b5-71b4d6bff169 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:26.624277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87cb6430-ea52-4f1b-85b5-71b4d6bff169 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:26.754649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87cb6430-ea52-4f1b-85b5-71b4d6bff169 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:26.762138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-87cb6430-ea52-4f1b-85b5-71b4d6bff169 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1511 microversion: 2.1 time: 0.151247 Jun 20 07:09:26.762702 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 175/350] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:26 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:26.863650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6dd675fc-68cb-4d35-8564-d4b9e31bc635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:26.864315 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6dd675fc-68cb-4d35-8564-d4b9e31bc635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:26.870898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6dd675fc-68cb-4d35-8564-d4b9e31bc635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:26.871363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6dd675fc-68cb-4d35-8564-d4b9e31bc635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:26.872129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6dd675fc-68cb-4d35-8564-d4b9e31bc635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:26.873067 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6dd675fc-68cb-4d35-8564-d4b9e31bc635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:26.995353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f9ae6a4a-8346-4c33-88ac-ba0792a8ef36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:26.995967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f9ae6a4a-8346-4c33-88ac-ba0792a8ef36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:27.001232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6dd675fc-68cb-4d35-8564-d4b9e31bc635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:27.002494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9ae6a4a-8346-4c33-88ac-ba0792a8ef36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:27.002944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9ae6a4a-8346-4c33-88ac-ba0792a8ef36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:27.003710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9ae6a4a-8346-4c33-88ac-ba0792a8ef36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:27.004167 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9ae6a4a-8346-4c33-88ac-ba0792a8ef36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:27.009196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6dd675fc-68cb-4d35-8564-d4b9e31bc635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:27.010708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6dd675fc-68cb-4d35-8564-d4b9e31bc635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:27.011864 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6dd675fc-68cb-4d35-8564-d4b9e31bc635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.152190 Jun 20 07:09:27.012488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 176/351] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:26 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:27.130522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f9ae6a4a-8346-4c33-88ac-ba0792a8ef36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:27.138993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f9ae6a4a-8346-4c33-88ac-ba0792a8ef36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.146907 Jun 20 07:09:27.139552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 176/352] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:26 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:27.778660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3bf8eba9-2efd-4917-bb95-97f926c2b145 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:27.779292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3bf8eba9-2efd-4917-bb95-97f926c2b145 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:27.785314 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3bf8eba9-2efd-4917-bb95-97f926c2b145 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:27.785758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3bf8eba9-2efd-4917-bb95-97f926c2b145 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:27.786505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3bf8eba9-2efd-4917-bb95-97f926c2b145 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:27.786932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3bf8eba9-2efd-4917-bb95-97f926c2b145 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:27.911387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3bf8eba9-2efd-4917-bb95-97f926c2b145 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:27.918755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3bf8eba9-2efd-4917-bb95-97f926c2b145 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1511 microversion: 2.1 time: 0.143903 Jun 20 07:09:27.919313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 177/353] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:27 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1511 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:28.030725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4ba3cfd7-fb4e-4a8a-9782-8299bdb76e41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:28.031265 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4ba3cfd7-fb4e-4a8a-9782-8299bdb76e41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:28.037716 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ba3cfd7-fb4e-4a8a-9782-8299bdb76e41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:28.038169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ba3cfd7-fb4e-4a8a-9782-8299bdb76e41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:28.038980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ba3cfd7-fb4e-4a8a-9782-8299bdb76e41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:28.039424 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ba3cfd7-fb4e-4a8a-9782-8299bdb76e41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:28.155554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-09785164-8dd4-458c-92e6-650dc128db33 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:28.156186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-09785164-8dd4-458c-92e6-650dc128db33 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:28.162171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09785164-8dd4-458c-92e6-650dc128db33 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:28.162621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09785164-8dd4-458c-92e6-650dc128db33 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:28.163387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09785164-8dd4-458c-92e6-650dc128db33 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:28.163827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09785164-8dd4-458c-92e6-650dc128db33 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:28.170601 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ba3cfd7-fb4e-4a8a-9782-8299bdb76e41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:28.178430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ba3cfd7-fb4e-4a8a-9782-8299bdb76e41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:28.179998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ba3cfd7-fb4e-4a8a-9782-8299bdb76e41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:28.181278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4ba3cfd7-fb4e-4a8a-9782-8299bdb76e41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.154439 Jun 20 07:09:28.182386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 177/354] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:28 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:28.296306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-09785164-8dd4-458c-92e6-650dc128db33 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:28.304247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-09785164-8dd4-458c-92e6-650dc128db33 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.152499 Jun 20 07:09:28.304809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 178/355] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:28 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:28.936493 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3b13d39f-099a-4917-8ad5-8e7d7270b5a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:28.937086 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3b13d39f-099a-4917-8ad5-8e7d7270b5a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:28.943362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b13d39f-099a-4917-8ad5-8e7d7270b5a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:28.943809 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b13d39f-099a-4917-8ad5-8e7d7270b5a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:28.944608 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b13d39f-099a-4917-8ad5-8e7d7270b5a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:28.945038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b13d39f-099a-4917-8ad5-8e7d7270b5a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:29.072658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3b13d39f-099a-4917-8ad5-8e7d7270b5a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:29.080867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3b13d39f-099a-4917-8ad5-8e7d7270b5a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1511 microversion: 2.1 time: 0.148479 Jun 20 07:09:29.081430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 178/356] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:28 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:29.200516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ab262826-6c01-449a-9afb-88bcdf52fbc2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:29.201687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ab262826-6c01-449a-9afb-88bcdf52fbc2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:29.208018 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab262826-6c01-449a-9afb-88bcdf52fbc2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:29.208488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab262826-6c01-449a-9afb-88bcdf52fbc2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:29.209236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab262826-6c01-449a-9afb-88bcdf52fbc2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:29.209668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ab262826-6c01-449a-9afb-88bcdf52fbc2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:29.322027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-497ebbc4-fb4a-44ba-9646-e02235642a63 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:29.322644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-497ebbc4-fb4a-44ba-9646-e02235642a63 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:29.334351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-497ebbc4-fb4a-44ba-9646-e02235642a63 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:29.334984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-497ebbc4-fb4a-44ba-9646-e02235642a63 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:29.336297 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-497ebbc4-fb4a-44ba-9646-e02235642a63 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:29.337002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-497ebbc4-fb4a-44ba-9646-e02235642a63 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:29.348837 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ab262826-6c01-449a-9afb-88bcdf52fbc2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:29.357008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ab262826-6c01-449a-9afb-88bcdf52fbc2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:29.358634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ab262826-6c01-449a-9afb-88bcdf52fbc2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:29.359970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ab262826-6c01-449a-9afb-88bcdf52fbc2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.163252 Jun 20 07:09:29.361405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 179/357] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:29 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:29.478253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-497ebbc4-fb4a-44ba-9646-e02235642a63 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:29.486674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-497ebbc4-fb4a-44ba-9646-e02235642a63 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.168854 Jun 20 07:09:29.487241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 179/358] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:29 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:30.098347 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-765d2aba-1fe8-4f6b-9edf-55c83e11d49c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:30.098950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-765d2aba-1fe8-4f6b-9edf-55c83e11d49c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:30.105408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-765d2aba-1fe8-4f6b-9edf-55c83e11d49c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:30.105853 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-765d2aba-1fe8-4f6b-9edf-55c83e11d49c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:30.106606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-765d2aba-1fe8-4f6b-9edf-55c83e11d49c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:30.107039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-765d2aba-1fe8-4f6b-9edf-55c83e11d49c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:30.241732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-765d2aba-1fe8-4f6b-9edf-55c83e11d49c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:30.250020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-765d2aba-1fe8-4f6b-9edf-55c83e11d49c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1517 microversion: 2.1 time: 0.155462 Jun 20 07:09:30.250831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 180/359] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:30 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:30.378843 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-89c3ecf4-52b8-453b-a2d7-9a740af5bb18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:30.380030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-89c3ecf4-52b8-453b-a2d7-9a740af5bb18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:30.388468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89c3ecf4-52b8-453b-a2d7-9a740af5bb18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:30.390398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89c3ecf4-52b8-453b-a2d7-9a740af5bb18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:30.391568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89c3ecf4-52b8-453b-a2d7-9a740af5bb18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:30.392782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89c3ecf4-52b8-453b-a2d7-9a740af5bb18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:30.515305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8e76531b-299b-495e-b5e4-3ed20a756492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:30.515929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8e76531b-299b-495e-b5e4-3ed20a756492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:30.524255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e76531b-299b-495e-b5e4-3ed20a756492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:30.524948 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e76531b-299b-495e-b5e4-3ed20a756492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:30.526179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e76531b-299b-495e-b5e4-3ed20a756492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:30.527023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e76531b-299b-495e-b5e4-3ed20a756492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:30.669005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-89c3ecf4-52b8-453b-a2d7-9a740af5bb18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:30.684845 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-89c3ecf4-52b8-453b-a2d7-9a740af5bb18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:30.687731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-89c3ecf4-52b8-453b-a2d7-9a740af5bb18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:30.690471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-89c3ecf4-52b8-453b-a2d7-9a740af5bb18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1721 microversion: 2.20 time: 0.314296 Jun 20 07:09:30.702110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 180/360] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:30 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:30.842963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8e76531b-299b-495e-b5e4-3ed20a756492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:30.851222 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8e76531b-299b-495e-b5e4-3ed20a756492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.342801 Jun 20 07:09:30.851799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 181/361] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:30 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:31.626193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3562718c-a672-4c4e-a8e6-16d9de7dcd73 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Action: 'create', calling method: .version_select at 0x7ffa1fd94040>, body: {"keypair": {"name": "tempest-keypair-1925049029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME1F1SK4Om5V6oXBHdNABjYPIbibrt1Z1lB+8evfUgsVPgQLeur6I8SA3CFKkIwPbMdd7pd84Z3Q9NHcLa/SJ2vwqufzijT/zCEjgMXJ/PzfwOM/J87qNLJVMOtP/feZg=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:31.642724 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-3562718c-a672-4c4e-a8e6-16d9de7dcd73 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Getting quotas for project b07b7ec64ab448338374bb16c29c7b1d. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:09:31.647010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-3562718c-a672-4c4e-a8e6-16d9de7dcd73 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Getting quotas for user af0dee4e1dfb4f879dfe41622a9e23b1 and project b07b7ec64ab448338374bb16c29c7b1d. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:09:31.670635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3562718c-a672-4c4e-a8e6-16d9de7dcd73 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048266 Jun 20 07:09:31.671224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 181/362] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 07:09:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:31.722162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8ea1d7e9-55d3-44dc-9d5e-31bb75a59948 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:31.723758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8ea1d7e9-55d3-44dc-9d5e-31bb75a59948 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:31.731258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ea1d7e9-55d3-44dc-9d5e-31bb75a59948 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:31.731773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ea1d7e9-55d3-44dc-9d5e-31bb75a59948 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:31.732827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ea1d7e9-55d3-44dc-9d5e-31bb75a59948 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:31.733497 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ea1d7e9-55d3-44dc-9d5e-31bb75a59948 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:31.873929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f5295bf5-5157-42d4-a0ec-eb67d63beb82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:31.875179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f5295bf5-5157-42d4-a0ec-eb67d63beb82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:31.886475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5295bf5-5157-42d4-a0ec-eb67d63beb82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:31.887150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5295bf5-5157-42d4-a0ec-eb67d63beb82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:31.888664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5295bf5-5157-42d4-a0ec-eb67d63beb82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:31.889973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5295bf5-5157-42d4-a0ec-eb67d63beb82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:31.903124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ea1d7e9-55d3-44dc-9d5e-31bb75a59948 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:31.914603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ea1d7e9-55d3-44dc-9d5e-31bb75a59948 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:31.916908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8ea1d7e9-55d3-44dc-9d5e-31bb75a59948 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:31.918614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8ea1d7e9-55d3-44dc-9d5e-31bb75a59948 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1742 microversion: 2.20 time: 0.203700 Jun 20 07:09:31.920373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 182/363] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:31 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1742 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:32.359915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f5295bf5-5157-42d4-a0ec-eb67d63beb82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:32.369057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f5295bf5-5157-42d4-a0ec-eb67d63beb82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.502993 Jun 20 07:09:32.369991 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 182/364] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:31 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:32.944138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7ebda890-e9be-497a-a358-278e0dc6897b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:32.945555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7ebda890-e9be-497a-a358-278e0dc6897b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:32.953698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ebda890-e9be-497a-a358-278e0dc6897b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:32.954144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ebda890-e9be-497a-a358-278e0dc6897b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:32.955063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ebda890-e9be-497a-a358-278e0dc6897b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:32.955485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ebda890-e9be-497a-a358-278e0dc6897b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:33.123733 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7ebda890-e9be-497a-a358-278e0dc6897b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:33.140779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7ebda890-e9be-497a-a358-278e0dc6897b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:33.143093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7ebda890-e9be-497a-a358-278e0dc6897b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:33.144843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7ebda890-e9be-497a-a358-278e0dc6897b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1742 microversion: 2.20 time: 0.207638 Jun 20 07:09:33.145710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 183/365] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:32 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1742 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:33.385628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1dd050e8-e0af-4aaa-bcd4-6c4478af26cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:33.386532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1dd050e8-e0af-4aaa-bcd4-6c4478af26cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:33.399000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1dd050e8-e0af-4aaa-bcd4-6c4478af26cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:33.399452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1dd050e8-e0af-4aaa-bcd4-6c4478af26cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:33.400529 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1dd050e8-e0af-4aaa-bcd4-6c4478af26cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:33.401276 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1dd050e8-e0af-4aaa-bcd4-6c4478af26cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:33.429970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-257928763", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "268c66c4-17bf-4494-8dc1-1ea1d6190507"}], "security_groups": [{"name": "tempest-securitygroup--445106007"}], "key_name": "tempest-keypair-1925049029", "user_data": "}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:33.575731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] validate_networks() for [('268c66c4-17bf-4494-8dc1-1ea1d6190507', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:09:33.603944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1dd050e8-e0af-4aaa-bcd4-6c4478af26cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:33.636188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1dd050e8-e0af-4aaa-bcd4-6c4478af26cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.254230 Jun 20 07:09:33.637661 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 183/366] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:33 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:34.004239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:09:34.004710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:09:34.005413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:09:34.005835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:09:34.006271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:09:34.017393 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:34.017854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:34.018707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:34.018984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-dda8d28d-797f-48b1-bb3d-ae20d2b728c6 req-13e510d0-bb4b-440f-a1bd-d2186dedace8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e214060-f046-41a1-b243-020c88edde42", "name": "network-vif-plugged", "status": "completed", "tag": "316c2317-90c4-4b27-bb5e-34a3153b065e"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:34.019293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:34.030859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-dda8d28d-797f-48b1-bb3d-ae20d2b728c6 req-13e510d0-bb4b-440f-a1bd-d2186dedace8 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:34.031512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-dda8d28d-797f-48b1-bb3d-ae20d2b728c6 req-13e510d0-bb4b-440f-a1bd-d2186dedace8 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:34.041817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Getting quotas for project b07b7ec64ab448338374bb16c29c7b1d. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:09:34.044905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-dda8d28d-797f-48b1-bb3d-ae20d2b728c6 req-13e510d0-bb4b-440f-a1bd-d2186dedace8 service nova] Creating event network-vif-plugged:316c2317-90c4-4b27-bb5e-34a3153b065e for instance 0e214060-f046-41a1-b243-020c88edde42 on hv-cinder-77819 Jun 20 07:09:34.046740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Getting quotas for user af0dee4e1dfb4f879dfe41622a9e23b1 and project b07b7ec64ab448338374bb16c29c7b1d. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:09:34.050589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-dda8d28d-797f-48b1-bb3d-ae20d2b728c6 req-13e510d0-bb4b-440f-a1bd-d2186dedace8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038974 Jun 20 07:09:34.060255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:09:34.062847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:09:34.063218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 184/367] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:34.114555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3baf158b-e5a9-4402-bc8a-5907d3784862 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.688717 Jun 20 07:09:34.115527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 184/368] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:09:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 07:09:34.126350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f1dfe9df-d07b-46f3-bb85-975a4e2b6151 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:34.127051 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f1dfe9df-d07b-46f3-bb85-975a4e2b6151 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:34.168136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-328489b1-0c52-43e4-8d06-6b41995ea36a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:34.168910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-328489b1-0c52-43e4-8d06-6b41995ea36a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:34.184797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-328489b1-0c52-43e4-8d06-6b41995ea36a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:34.185362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-328489b1-0c52-43e4-8d06-6b41995ea36a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:34.186455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-328489b1-0c52-43e4-8d06-6b41995ea36a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:34.187071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-328489b1-0c52-43e4-8d06-6b41995ea36a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:34.188095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f1dfe9df-d07b-46f3-bb85-975a4e2b6151 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:34.201163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f1dfe9df-d07b-46f3-bb85-975a4e2b6151 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1245 microversion: 2.1 time: 0.078709 Jun 20 07:09:34.203956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 185/369] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:34.415732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-328489b1-0c52-43e4-8d06-6b41995ea36a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:34.439516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-328489b1-0c52-43e4-8d06-6b41995ea36a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:34.442474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-328489b1-0c52-43e4-8d06-6b41995ea36a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:34.443918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-328489b1-0c52-43e4-8d06-6b41995ea36a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1742 microversion: 2.20 time: 0.281641 Jun 20 07:09:34.444520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 185/370] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:34 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1742 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:09:34.653675 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0f622c7f-a5ce-432d-8224-c9b3b3683b23 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:34.654339 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0f622c7f-a5ce-432d-8224-c9b3b3683b23 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:34.662827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f622c7f-a5ce-432d-8224-c9b3b3683b23 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:34.663283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f622c7f-a5ce-432d-8224-c9b3b3683b23 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:34.664374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f622c7f-a5ce-432d-8224-c9b3b3683b23 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:34.665119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f622c7f-a5ce-432d-8224-c9b3b3683b23 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:34.750046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-481a141e-74cb-4ccd-a17d-fc58020c8a93 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "679d0d87-5e97-45b8-b206-001aed251a15", "device": "/dev/sdb"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:34.752337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-481a141e-74cb-4ccd-a17d-fc58020c8a93 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:34.759035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-481a141e-74cb-4ccd-a17d-fc58020c8a93 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:34.759571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-481a141e-74cb-4ccd-a17d-fc58020c8a93 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:34.760652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-481a141e-74cb-4ccd-a17d-fc58020c8a93 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:34.761332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-481a141e-74cb-4ccd-a17d-fc58020c8a93 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:34.831862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0f622c7f-a5ce-432d-8224-c9b3b3683b23 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:34.841277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0f622c7f-a5ce-432d-8224-c9b3b3683b23 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.191590 Jun 20 07:09:34.842280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 186/371] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:34 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:34.861273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:35.060422 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-481a141e-74cb-4ccd-a17d-fc58020c8a93 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "POST /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315568 Jun 20 07:09:35.061236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 186/372] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 07:09:34 2022] POST /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:35.222374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-69a7e952-03db-4867-a678-8df0315d82b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:35.223043 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-69a7e952-03db-4867-a678-8df0315d82b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:35.229936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69a7e952-03db-4867-a678-8df0315d82b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:35.230390 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69a7e952-03db-4867-a678-8df0315d82b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:35.231166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69a7e952-03db-4867-a678-8df0315d82b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:35.231602 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69a7e952-03db-4867-a678-8df0315d82b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:35.296866 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-69a7e952-03db-4867-a678-8df0315d82b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:35.305432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-69a7e952-03db-4867-a678-8df0315d82b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1297 microversion: 2.1 time: 0.087055 Jun 20 07:09:35.315173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 187/373] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:35 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:35.464526 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5c624ad3-bbe0-4f04-8b1b-4ed002b86d39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:35.465436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5c624ad3-bbe0-4f04-8b1b-4ed002b86d39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:35.478163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c624ad3-bbe0-4f04-8b1b-4ed002b86d39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:35.507557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c624ad3-bbe0-4f04-8b1b-4ed002b86d39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:35.512235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c624ad3-bbe0-4f04-8b1b-4ed002b86d39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:35.512796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c624ad3-bbe0-4f04-8b1b-4ed002b86d39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:35.795607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5c624ad3-bbe0-4f04-8b1b-4ed002b86d39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:35.805225 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5c624ad3-bbe0-4f04-8b1b-4ed002b86d39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:35.806717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5c624ad3-bbe0-4f04-8b1b-4ed002b86d39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:35.807877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5c624ad3-bbe0-4f04-8b1b-4ed002b86d39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1737 microversion: 2.20 time: 0.348439 Jun 20 07:09:35.813525 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 187/374] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:35 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1737 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:35.859861 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f623a3e-1b99-44bd-9927-7a315c33f6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:35.860606 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8f623a3e-1b99-44bd-9927-7a315c33f6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:35.872750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f623a3e-1b99-44bd-9927-7a315c33f6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:35.875405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f623a3e-1b99-44bd-9927-7a315c33f6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:35.877298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f623a3e-1b99-44bd-9927-7a315c33f6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:35.878022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f623a3e-1b99-44bd-9927-7a315c33f6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:35.882768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:36.140460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8f623a3e-1b99-44bd-9927-7a315c33f6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:36.152679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8f623a3e-1b99-44bd-9927-7a315c33f6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.297006 Jun 20 07:09:36.153321 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 188/375] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:35 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:36.325535 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-33d706ac-d22a-4b19-85ad-d601af7346ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:36.326841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-33d706ac-d22a-4b19-85ad-d601af7346ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:36.353894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-33d706ac-d22a-4b19-85ad-d601af7346ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:36.354613 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-33d706ac-d22a-4b19-85ad-d601af7346ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:36.355720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-33d706ac-d22a-4b19-85ad-d601af7346ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:36.356961 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-33d706ac-d22a-4b19-85ad-d601af7346ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:36.656774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-33d706ac-d22a-4b19-85ad-d601af7346ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:36.665044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-33d706ac-d22a-4b19-85ad-d601af7346ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.346165 Jun 20 07:09:36.668291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 188/376] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:36 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:36.834131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f8cdd901-cbd9-4269-8851-3613a866c75a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:36.836734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f8cdd901-cbd9-4269-8851-3613a866c75a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:36.867791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8cdd901-cbd9-4269-8851-3613a866c75a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:36.867791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8cdd901-cbd9-4269-8851-3613a866c75a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:36.867791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8cdd901-cbd9-4269-8851-3613a866c75a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:36.867791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8cdd901-cbd9-4269-8851-3613a866c75a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:37.170887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-efc7d1ee-4bac-4e02-8242-6aaf919b17ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:37.171661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-efc7d1ee-4bac-4e02-8242-6aaf919b17ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:37.187741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efc7d1ee-4bac-4e02-8242-6aaf919b17ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:37.188161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efc7d1ee-4bac-4e02-8242-6aaf919b17ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:37.189090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efc7d1ee-4bac-4e02-8242-6aaf919b17ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:37.189626 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efc7d1ee-4bac-4e02-8242-6aaf919b17ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:37.223793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f8cdd901-cbd9-4269-8851-3613a866c75a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:37.232093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f8cdd901-cbd9-4269-8851-3613a866c75a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:37.239803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f8cdd901-cbd9-4269-8851-3613a866c75a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:37.245996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f8cdd901-cbd9-4269-8851-3613a866c75a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1737 microversion: 2.20 time: 0.420486 Jun 20 07:09:37.246587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 189/377] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:36 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1737 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:37.526401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-efc7d1ee-4bac-4e02-8242-6aaf919b17ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:37.535514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-efc7d1ee-4bac-4e02-8242-6aaf919b17ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.368920 Jun 20 07:09:37.538945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 189/378] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:37 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:37.699044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe71ef44-644e-413a-a937-c8485da01108 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:37.699671 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe71ef44-644e-413a-a937-c8485da01108 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:37.720417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe71ef44-644e-413a-a937-c8485da01108 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:37.720898 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe71ef44-644e-413a-a937-c8485da01108 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:37.721710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe71ef44-644e-413a-a937-c8485da01108 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:37.722157 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe71ef44-644e-413a-a937-c8485da01108 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:37.973921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe71ef44-644e-413a-a937-c8485da01108 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:37.988341 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe71ef44-644e-413a-a937-c8485da01108 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.295514 Jun 20 07:09:37.989218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 190/379] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:37 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:38.037387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-f77c9ef8-5a10-483b-9e5b-4cef775db8a2 req-5625f42c-06af-4cfe-b366-8f927902213f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2be05cc-d645-4d3b-9fcb-dbacd92e2f75", "tag": "f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:38.053391 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f77c9ef8-5a10-483b-9e5b-4cef775db8a2 req-5625f42c-06af-4cfe-b366-8f927902213f service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:38.054701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f77c9ef8-5a10-483b-9e5b-4cef775db8a2 req-5625f42c-06af-4cfe-b366-8f927902213f service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:38.068140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-f77c9ef8-5a10-483b-9e5b-4cef775db8a2 req-5625f42c-06af-4cfe-b366-8f927902213f service nova] Creating event network-changed:f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad for instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 on hv-cinder-77819 Jun 20 07:09:38.074512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-f77c9ef8-5a10-483b-9e5b-4cef775db8a2 req-5625f42c-06af-4cfe-b366-8f927902213f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041797 Jun 20 07:09:38.081558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 190/380] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:38.271765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e1dcf808-0391-4e32-83cc-10473d34d8ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:38.272695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e1dcf808-0391-4e32-83cc-10473d34d8ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:38.280968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1dcf808-0391-4e32-83cc-10473d34d8ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:38.281809 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1dcf808-0391-4e32-83cc-10473d34d8ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:38.282746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1dcf808-0391-4e32-83cc-10473d34d8ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:38.283333 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1dcf808-0391-4e32-83cc-10473d34d8ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:38.517698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e1dcf808-0391-4e32-83cc-10473d34d8ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:38.530998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e1dcf808-0391-4e32-83cc-10473d34d8ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:38.540190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e1dcf808-0391-4e32-83cc-10473d34d8ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:38.542248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e1dcf808-0391-4e32-83cc-10473d34d8ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1737 microversion: 2.20 time: 0.276822 Jun 20 07:09:38.543212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 191/381] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:38 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1737 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:38.556039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b30f4e1e-30d4-4b0e-bf22-5d456a7eace2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:38.556846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b30f4e1e-30d4-4b0e-bf22-5d456a7eace2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:38.570916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b30f4e1e-30d4-4b0e-bf22-5d456a7eace2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:38.571455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b30f4e1e-30d4-4b0e-bf22-5d456a7eace2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:38.572358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b30f4e1e-30d4-4b0e-bf22-5d456a7eace2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:38.572862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b30f4e1e-30d4-4b0e-bf22-5d456a7eace2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:38.793479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b30f4e1e-30d4-4b0e-bf22-5d456a7eace2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:38.803801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b30f4e1e-30d4-4b0e-bf22-5d456a7eace2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.254056 Jun 20 07:09:38.804579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 191/382] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:38 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:39.021830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-57093714-f7f0-47e9-8ee2-d460f137ff6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:39.023095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-57093714-f7f0-47e9-8ee2-d460f137ff6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:39.043927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57093714-f7f0-47e9-8ee2-d460f137ff6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:39.044350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57093714-f7f0-47e9-8ee2-d460f137ff6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:39.045201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57093714-f7f0-47e9-8ee2-d460f137ff6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:39.045661 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57093714-f7f0-47e9-8ee2-d460f137ff6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:39.330891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-57093714-f7f0-47e9-8ee2-d460f137ff6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:39.344388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-57093714-f7f0-47e9-8ee2-d460f137ff6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.342421 Jun 20 07:09:39.345438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 192/383] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:39 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:39.564483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ae7198ad-6232-4d21-98e8-d889af886cf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:39.565069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ae7198ad-6232-4d21-98e8-d889af886cf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:39.572010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae7198ad-6232-4d21-98e8-d889af886cf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:39.572500 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae7198ad-6232-4d21-98e8-d889af886cf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:39.573306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae7198ad-6232-4d21-98e8-d889af886cf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:39.573750 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae7198ad-6232-4d21-98e8-d889af886cf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:39.729540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae7198ad-6232-4d21-98e8-d889af886cf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:39.738979 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae7198ad-6232-4d21-98e8-d889af886cf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:39.740601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae7198ad-6232-4d21-98e8-d889af886cf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:39.741787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ae7198ad-6232-4d21-98e8-d889af886cf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1737 microversion: 2.20 time: 0.181478 Jun 20 07:09:39.742391 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 192/384] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:39 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:39.821951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-daa59fbe-5e99-4f84-a873-6af3c283a818 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:39.822887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-daa59fbe-5e99-4f84-a873-6af3c283a818 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:39.829221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-daa59fbe-5e99-4f84-a873-6af3c283a818 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:39.829678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-daa59fbe-5e99-4f84-a873-6af3c283a818 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:39.830476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-daa59fbe-5e99-4f84-a873-6af3c283a818 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:39.830917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-daa59fbe-5e99-4f84-a873-6af3c283a818 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:39.978531 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-daa59fbe-5e99-4f84-a873-6af3c283a818 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:39.987522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-daa59fbe-5e99-4f84-a873-6af3c283a818 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.170022 Jun 20 07:09:39.988098 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 193/385] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:39 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:40.366771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-32640472-02b3-4444-ad7d-37719d334ad0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:40.367696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-32640472-02b3-4444-ad7d-37719d334ad0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:40.381520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32640472-02b3-4444-ad7d-37719d334ad0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:40.382330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32640472-02b3-4444-ad7d-37719d334ad0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:40.383337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32640472-02b3-4444-ad7d-37719d334ad0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:40.383938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32640472-02b3-4444-ad7d-37719d334ad0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:40.686382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-32640472-02b3-4444-ad7d-37719d334ad0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:40.697999 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-32640472-02b3-4444-ad7d-37719d334ad0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.335019 Jun 20 07:09:40.710375 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 193/386] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:40 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:40.763101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-292feabf-44f7-4e16-bc4c-d548bc2a9d71 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:40.769798 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-292feabf-44f7-4e16-bc4c-d548bc2a9d71 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:40.776455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-292feabf-44f7-4e16-bc4c-d548bc2a9d71 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:40.776907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-292feabf-44f7-4e16-bc4c-d548bc2a9d71 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:40.781568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-292feabf-44f7-4e16-bc4c-d548bc2a9d71 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:40.782032 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-292feabf-44f7-4e16-bc4c-d548bc2a9d71 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:41.007866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-df5c5cac-f045-48e4-bd09-9ccb40a3856d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:41.008673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-df5c5cac-f045-48e4-bd09-9ccb40a3856d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:41.018414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df5c5cac-f045-48e4-bd09-9ccb40a3856d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:41.019119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df5c5cac-f045-48e4-bd09-9ccb40a3856d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:41.020066 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df5c5cac-f045-48e4-bd09-9ccb40a3856d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:41.020524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df5c5cac-f045-48e4-bd09-9ccb40a3856d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:41.036539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-292feabf-44f7-4e16-bc4c-d548bc2a9d71 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:41.053522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-292feabf-44f7-4e16-bc4c-d548bc2a9d71 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:41.059455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-292feabf-44f7-4e16-bc4c-d548bc2a9d71 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:41.061414 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-292feabf-44f7-4e16-bc4c-d548bc2a9d71 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1737 microversion: 2.20 time: 0.302212 Jun 20 07:09:41.062160 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 194/387] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:40 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1737 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:41.435128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-df5c5cac-f045-48e4-bd09-9ccb40a3856d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:41.444730 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-df5c5cac-f045-48e4-bd09-9ccb40a3856d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.444245 Jun 20 07:09:41.454367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 194/388] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:40 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:41.715857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7ec6d355-7780-4428-b67a-de5dc37b6a92 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:41.716583 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7ec6d355-7780-4428-b67a-de5dc37b6a92 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:41.726603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ec6d355-7780-4428-b67a-de5dc37b6a92 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:41.726603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ec6d355-7780-4428-b67a-de5dc37b6a92 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:41.726603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ec6d355-7780-4428-b67a-de5dc37b6a92 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:41.726603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ec6d355-7780-4428-b67a-de5dc37b6a92 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:41.887247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7ec6d355-7780-4428-b67a-de5dc37b6a92 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:41.895947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7ec6d355-7780-4428-b67a-de5dc37b6a92 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.184182 Jun 20 07:09:41.896544 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 195/389] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:42.080232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-38552b81-288f-418e-b193-67421f287f48 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:42.081088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-38552b81-288f-418e-b193-67421f287f48 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:42.088553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-38552b81-288f-418e-b193-67421f287f48 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:42.089258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-38552b81-288f-418e-b193-67421f287f48 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:42.090209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-38552b81-288f-418e-b193-67421f287f48 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:42.090645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-38552b81-288f-418e-b193-67421f287f48 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:42.241385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-38552b81-288f-418e-b193-67421f287f48 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:42.250154 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-38552b81-288f-418e-b193-67421f287f48 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:42.251668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-38552b81-288f-418e-b193-67421f287f48 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:42.253531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-38552b81-288f-418e-b193-67421f287f48 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1737 microversion: 2.20 time: 0.177946 Jun 20 07:09:42.254096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 195/390] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:42.462225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-181ee5cb-172c-4151-99e7-f3f02c324ff6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:42.462775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-181ee5cb-172c-4151-99e7-f3f02c324ff6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:42.470225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-181ee5cb-172c-4151-99e7-f3f02c324ff6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:42.470681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-181ee5cb-172c-4151-99e7-f3f02c324ff6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:42.471463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-181ee5cb-172c-4151-99e7-f3f02c324ff6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:42.471907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-181ee5cb-172c-4151-99e7-f3f02c324ff6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:42.615327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-181ee5cb-172c-4151-99e7-f3f02c324ff6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:42.623374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-181ee5cb-172c-4151-99e7-f3f02c324ff6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.165107 Jun 20 07:09:42.624245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 196/391] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:42 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:42.914925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15311c70-eded-4c23-9bbe-da7098ae5f85 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:42.915624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-15311c70-eded-4c23-9bbe-da7098ae5f85 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:42.924256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15311c70-eded-4c23-9bbe-da7098ae5f85 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:42.924703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15311c70-eded-4c23-9bbe-da7098ae5f85 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:42.925466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15311c70-eded-4c23-9bbe-da7098ae5f85 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:42.925894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15311c70-eded-4c23-9bbe-da7098ae5f85 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:43.088666 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-15311c70-eded-4c23-9bbe-da7098ae5f85 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:43.099067 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-15311c70-eded-4c23-9bbe-da7098ae5f85 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.188850 Jun 20 07:09:43.099841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 196/392] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:42 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:43.272760 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-99fd0ea3-7c20-4b1f-a4c9-69f12c4bb261 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:43.274129 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-99fd0ea3-7c20-4b1f-a4c9-69f12c4bb261 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:43.281007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99fd0ea3-7c20-4b1f-a4c9-69f12c4bb261 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:43.281764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99fd0ea3-7c20-4b1f-a4c9-69f12c4bb261 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:43.282772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99fd0ea3-7c20-4b1f-a4c9-69f12c4bb261 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:43.283274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99fd0ea3-7c20-4b1f-a4c9-69f12c4bb261 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:43.441755 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99fd0ea3-7c20-4b1f-a4c9-69f12c4bb261 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:43.450539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99fd0ea3-7c20-4b1f-a4c9-69f12c4bb261 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:43.452720 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99fd0ea3-7c20-4b1f-a4c9-69f12c4bb261 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:43.454047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-99fd0ea3-7c20-4b1f-a4c9-69f12c4bb261 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1737 microversion: 2.20 time: 0.185223 Jun 20 07:09:43.455060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 197/393] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:43 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:43.643221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3aa27a5d-5a4b-414e-9401-82d17ecfe40f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:43.644220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3aa27a5d-5a4b-414e-9401-82d17ecfe40f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:43.651995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3aa27a5d-5a4b-414e-9401-82d17ecfe40f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:43.652499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3aa27a5d-5a4b-414e-9401-82d17ecfe40f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:43.653277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3aa27a5d-5a4b-414e-9401-82d17ecfe40f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:43.653714 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3aa27a5d-5a4b-414e-9401-82d17ecfe40f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:43.828614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3aa27a5d-5a4b-414e-9401-82d17ecfe40f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:43.837612 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3aa27a5d-5a4b-414e-9401-82d17ecfe40f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.198630 Jun 20 07:09:43.838544 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 197/394] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:43 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:44.116669 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2cde4ad5-e80e-468b-a86b-e3931bcabf3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:44.119482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2cde4ad5-e80e-468b-a86b-e3931bcabf3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:44.124966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cde4ad5-e80e-468b-a86b-e3931bcabf3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:44.125424 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cde4ad5-e80e-468b-a86b-e3931bcabf3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:44.126199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cde4ad5-e80e-468b-a86b-e3931bcabf3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:44.126639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cde4ad5-e80e-468b-a86b-e3931bcabf3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:44.200719 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:44.270628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2cde4ad5-e80e-468b-a86b-e3931bcabf3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:44.280654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2cde4ad5-e80e-468b-a86b-e3931bcabf3c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.166663 Jun 20 07:09:44.282279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 198/395] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:44.472600 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fc750324-75e4-49b7-853f-329fefcfb8a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:44.473916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fc750324-75e4-49b7-853f-329fefcfb8a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:44.476131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:44.479039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=6 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:44.487210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc750324-75e4-49b7-853f-329fefcfb8a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:44.487655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc750324-75e4-49b7-853f-329fefcfb8a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:44.488461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc750324-75e4-49b7-853f-329fefcfb8a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:44.489087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc750324-75e4-49b7-853f-329fefcfb8a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:44.637064 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fc750324-75e4-49b7-853f-329fefcfb8a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:44.647991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fc750324-75e4-49b7-853f-329fefcfb8a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:44.649582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fc750324-75e4-49b7-853f-329fefcfb8a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:44.650909 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fc750324-75e4-49b7-853f-329fefcfb8a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1737 microversion: 2.20 time: 0.182233 Jun 20 07:09:44.652606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 198/396] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:44 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:44.854846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-df37ec8f-0e81-4a33-bdba-cb79800dabda tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:44.855471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-df37ec8f-0e81-4a33-bdba-cb79800dabda tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:44.862811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df37ec8f-0e81-4a33-bdba-cb79800dabda tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:44.863273 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df37ec8f-0e81-4a33-bdba-cb79800dabda tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:44.864055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df37ec8f-0e81-4a33-bdba-cb79800dabda tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:44.864540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df37ec8f-0e81-4a33-bdba-cb79800dabda tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:45.018148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-df37ec8f-0e81-4a33-bdba-cb79800dabda tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:45.026915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-df37ec8f-0e81-4a33-bdba-cb79800dabda tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.176040 Jun 20 07:09:45.027692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 199/397] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:44 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:45.308031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b776330a-6216-4179-9b93-cb24f9156e34 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:45.309047 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b776330a-6216-4179-9b93-cb24f9156e34 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:45.319231 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b776330a-6216-4179-9b93-cb24f9156e34 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:45.319231 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b776330a-6216-4179-9b93-cb24f9156e34 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:45.319590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b776330a-6216-4179-9b93-cb24f9156e34 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:45.319798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b776330a-6216-4179-9b93-cb24f9156e34 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:45.474132 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b776330a-6216-4179-9b93-cb24f9156e34 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:45.486200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b776330a-6216-4179-9b93-cb24f9156e34 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.182574 Jun 20 07:09:45.487338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 199/398] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:45.669857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-48ea50c2-e0a4-4a73-b8ac-a106e8bb363c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:45.670457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-48ea50c2-e0a4-4a73-b8ac-a106e8bb363c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:45.677223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48ea50c2-e0a4-4a73-b8ac-a106e8bb363c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:45.677843 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48ea50c2-e0a4-4a73-b8ac-a106e8bb363c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:45.678997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48ea50c2-e0a4-4a73-b8ac-a106e8bb363c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:45.679561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48ea50c2-e0a4-4a73-b8ac-a106e8bb363c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:45.825941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48ea50c2-e0a4-4a73-b8ac-a106e8bb363c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:45.834695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48ea50c2-e0a4-4a73-b8ac-a106e8bb363c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:45.836274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48ea50c2-e0a4-4a73-b8ac-a106e8bb363c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:45.837428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-48ea50c2-e0a4-4a73-b8ac-a106e8bb363c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1737 microversion: 2.20 time: 0.172450 Jun 20 07:09:45.837987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 200/399] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:45 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:46.059379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c1926f28-64be-408e-b82b-e87cc9447a89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:46.060287 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c1926f28-64be-408e-b82b-e87cc9447a89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:46.070014 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1926f28-64be-408e-b82b-e87cc9447a89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:46.070866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1926f28-64be-408e-b82b-e87cc9447a89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:46.072816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1926f28-64be-408e-b82b-e87cc9447a89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:46.073448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1926f28-64be-408e-b82b-e87cc9447a89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:46.344378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c1926f28-64be-408e-b82b-e87cc9447a89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:46.353647 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c1926f28-64be-408e-b82b-e87cc9447a89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.301141 Jun 20 07:09:46.354753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 200/400] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:46 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:46.503376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cda286f4-8de0-4e39-80db-a709b412435a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:46.504295 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cda286f4-8de0-4e39-80db-a709b412435a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:46.510842 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cda286f4-8de0-4e39-80db-a709b412435a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:46.511397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cda286f4-8de0-4e39-80db-a709b412435a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:46.512306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cda286f4-8de0-4e39-80db-a709b412435a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:46.512843 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cda286f4-8de0-4e39-80db-a709b412435a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:46.655436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cda286f4-8de0-4e39-80db-a709b412435a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:46.663153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cda286f4-8de0-4e39-80db-a709b412435a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.163606 Jun 20 07:09:46.663799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 201/401] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:46.724435 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-726817169", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-278969032", "security_groups": [{"name": "tempest-secgroup-smoke-525829523"}], "block_device_mapping_v2": [{"uuid": "bfa92e81-b67f-42e9-9dcf-be36cf5e05fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ddcb8d3f-44bb-4b92-bea7-7e5055ea63a4"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:46.832353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] validate_networks() for [('ddcb8d3f-44bb-4b92-bea7-7e5055ea63a4', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:09:46.856226 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ea0d3ff6-5a96-4615-8890-6503a2f5f37b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:46.856841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ea0d3ff6-5a96-4615-8890-6503a2f5f37b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:46.863409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea0d3ff6-5a96-4615-8890-6503a2f5f37b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:46.863863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea0d3ff6-5a96-4615-8890-6503a2f5f37b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:46.864659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea0d3ff6-5a96-4615-8890-6503a2f5f37b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:46.865099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea0d3ff6-5a96-4615-8890-6503a2f5f37b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:47.063673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ea0d3ff6-5a96-4615-8890-6503a2f5f37b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:47.071747 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ea0d3ff6-5a96-4615-8890-6503a2f5f37b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:47.073495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ea0d3ff6-5a96-4615-8890-6503a2f5f37b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:47.074676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ea0d3ff6-5a96-4615-8890-6503a2f5f37b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1737 microversion: 2.20 time: 0.222383 Jun 20 07:09:47.075247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 202/402] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:46 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:09:47.257517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:09:47.257930 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:09:47.258395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:09:47.258793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:09:47.259193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:09:47.268889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:47.269332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:47.270122 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:47.270552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:47.287318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Getting quotas for project f5a98ee7cefc4c759c846f6cacb646a8. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:09:47.291323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Getting quotas for user 1404717904a14000a11f06c6c8291105 and project f5a98ee7cefc4c759c846f6cacb646a8. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:09:47.347144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:09:47.349238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bfa92e81-b67f-42e9-9dcf-be36cf5e05fa',volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:09:47.370533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9017f11b-bb07-4f80-a8ca-71a4833215c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:47.371156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9017f11b-bb07-4f80-a8ca-71a4833215c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:47.377776 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9017f11b-bb07-4f80-a8ca-71a4833215c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:47.378232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9017f11b-bb07-4f80-a8ca-71a4833215c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:47.379031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9017f11b-bb07-4f80-a8ca-71a4833215c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:47.379477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9017f11b-bb07-4f80-a8ca-71a4833215c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:47.479077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-088b741e-6b74-4b78-8dd7-49c4f2a65e72 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.758497 Jun 20 07:09:47.479992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 201/403] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:09:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:09:47.504321 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0e3d783-639d-434b-9a6f-403c69bf9569 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:47.505558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c0e3d783-639d-434b-9a6f-403c69bf9569 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:47.541990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9017f11b-bb07-4f80-a8ca-71a4833215c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:47.554589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9017f11b-bb07-4f80-a8ca-71a4833215c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.187490 Jun 20 07:09:47.555347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 203/404] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:47 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:47.587897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c0e3d783-639d-434b-9a6f-403c69bf9569 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:47.595936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c0e3d783-639d-434b-9a6f-403c69bf9569 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1093 microversion: 2.1 time: 0.106071 Jun 20 07:09:47.596553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 202/405] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:47 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1093 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:47.679601 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c7cc0b9b-3eb9-490a-95cd-36c2e448dcdd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:47.680243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c7cc0b9b-3eb9-490a-95cd-36c2e448dcdd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:47.687691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7cc0b9b-3eb9-490a-95cd-36c2e448dcdd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:47.688174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7cc0b9b-3eb9-490a-95cd-36c2e448dcdd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:47.688954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7cc0b9b-3eb9-490a-95cd-36c2e448dcdd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:47.689397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7cc0b9b-3eb9-490a-95cd-36c2e448dcdd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:47.825995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c7cc0b9b-3eb9-490a-95cd-36c2e448dcdd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:47.829555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:47.835343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c7cc0b9b-3eb9-490a-95cd-36c2e448dcdd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.159433 Jun 20 07:09:47.836045 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 204/406] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:47 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:47.861702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-0e99ccf2-8f5b-4bf0-bbed-47237489fc4f req-a5c1356a-a3cc-4c15-8825-d3b7d1ea8e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2be05cc-d645-4d3b-9fcb-dbacd92e2f75", "name": "network-vif-plugged", "status": "completed", "tag": "f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:47.870983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-0e99ccf2-8f5b-4bf0-bbed-47237489fc4f req-a5c1356a-a3cc-4c15-8825-d3b7d1ea8e3c service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:47.871519 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-0e99ccf2-8f5b-4bf0-bbed-47237489fc4f req-a5c1356a-a3cc-4c15-8825-d3b7d1ea8e3c service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:47.884053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-0e99ccf2-8f5b-4bf0-bbed-47237489fc4f req-a5c1356a-a3cc-4c15-8825-d3b7d1ea8e3c service nova] Creating event network-vif-plugged:f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad for instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 on hv-cinder-77819 Jun 20 07:09:47.889133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-0e99ccf2-8f5b-4bf0-bbed-47237489fc4f req-a5c1356a-a3cc-4c15-8825-d3b7d1ea8e3c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032028 Jun 20 07:09:47.889735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 203/407] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:48.094921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a0d267e2-96c1-4046-ac1f-42b30b95c81f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:48.095455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a0d267e2-96c1-4046-ac1f-42b30b95c81f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:48.102159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0d267e2-96c1-4046-ac1f-42b30b95c81f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:48.102607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0d267e2-96c1-4046-ac1f-42b30b95c81f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:48.103365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0d267e2-96c1-4046-ac1f-42b30b95c81f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:48.103798 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0d267e2-96c1-4046-ac1f-42b30b95c81f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:48.232271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a0d267e2-96c1-4046-ac1f-42b30b95c81f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:48.239973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a0d267e2-96c1-4046-ac1f-42b30b95c81f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:48.241484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a0d267e2-96c1-4046-ac1f-42b30b95c81f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:48.242630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a0d267e2-96c1-4046-ac1f-42b30b95c81f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1737 microversion: 2.20 time: 0.153021 Jun 20 07:09:48.243183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 205/408] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:48 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:48.572933 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-03ad2255-4623-4953-80ea-5ec07c7e08e3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:48.573625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-03ad2255-4623-4953-80ea-5ec07c7e08e3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:48.580521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03ad2255-4623-4953-80ea-5ec07c7e08e3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:48.580971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03ad2255-4623-4953-80ea-5ec07c7e08e3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:48.581721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03ad2255-4623-4953-80ea-5ec07c7e08e3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:48.582152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03ad2255-4623-4953-80ea-5ec07c7e08e3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:48.613194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca727327-0221-4524-b4dc-4907adf0a46e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:48.613930 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca727327-0221-4524-b4dc-4907adf0a46e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:48.619975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca727327-0221-4524-b4dc-4907adf0a46e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:48.620462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca727327-0221-4524-b4dc-4907adf0a46e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:48.621231 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca727327-0221-4524-b4dc-4907adf0a46e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:48.621677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca727327-0221-4524-b4dc-4907adf0a46e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:48.698821 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca727327-0221-4524-b4dc-4907adf0a46e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:48.707268 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca727327-0221-4524-b4dc-4907adf0a46e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1143 microversion: 2.1 time: 0.097983 Jun 20 07:09:48.708182 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 206/409] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:48 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1143 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:48.729420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-03ad2255-4623-4953-80ea-5ec07c7e08e3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:48.738353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-03ad2255-4623-4953-80ea-5ec07c7e08e3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.169589 Jun 20 07:09:48.738928 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 204/410] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:48 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:48.853311 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-908fa3e2-421b-44c5-94b0-6daa184ee8a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:48.853894 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-908fa3e2-421b-44c5-94b0-6daa184ee8a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:48.859860 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-908fa3e2-421b-44c5-94b0-6daa184ee8a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:48.860347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-908fa3e2-421b-44c5-94b0-6daa184ee8a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:48.861111 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-908fa3e2-421b-44c5-94b0-6daa184ee8a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:48.861551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-908fa3e2-421b-44c5-94b0-6daa184ee8a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:48.992522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-908fa3e2-421b-44c5-94b0-6daa184ee8a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:49.000423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-908fa3e2-421b-44c5-94b0-6daa184ee8a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.150969 Jun 20 07:09:49.000978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 207/411] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:48 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:49.260592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d3176ca1-c3a8-4430-8ac8-1abf2077185d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:49.261189 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d3176ca1-c3a8-4430-8ac8-1abf2077185d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:49.268452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3176ca1-c3a8-4430-8ac8-1abf2077185d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:49.268891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3176ca1-c3a8-4430-8ac8-1abf2077185d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:49.269639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3176ca1-c3a8-4430-8ac8-1abf2077185d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:49.270067 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3176ca1-c3a8-4430-8ac8-1abf2077185d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:49.273939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:49.399740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d3176ca1-c3a8-4430-8ac8-1abf2077185d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:49.407555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d3176ca1-c3a8-4430-8ac8-1abf2077185d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:49.409095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d3176ca1-c3a8-4430-8ac8-1abf2077185d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:49.410282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d3176ca1-c3a8-4430-8ac8-1abf2077185d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1737 microversion: 2.20 time: 0.153468 Jun 20 07:09:49.410847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 205/412] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:49 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:49.724738 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8823bba8-2c24-4bd8-b2ae-15ccde2ba045 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:49.725371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8823bba8-2c24-4bd8-b2ae-15ccde2ba045 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:49.731863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8823bba8-2c24-4bd8-b2ae-15ccde2ba045 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:49.732865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8823bba8-2c24-4bd8-b2ae-15ccde2ba045 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:49.733640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8823bba8-2c24-4bd8-b2ae-15ccde2ba045 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:49.734081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8823bba8-2c24-4bd8-b2ae-15ccde2ba045 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:49.755324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0237b7bb-accb-4da9-9833-0d31628a1c99 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:49.755846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0237b7bb-accb-4da9-9833-0d31628a1c99 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:49.762325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0237b7bb-accb-4da9-9833-0d31628a1c99 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:49.762983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0237b7bb-accb-4da9-9833-0d31628a1c99 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:49.763899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0237b7bb-accb-4da9-9833-0d31628a1c99 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:49.764506 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0237b7bb-accb-4da9-9833-0d31628a1c99 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:49.818710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8823bba8-2c24-4bd8-b2ae-15ccde2ba045 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:49.826581 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8823bba8-2c24-4bd8-b2ae-15ccde2ba045 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1135 microversion: 2.1 time: 0.106163 Jun 20 07:09:49.827964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 208/413] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:49 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1135 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:49.914057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0237b7bb-accb-4da9-9833-0d31628a1c99 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:49.922628 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0237b7bb-accb-4da9-9833-0d31628a1c99 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.171400 Jun 20 07:09:49.923189 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 206/414] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:49 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:50.018817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca9d414c-1f56-4833-8048-4fbab8d8899b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:50.019441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca9d414c-1f56-4833-8048-4fbab8d8899b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:50.026290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca9d414c-1f56-4833-8048-4fbab8d8899b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:50.026823 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca9d414c-1f56-4833-8048-4fbab8d8899b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:50.027594 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca9d414c-1f56-4833-8048-4fbab8d8899b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:50.028068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca9d414c-1f56-4833-8048-4fbab8d8899b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:50.191578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca9d414c-1f56-4833-8048-4fbab8d8899b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:50.198950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca9d414c-1f56-4833-8048-4fbab8d8899b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.185417 Jun 20 07:09:50.199542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 209/415] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:50.428381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ae47471e-d8d8-4c5e-bb1e-9b459857cb60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:50.428993 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ae47471e-d8d8-4c5e-bb1e-9b459857cb60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:50.431249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:50.437176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae47471e-d8d8-4c5e-bb1e-9b459857cb60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:50.437621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae47471e-d8d8-4c5e-bb1e-9b459857cb60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:50.438411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae47471e-d8d8-4c5e-bb1e-9b459857cb60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:50.438841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae47471e-d8d8-4c5e-bb1e-9b459857cb60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:50.580208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae47471e-d8d8-4c5e-bb1e-9b459857cb60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:50.588196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae47471e-d8d8-4c5e-bb1e-9b459857cb60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:50.589695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae47471e-d8d8-4c5e-bb1e-9b459857cb60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:50.590841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ae47471e-d8d8-4c5e-bb1e-9b459857cb60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1719 microversion: 2.20 time: 0.166366 Jun 20 07:09:50.591437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 207/416] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:50 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:50.845014 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-df128078-0b32-44b2-a1ed-ffbbdb7ffaf1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:50.845626 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-df128078-0b32-44b2-a1ed-ffbbdb7ffaf1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:50.852000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df128078-0b32-44b2-a1ed-ffbbdb7ffaf1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:50.852485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df128078-0b32-44b2-a1ed-ffbbdb7ffaf1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:50.853382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df128078-0b32-44b2-a1ed-ffbbdb7ffaf1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:50.853687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df128078-0b32-44b2-a1ed-ffbbdb7ffaf1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:50.916507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-df128078-0b32-44b2-a1ed-ffbbdb7ffaf1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:50.925232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-df128078-0b32-44b2-a1ed-ffbbdb7ffaf1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1191 microversion: 2.1 time: 0.084596 Jun 20 07:09:50.925948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 210/417] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:50 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:50.938790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-768469b7-a09e-4e2b-879f-ab0a6b85d933 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:50.939516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-768469b7-a09e-4e2b-879f-ab0a6b85d933 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:50.945434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-768469b7-a09e-4e2b-879f-ab0a6b85d933 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:50.945885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-768469b7-a09e-4e2b-879f-ab0a6b85d933 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:50.946642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-768469b7-a09e-4e2b-879f-ab0a6b85d933 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:50.947080 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-768469b7-a09e-4e2b-879f-ab0a6b85d933 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:51.074178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-768469b7-a09e-4e2b-879f-ab0a6b85d933 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:51.081977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-768469b7-a09e-4e2b-879f-ab0a6b85d933 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.146997 Jun 20 07:09:51.082543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 208/418] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:50 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:51.217437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e8ee3da8-0b0d-4902-a175-341c40003f53 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:51.218051 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e8ee3da8-0b0d-4902-a175-341c40003f53 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:51.224011 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8ee3da8-0b0d-4902-a175-341c40003f53 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:51.224497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8ee3da8-0b0d-4902-a175-341c40003f53 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:51.225264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8ee3da8-0b0d-4902-a175-341c40003f53 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:51.225710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8ee3da8-0b0d-4902-a175-341c40003f53 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:51.350961 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e8ee3da8-0b0d-4902-a175-341c40003f53 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:51.358753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e8ee3da8-0b0d-4902-a175-341c40003f53 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.145760 Jun 20 07:09:51.359302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 211/419] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:51.609146 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-36066380-a6f6-48fb-a3e7-197564a0b8dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:51.609787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-36066380-a6f6-48fb-a3e7-197564a0b8dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:51.616242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36066380-a6f6-48fb-a3e7-197564a0b8dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:51.616695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36066380-a6f6-48fb-a3e7-197564a0b8dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:51.617454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36066380-a6f6-48fb-a3e7-197564a0b8dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:51.617892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36066380-a6f6-48fb-a3e7-197564a0b8dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:51.744687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36066380-a6f6-48fb-a3e7-197564a0b8dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:51.752513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36066380-a6f6-48fb-a3e7-197564a0b8dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:51.754026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36066380-a6f6-48fb-a3e7-197564a0b8dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:51.755163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-36066380-a6f6-48fb-a3e7-197564a0b8dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1719 microversion: 2.20 time: 0.150548 Jun 20 07:09:51.755718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 209/420] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:51 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:51.941907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7e1ffc74-f799-47a0-8c5d-0366d98c5e4e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:51.942522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7e1ffc74-f799-47a0-8c5d-0366d98c5e4e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:51.949190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e1ffc74-f799-47a0-8c5d-0366d98c5e4e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:51.949544 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e1ffc74-f799-47a0-8c5d-0366d98c5e4e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:51.950307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e1ffc74-f799-47a0-8c5d-0366d98c5e4e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:51.951245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e1ffc74-f799-47a0-8c5d-0366d98c5e4e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:52.010598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7e1ffc74-f799-47a0-8c5d-0366d98c5e4e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:52.018746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7e1ffc74-f799-47a0-8c5d-0366d98c5e4e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1191 microversion: 2.1 time: 0.080705 Jun 20 07:09:52.019301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 212/421] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:51 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:52.098463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f300d8b3-becb-49d7-b548-03b080e7386f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:52.099205 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f300d8b3-becb-49d7-b548-03b080e7386f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:52.105197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f300d8b3-becb-49d7-b548-03b080e7386f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:52.105644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f300d8b3-becb-49d7-b548-03b080e7386f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:52.106400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f300d8b3-becb-49d7-b548-03b080e7386f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:52.106836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f300d8b3-becb-49d7-b548-03b080e7386f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:52.230207 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f300d8b3-becb-49d7-b548-03b080e7386f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:52.238044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f300d8b3-becb-49d7-b548-03b080e7386f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.143346 Jun 20 07:09:52.238609 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 210/422] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:52 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:52.375688 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e0978421-6bb6-4a0c-b5bd-8b50f526066b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:52.376339 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e0978421-6bb6-4a0c-b5bd-8b50f526066b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:52.382278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0978421-6bb6-4a0c-b5bd-8b50f526066b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:52.382728 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0978421-6bb6-4a0c-b5bd-8b50f526066b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:52.383486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0978421-6bb6-4a0c-b5bd-8b50f526066b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:52.383926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0978421-6bb6-4a0c-b5bd-8b50f526066b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:52.510400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0978421-6bb6-4a0c-b5bd-8b50f526066b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:52.518403 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e0978421-6bb6-4a0c-b5bd-8b50f526066b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.147073 Jun 20 07:09:52.518968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 213/423] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:52.773654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e1a07dc4-ef33-48f7-9324-78e66468429d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:52.774267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e1a07dc4-ef33-48f7-9324-78e66468429d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:52.780798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1a07dc4-ef33-48f7-9324-78e66468429d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:52.781245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1a07dc4-ef33-48f7-9324-78e66468429d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:52.782004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1a07dc4-ef33-48f7-9324-78e66468429d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:52.782439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1a07dc4-ef33-48f7-9324-78e66468429d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:52.914797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e1a07dc4-ef33-48f7-9324-78e66468429d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:52.923093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e1a07dc4-ef33-48f7-9324-78e66468429d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:52.924629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e1a07dc4-ef33-48f7-9324-78e66468429d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:52.925780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e1a07dc4-ef33-48f7-9324-78e66468429d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1719 microversion: 2.20 time: 0.156085 Jun 20 07:09:52.926333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 211/424] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:52 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:53.035391 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6ab9aebd-308f-42e2-b43a-c58a94de2b51 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:53.036087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6ab9aebd-308f-42e2-b43a-c58a94de2b51 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:53.042564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ab9aebd-308f-42e2-b43a-c58a94de2b51 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:53.043024 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ab9aebd-308f-42e2-b43a-c58a94de2b51 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:53.043796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ab9aebd-308f-42e2-b43a-c58a94de2b51 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:53.044264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ab9aebd-308f-42e2-b43a-c58a94de2b51 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:53.108016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ab9aebd-308f-42e2-b43a-c58a94de2b51 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:53.115354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6ab9aebd-308f-42e2-b43a-c58a94de2b51 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1191 microversion: 2.1 time: 0.084087 Jun 20 07:09:53.115912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 214/425] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:53 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:53.254934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d73b2afe-7d1e-42ef-98d5-ec5bee778a34 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:53.255540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d73b2afe-7d1e-42ef-98d5-ec5bee778a34 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:53.261592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d73b2afe-7d1e-42ef-98d5-ec5bee778a34 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:53.262042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d73b2afe-7d1e-42ef-98d5-ec5bee778a34 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:53.262805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d73b2afe-7d1e-42ef-98d5-ec5bee778a34 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:53.263307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d73b2afe-7d1e-42ef-98d5-ec5bee778a34 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:53.391382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d73b2afe-7d1e-42ef-98d5-ec5bee778a34 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:53.399505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d73b2afe-7d1e-42ef-98d5-ec5bee778a34 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.148426 Jun 20 07:09:53.400066 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 212/426] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:53 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:53.535644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e24be54b-ddf8-40e5-a6dd-48dd0e48b895 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:53.536294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e24be54b-ddf8-40e5-a6dd-48dd0e48b895 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:53.538168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:53.544271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e24be54b-ddf8-40e5-a6dd-48dd0e48b895 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:53.544768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e24be54b-ddf8-40e5-a6dd-48dd0e48b895 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:53.545481 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e24be54b-ddf8-40e5-a6dd-48dd0e48b895 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:53.545925 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e24be54b-ddf8-40e5-a6dd-48dd0e48b895 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:53.671421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e24be54b-ddf8-40e5-a6dd-48dd0e48b895 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:53.678743 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e24be54b-ddf8-40e5-a6dd-48dd0e48b895 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.147011 Jun 20 07:09:53.679296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 215/427] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:53.945022 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0506d1f3-e5b8-45d2-a171-d56726166181 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:53.945563 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0506d1f3-e5b8-45d2-a171-d56726166181 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:53.952570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0506d1f3-e5b8-45d2-a171-d56726166181 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:53.953011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0506d1f3-e5b8-45d2-a171-d56726166181 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:53.953757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0506d1f3-e5b8-45d2-a171-d56726166181 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:53.954189 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0506d1f3-e5b8-45d2-a171-d56726166181 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:54.088521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0506d1f3-e5b8-45d2-a171-d56726166181 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:54.096524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0506d1f3-e5b8-45d2-a171-d56726166181 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:54.098013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0506d1f3-e5b8-45d2-a171-d56726166181 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:54.099151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0506d1f3-e5b8-45d2-a171-d56726166181 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1719 microversion: 2.20 time: 0.158184 Jun 20 07:09:54.099698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 213/428] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:53 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:54.132013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7fa11f2f-7596-4caa-9afa-3dec5e78b13d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:54.132815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7fa11f2f-7596-4caa-9afa-3dec5e78b13d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:54.140075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fa11f2f-7596-4caa-9afa-3dec5e78b13d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:54.140601 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fa11f2f-7596-4caa-9afa-3dec5e78b13d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:54.141392 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fa11f2f-7596-4caa-9afa-3dec5e78b13d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:54.141982 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fa11f2f-7596-4caa-9afa-3dec5e78b13d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:54.223184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7fa11f2f-7596-4caa-9afa-3dec5e78b13d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:54.230847 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7fa11f2f-7596-4caa-9afa-3dec5e78b13d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1191 microversion: 2.1 time: 0.102709 Jun 20 07:09:54.231486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 216/429] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:54 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1191 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:54.417083 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-af89df1a-9a4a-44c5-8df6-09f84e2334ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:54.417683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-af89df1a-9a4a-44c5-8df6-09f84e2334ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:54.424084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af89df1a-9a4a-44c5-8df6-09f84e2334ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:54.424550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af89df1a-9a4a-44c5-8df6-09f84e2334ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:54.425296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af89df1a-9a4a-44c5-8df6-09f84e2334ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:54.425725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af89df1a-9a4a-44c5-8df6-09f84e2334ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:54.552382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-af89df1a-9a4a-44c5-8df6-09f84e2334ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:54.560707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-af89df1a-9a4a-44c5-8df6-09f84e2334ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.147358 Jun 20 07:09:54.561418 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 214/430] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:54 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:54.694628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b3673740-9622-4016-9209-ed38fc776d91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:54.695209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b3673740-9622-4016-9209-ed38fc776d91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:54.710705 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3673740-9622-4016-9209-ed38fc776d91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:54.711915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3673740-9622-4016-9209-ed38fc776d91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:54.713131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3673740-9622-4016-9209-ed38fc776d91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:54.714388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3673740-9622-4016-9209-ed38fc776d91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:54.854671 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b3673740-9622-4016-9209-ed38fc776d91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:54.865629 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b3673740-9622-4016-9209-ed38fc776d91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1370 microversion: 2.1 time: 0.174572 Jun 20 07:09:54.868152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 217/431] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:54 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:55.032523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-39346fd7-7d3c-49eb-96fa-c58d02d267ce req-736f61f4-2153-4725-920f-ce5e0f23e5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e214060-f046-41a1-b243-020c88edde42", "name": "network-vif-unplugged", "status": "completed", "tag": "316c2317-90c4-4b27-bb5e-34a3153b065e"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:55.042264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-39346fd7-7d3c-49eb-96fa-c58d02d267ce req-736f61f4-2153-4725-920f-ce5e0f23e5bb service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:55.042796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-39346fd7-7d3c-49eb-96fa-c58d02d267ce req-736f61f4-2153-4725-920f-ce5e0f23e5bb service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:55.053995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-39346fd7-7d3c-49eb-96fa-c58d02d267ce req-736f61f4-2153-4725-920f-ce5e0f23e5bb service nova] Creating event network-vif-unplugged:316c2317-90c4-4b27-bb5e-34a3153b065e for instance 0e214060-f046-41a1-b243-020c88edde42 on hv-cinder-77819 Jun 20 07:09:55.059065 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-39346fd7-7d3c-49eb-96fa-c58d02d267ce req-736f61f4-2153-4725-920f-ce5e0f23e5bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031499 Jun 20 07:09:55.059650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 215/432] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:55.117843 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a0d1371c-81fc-49a5-9dae-6649304b95bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:55.118464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a0d1371c-81fc-49a5-9dae-6649304b95bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:55.125173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0d1371c-81fc-49a5-9dae-6649304b95bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:55.125621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0d1371c-81fc-49a5-9dae-6649304b95bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:55.126380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0d1371c-81fc-49a5-9dae-6649304b95bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:55.126816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0d1371c-81fc-49a5-9dae-6649304b95bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:55.250796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7932586d-e547-462d-939b-5cede13e94a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:55.251635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7932586d-e547-462d-939b-5cede13e94a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:55.258497 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7932586d-e547-462d-939b-5cede13e94a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:55.258949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7932586d-e547-462d-939b-5cede13e94a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:55.259723 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7932586d-e547-462d-939b-5cede13e94a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:55.260227 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7932586d-e547-462d-939b-5cede13e94a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:55.264242 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a0d1371c-81fc-49a5-9dae-6649304b95bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:55.273370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a0d1371c-81fc-49a5-9dae-6649304b95bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:55.275435 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a0d1371c-81fc-49a5-9dae-6649304b95bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:55.276817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a0d1371c-81fc-49a5-9dae-6649304b95bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1719 microversion: 2.20 time: 0.163078 Jun 20 07:09:55.277734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 218/433] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:55 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:55.323384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7932586d-e547-462d-939b-5cede13e94a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:55.330942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7932586d-e547-462d-939b-5cede13e94a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1209 microversion: 2.1 time: 0.084981 Jun 20 07:09:55.331382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 216/434] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:55 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:55.578247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-70f9cc72-c9ca-4482-8453-61b82dcecbd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:55.578865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-70f9cc72-c9ca-4482-8453-61b82dcecbd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:55.584936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70f9cc72-c9ca-4482-8453-61b82dcecbd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:55.585383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70f9cc72-c9ca-4482-8453-61b82dcecbd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:55.586314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70f9cc72-c9ca-4482-8453-61b82dcecbd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:55.586757 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70f9cc72-c9ca-4482-8453-61b82dcecbd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:55.719545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-70f9cc72-c9ca-4482-8453-61b82dcecbd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:55.728922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-70f9cc72-c9ca-4482-8453-61b82dcecbd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.155042 Jun 20 07:09:55.729612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 219/435] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:55 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:55.882777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-88ddae41-94d2-42ec-a77f-5b0f310910dc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:55.883668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-88ddae41-94d2-42ec-a77f-5b0f310910dc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:55.889921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88ddae41-94d2-42ec-a77f-5b0f310910dc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:55.890382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88ddae41-94d2-42ec-a77f-5b0f310910dc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:55.891157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88ddae41-94d2-42ec-a77f-5b0f310910dc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:55.891597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88ddae41-94d2-42ec-a77f-5b0f310910dc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:56.031430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-88ddae41-94d2-42ec-a77f-5b0f310910dc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:56.039696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-88ddae41-94d2-42ec-a77f-5b0f310910dc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1564 microversion: 2.1 time: 0.160837 Jun 20 07:09:56.040698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 217/436] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:55 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:56.056727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f6694518-0522-4623-8cb2-394ba6331376 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:56.057226 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f6694518-0522-4623-8cb2-394ba6331376 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:56.065489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6694518-0522-4623-8cb2-394ba6331376 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:56.065489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6694518-0522-4623-8cb2-394ba6331376 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:56.065489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6694518-0522-4623-8cb2-394ba6331376 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:56.065489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6694518-0522-4623-8cb2-394ba6331376 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:56.142891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f6694518-0522-4623-8cb2-394ba6331376 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090005 Jun 20 07:09:56.143492 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 220/437] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 07:09:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:56.296745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-670c08b6-f046-4d6d-9436-10e16fb63b92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:56.297350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-670c08b6-f046-4d6d-9436-10e16fb63b92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:56.304302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-670c08b6-f046-4d6d-9436-10e16fb63b92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:56.304760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-670c08b6-f046-4d6d-9436-10e16fb63b92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:56.305532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-670c08b6-f046-4d6d-9436-10e16fb63b92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:56.305966 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-670c08b6-f046-4d6d-9436-10e16fb63b92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:56.347735 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8bda4f4c-952d-483a-9aa8-2530eec40a19 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:56.348795 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8bda4f4c-952d-483a-9aa8-2530eec40a19 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:56.354892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bda4f4c-952d-483a-9aa8-2530eec40a19 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:56.355340 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bda4f4c-952d-483a-9aa8-2530eec40a19 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:56.356329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bda4f4c-952d-483a-9aa8-2530eec40a19 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:56.356768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8bda4f4c-952d-483a-9aa8-2530eec40a19 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:56.443678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8bda4f4c-952d-483a-9aa8-2530eec40a19 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:56.447944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:56.455034 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8bda4f4c-952d-483a-9aa8-2530eec40a19 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1209 microversion: 2.1 time: 0.111643 Jun 20 07:09:56.464467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 221/438] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:56 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:09:56.529649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-670c08b6-f046-4d6d-9436-10e16fb63b92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:56.538033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-670c08b6-f046-4d6d-9436-10e16fb63b92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:56.539863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-670c08b6-f046-4d6d-9436-10e16fb63b92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:56.542113 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-670c08b6-f046-4d6d-9436-10e16fb63b92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1719 microversion: 2.20 time: 0.250070 Jun 20 07:09:56.552448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 218/439] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:56 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1719 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:09:56.748123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7a81510-6414-4a57-9017-03d270d5c852 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:56.749075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7a81510-6414-4a57-9017-03d270d5c852 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:56.756328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7a81510-6414-4a57-9017-03d270d5c852 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:56.757004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7a81510-6414-4a57-9017-03d270d5c852 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:56.758182 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7a81510-6414-4a57-9017-03d270d5c852 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:56.758878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7a81510-6414-4a57-9017-03d270d5c852 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:56.909102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7a81510-6414-4a57-9017-03d270d5c852 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:56.917742 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7a81510-6414-4a57-9017-03d270d5c852 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.174596 Jun 20 07:09:56.918546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 222/440] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:56 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:57.133905 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-9e148798-343a-42ab-9d6c-15cdaac1b230 req-b004bf84-de84-429b-a5a0-4589c206eae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2be05cc-d645-4d3b-9fcb-dbacd92e2f75", "tag": "f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:57.145293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-9e148798-343a-42ab-9d6c-15cdaac1b230 req-b004bf84-de84-429b-a5a0-4589c206eae3 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:57.146102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-9e148798-343a-42ab-9d6c-15cdaac1b230 req-b004bf84-de84-429b-a5a0-4589c206eae3 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:57.164749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-9e148798-343a-42ab-9d6c-15cdaac1b230 req-b004bf84-de84-429b-a5a0-4589c206eae3 service nova] Creating event network-changed:f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad for instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 on hv-cinder-77819 Jun 20 07:09:57.170990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-9e148798-343a-42ab-9d6c-15cdaac1b230 req-b004bf84-de84-429b-a5a0-4589c206eae3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041434 Jun 20 07:09:57.171587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 219/441] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:09:57.472695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-923e58ff-7f8c-40ed-80f8-3fd3d2f50875 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:57.473312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-923e58ff-7f8c-40ed-80f8-3fd3d2f50875 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:57.482966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-923e58ff-7f8c-40ed-80f8-3fd3d2f50875 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:57.483407 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-923e58ff-7f8c-40ed-80f8-3fd3d2f50875 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:57.484199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-923e58ff-7f8c-40ed-80f8-3fd3d2f50875 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:57.484849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-923e58ff-7f8c-40ed-80f8-3fd3d2f50875 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:57.553249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-923e58ff-7f8c-40ed-80f8-3fd3d2f50875 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:57.558542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:57.563339 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ca9f9a82-1a2d-4416-b419-7ce84dcf760c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:57.564206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ca9f9a82-1a2d-4416-b419-7ce84dcf760c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:57.575290 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca9f9a82-1a2d-4416-b419-7ce84dcf760c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:57.575777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca9f9a82-1a2d-4416-b419-7ce84dcf760c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:57.577693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-923e58ff-7f8c-40ed-80f8-3fd3d2f50875 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1209 microversion: 2.1 time: 0.109492 Jun 20 07:09:57.578915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca9f9a82-1a2d-4416-b419-7ce84dcf760c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:57.579344 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca9f9a82-1a2d-4416-b419-7ce84dcf760c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:57.580694 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 223/442] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:57 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:57.598973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=8 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:57.728203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca9f9a82-1a2d-4416-b419-7ce84dcf760c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:57.737036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca9f9a82-1a2d-4416-b419-7ce84dcf760c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:57.738584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca9f9a82-1a2d-4416-b419-7ce84dcf760c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:57.739805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ca9f9a82-1a2d-4416-b419-7ce84dcf760c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1719 microversion: 2.20 time: 0.182153 Jun 20 07:09:57.740607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 220/443] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:57 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:09:57.935680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-afa6c148-e232-4fd6-b481-6317e32a0b17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:57.936458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-afa6c148-e232-4fd6-b481-6317e32a0b17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:57.942906 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afa6c148-e232-4fd6-b481-6317e32a0b17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:57.943482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afa6c148-e232-4fd6-b481-6317e32a0b17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:57.944734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afa6c148-e232-4fd6-b481-6317e32a0b17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:57.945687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afa6c148-e232-4fd6-b481-6317e32a0b17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:58.104668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-afa6c148-e232-4fd6-b481-6317e32a0b17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:58.117165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-afa6c148-e232-4fd6-b481-6317e32a0b17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1722 microversion: 2.1 time: 0.186230 Jun 20 07:09:58.123137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 224/444] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:57 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:58.594579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0cf4d881-538b-4932-b001-eca071b7e92c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:58.595778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0cf4d881-538b-4932-b001-eca071b7e92c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:58.605820 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cf4d881-538b-4932-b001-eca071b7e92c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:58.606301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cf4d881-538b-4932-b001-eca071b7e92c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:58.609177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cf4d881-538b-4932-b001-eca071b7e92c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:58.609525 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cf4d881-538b-4932-b001-eca071b7e92c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:58.717807 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0cf4d881-538b-4932-b001-eca071b7e92c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:58.727842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0cf4d881-538b-4932-b001-eca071b7e92c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1209 microversion: 2.1 time: 0.137049 Jun 20 07:09:58.728716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 221/445] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:58 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1209 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:58.758766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ead94942-d150-46a0-b940-019ebd29534b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:58.759485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ead94942-d150-46a0-b940-019ebd29534b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:58.766561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ead94942-d150-46a0-b940-019ebd29534b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:58.767272 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ead94942-d150-46a0-b940-019ebd29534b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:58.768036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ead94942-d150-46a0-b940-019ebd29534b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:58.768489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ead94942-d150-46a0-b940-019ebd29534b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:58.916090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ead94942-d150-46a0-b940-019ebd29534b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:58.926536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ead94942-d150-46a0-b940-019ebd29534b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:58.928587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ead94942-d150-46a0-b940-019ebd29534b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:58.929854 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ead94942-d150-46a0-b940-019ebd29534b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1719 microversion: 2.20 time: 0.175158 Jun 20 07:09:58.930636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 225/446] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:58 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:09:59.140708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9c30f665-56c9-44c2-99f9-3c5581161b57 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:59.141638 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9c30f665-56c9-44c2-99f9-3c5581161b57 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:59.149633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c30f665-56c9-44c2-99f9-3c5581161b57 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:59.150680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c30f665-56c9-44c2-99f9-3c5581161b57 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:59.151681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c30f665-56c9-44c2-99f9-3c5581161b57 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:59.152614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9c30f665-56c9-44c2-99f9-3c5581161b57 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:59.351399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9c30f665-56c9-44c2-99f9-3c5581161b57 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:59.360802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9c30f665-56c9-44c2-99f9-3c5581161b57 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1699 microversion: 2.1 time: 0.225561 Jun 20 07:09:59.371959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 222/447] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:59 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1699 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:59.378721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0c0d58ba-2e55-45f1-9601-0e2d06d7620a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:09:59.385669 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c0d58ba-2e55-45f1-9601-0e2d06d7620a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:59.386477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c0d58ba-2e55-45f1-9601-0e2d06d7620a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:59.415137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0c0d58ba-2e55-45f1-9601-0e2d06d7620a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Going to try to start instance {{(pid=117606) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 07:09:59.461822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0c0d58ba-2e55-45f1-9601-0e2d06d7620a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "POST /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/action" status: 202 len: 0 microversion: 2.1 time: 0.086746 Jun 20 07:09:59.462441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 226/448] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:09:59 2022] POST /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 07:09:59.471310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac659541-a837-42fa-b532-0676e21c1f89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:59.472011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ac659541-a837-42fa-b532-0676e21c1f89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:59.478093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac659541-a837-42fa-b532-0676e21c1f89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:59.478608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac659541-a837-42fa-b532-0676e21c1f89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:59.479576 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac659541-a837-42fa-b532-0676e21c1f89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:59.480208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac659541-a837-42fa-b532-0676e21c1f89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:59.484846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:09:59.621874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ac659541-a837-42fa-b532-0676e21c1f89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:59.629951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ac659541-a837-42fa-b532-0676e21c1f89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1708 microversion: 2.1 time: 0.162587 Jun 20 07:09:59.630523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 223/449] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:59 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1708 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:59.744591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf399a9e-4743-43af-ac28-0ecda3d522ad tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:59.745400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bf399a9e-4743-43af-ac28-0ecda3d522ad tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:59.752205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf399a9e-4743-43af-ac28-0ecda3d522ad tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:59.752612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf399a9e-4743-43af-ac28-0ecda3d522ad tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:59.753466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf399a9e-4743-43af-ac28-0ecda3d522ad tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:59.753850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf399a9e-4743-43af-ac28-0ecda3d522ad tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:59.894157 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bf399a9e-4743-43af-ac28-0ecda3d522ad tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:09:59.902054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bf399a9e-4743-43af-ac28-0ecda3d522ad tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1276 microversion: 2.1 time: 0.161643 Jun 20 07:09:59.902658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 227/450] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:09:59 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:09:59.948790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6c194319-51d8-4d04-a6fd-c12bff3ce732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:09:59.949488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6c194319-51d8-4d04-a6fd-c12bff3ce732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:09:59.956094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c194319-51d8-4d04-a6fd-c12bff3ce732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:59.956572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c194319-51d8-4d04-a6fd-c12bff3ce732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:09:59.957357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c194319-51d8-4d04-a6fd-c12bff3ce732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:09:59.957802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c194319-51d8-4d04-a6fd-c12bff3ce732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:00.142929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6c194319-51d8-4d04-a6fd-c12bff3ce732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:00.151446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6c194319-51d8-4d04-a6fd-c12bff3ce732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:00.153663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6c194319-51d8-4d04-a6fd-c12bff3ce732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:00.154974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6c194319-51d8-4d04-a6fd-c12bff3ce732 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1719 microversion: 2.20 time: 0.210093 Jun 20 07:10:00.156102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 224/451] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:09:59 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1719 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:00.649238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ae9b85f-08d9-4cfc-9038-cc2ccde3d680 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:00.650081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3ae9b85f-08d9-4cfc-9038-cc2ccde3d680 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:00.660445 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ae9b85f-08d9-4cfc-9038-cc2ccde3d680 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:00.661670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ae9b85f-08d9-4cfc-9038-cc2ccde3d680 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:00.664991 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ae9b85f-08d9-4cfc-9038-cc2ccde3d680 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:00.665732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ae9b85f-08d9-4cfc-9038-cc2ccde3d680 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:00.919810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c2a7b730-4950-4c79-ac16-4ef32a7a4b68 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:00.920817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c2a7b730-4950-4c79-ac16-4ef32a7a4b68 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:00.929523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2a7b730-4950-4c79-ac16-4ef32a7a4b68 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:00.930081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2a7b730-4950-4c79-ac16-4ef32a7a4b68 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:00.931880 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2a7b730-4950-4c79-ac16-4ef32a7a4b68 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:00.932427 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2a7b730-4950-4c79-ac16-4ef32a7a4b68 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:01.527590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3ae9b85f-08d9-4cfc-9038-cc2ccde3d680 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:01.542189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3ae9b85f-08d9-4cfc-9038-cc2ccde3d680 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1708 microversion: 2.1 time: 0.897283 Jun 20 07:10:01.543048 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 228/452] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:00 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1708 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:01.549271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8710a578-7b71-4625-a79b-6a11c1833bc9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:01.550984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8710a578-7b71-4625-a79b-6a11c1833bc9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:01.558040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8710a578-7b71-4625-a79b-6a11c1833bc9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:01.558768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8710a578-7b71-4625-a79b-6a11c1833bc9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:01.561851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8710a578-7b71-4625-a79b-6a11c1833bc9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:01.563279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8710a578-7b71-4625-a79b-6a11c1833bc9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:01.731826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c2a7b730-4950-4c79-ac16-4ef32a7a4b68 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:01.740868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c2a7b730-4950-4c79-ac16-4ef32a7a4b68 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.825832 Jun 20 07:10:01.744554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 225/453] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:00 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:01.749294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-248e6f89-2f4f-4d56-97cf-c7bd7ef35512 req-73d8e88d-37d5-4c6e-a036-b5f51f992df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de77ef2f-9577-403b-99e7-2540b785a6d3", "tag": "ad8416ab-dcec-4280-89aa-c020d26b2a20"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:01.773778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-248e6f89-2f4f-4d56-97cf-c7bd7ef35512 req-73d8e88d-37d5-4c6e-a036-b5f51f992df1 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:01.774434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-248e6f89-2f4f-4d56-97cf-c7bd7ef35512 req-73d8e88d-37d5-4c6e-a036-b5f51f992df1 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:01.809325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-248e6f89-2f4f-4d56-97cf-c7bd7ef35512 req-73d8e88d-37d5-4c6e-a036-b5f51f992df1 service nova] Creating event network-changed:ad8416ab-dcec-4280-89aa-c020d26b2a20 for instance de77ef2f-9577-403b-99e7-2540b785a6d3 on hv-cinder-77819 Jun 20 07:10:01.828835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-248e6f89-2f4f-4d56-97cf-c7bd7ef35512 req-73d8e88d-37d5-4c6e-a036-b5f51f992df1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082900 Jun 20 07:10:01.829686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 226/454] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:01.912204 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8710a578-7b71-4625-a79b-6a11c1833bc9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:01.920862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8710a578-7b71-4625-a79b-6a11c1833bc9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:01.922374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8710a578-7b71-4625-a79b-6a11c1833bc9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:01.923532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8710a578-7b71-4625-a79b-6a11c1833bc9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1722 microversion: 2.20 time: 0.379223 Jun 20 07:10:01.924089 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 229/455] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:01 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1722 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:01.944017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b7f23415-bc8b-4779-89fe-afa3e0a8ea15 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f92cbd0-785e-45ac-9bc3-dbd94807f366"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:01.946006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b7f23415-bc8b-4779-89fe-afa3e0a8ea15 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:01.954160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7f23415-bc8b-4779-89fe-afa3e0a8ea15 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:01.954915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7f23415-bc8b-4779-89fe-afa3e0a8ea15 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:01.955795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7f23415-bc8b-4779-89fe-afa3e0a8ea15 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:01.957188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7f23415-bc8b-4779-89fe-afa3e0a8ea15 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:02.344415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b7f23415-bc8b-4779-89fe-afa3e0a8ea15 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "POST /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.405851 Jun 20 07:10:02.345379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 227/456] 10.222.0.23 () {62 vars in 1363 bytes} [Mon Jun 20 07:10:01 2022] POST /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 188 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:10:02.477332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d0d9a373-6b67-4947-9d4c-5a60adab17e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:02.477902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d0d9a373-6b67-4947-9d4c-5a60adab17e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:02.486888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0d9a373-6b67-4947-9d4c-5a60adab17e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:02.486888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0d9a373-6b67-4947-9d4c-5a60adab17e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:02.486888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0d9a373-6b67-4947-9d4c-5a60adab17e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:02.486888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0d9a373-6b67-4947-9d4c-5a60adab17e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:02.491737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-53a51c9e-1ab4-4242-b10c-5fa851b496b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:02.492258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-53a51c9e-1ab4-4242-b10c-5fa851b496b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:02.500457 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53a51c9e-1ab4-4242-b10c-5fa851b496b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:02.500908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53a51c9e-1ab4-4242-b10c-5fa851b496b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:02.501668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53a51c9e-1ab4-4242-b10c-5fa851b496b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:02.502102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53a51c9e-1ab4-4242-b10c-5fa851b496b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:02.642668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d0d9a373-6b67-4947-9d4c-5a60adab17e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "POST /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/action" status: 202 len: 0 microversion: 2.20 time: 0.169525 Jun 20 07:10:02.643931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 230/457] 10.222.0.23 () {62 vars in 1318 bytes} [Mon Jun 20 07:10:02 2022] POST /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:10:02.649153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0d9b81ea-78a7-49e2-813d-d524efa79209 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:02.650116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0d9b81ea-78a7-49e2-813d-d524efa79209 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:02.657561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d9b81ea-78a7-49e2-813d-d524efa79209 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:02.658322 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d9b81ea-78a7-49e2-813d-d524efa79209 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:02.658491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-53a51c9e-1ab4-4242-b10c-5fa851b496b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lazy-loading 'services' on Instance uuid 8beaf201-621c-45d2-beb4-4a93cae72cce {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:10:02.660356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d9b81ea-78a7-49e2-813d-d524efa79209 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:02.660903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d9b81ea-78a7-49e2-813d-d524efa79209 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:02.815463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-53a51c9e-1ab4-4242-b10c-5fa851b496b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce/os-volume_attachments/679d0d87-5e97-45b8-b206-001aed251a15" status: 202 len: 0 microversion: 2.1 time: 0.327343 Jun 20 07:10:02.816061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 228/458] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:10:02 2022] DELETE /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce/os-volume_attachments/679d0d87-5e97-45b8-b206-001aed251a15 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 07:10:02.821558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bbb531a5-bff9-4b4f-9a65-64fef9d256cb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:02.822473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bbb531a5-bff9-4b4f-9a65-64fef9d256cb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:02.830209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbb531a5-bff9-4b4f-9a65-64fef9d256cb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:02.831044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbb531a5-bff9-4b4f-9a65-64fef9d256cb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:02.832247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbb531a5-bff9-4b4f-9a65-64fef9d256cb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:02.832899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbb531a5-bff9-4b4f-9a65-64fef9d256cb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:02.855085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0d9b81ea-78a7-49e2-813d-d524efa79209 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:02.866923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0d9b81ea-78a7-49e2-813d-d524efa79209 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1708 microversion: 2.1 time: 0.221633 Jun 20 07:10:02.869212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 231/459] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:02 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1708 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:02.877965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1e32dc6e-57d5-4231-ba22-8cb821d6572c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:02.878797 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1e32dc6e-57d5-4231-ba22-8cb821d6572c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:02.896001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e32dc6e-57d5-4231-ba22-8cb821d6572c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:02.896333 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e32dc6e-57d5-4231-ba22-8cb821d6572c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:02.897106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e32dc6e-57d5-4231-ba22-8cb821d6572c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:02.897598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e32dc6e-57d5-4231-ba22-8cb821d6572c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:03.177924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bbb531a5-bff9-4b4f-9a65-64fef9d256cb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:03.191934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bbb531a5-bff9-4b4f-9a65-64fef9d256cb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:03.193826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bbb531a5-bff9-4b4f-9a65-64fef9d256cb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:03.196172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bbb531a5-bff9-4b4f-9a65-64fef9d256cb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1748 microversion: 2.20 time: 0.378759 Jun 20 07:10:03.197328 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 229/460] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:02 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1748 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:03.210485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1e32dc6e-57d5-4231-ba22-8cb821d6572c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:03.219806 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1e32dc6e-57d5-4231-ba22-8cb821d6572c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.349520 Jun 20 07:10:03.220393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 232/461] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:02 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:03.885584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9cf315ea-a71a-4610-b683-a3f3fe150f29 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:03.886195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9cf315ea-a71a-4610-b683-a3f3fe150f29 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:03.894518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9cf315ea-a71a-4610-b683-a3f3fe150f29 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:03.895019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9cf315ea-a71a-4610-b683-a3f3fe150f29 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:03.895740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9cf315ea-a71a-4610-b683-a3f3fe150f29 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:03.896217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9cf315ea-a71a-4610-b683-a3f3fe150f29 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:04.037155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9cf315ea-a71a-4610-b683-a3f3fe150f29 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:04.045594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9cf315ea-a71a-4610-b683-a3f3fe150f29 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1712 microversion: 2.1 time: 0.163894 Jun 20 07:10:04.046156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 230/462] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:03 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1712 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:04.216184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1acc014c-7960-49cd-bb68-3e77c370fd98 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:04.217257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1acc014c-7960-49cd-bb68-3e77c370fd98 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:04.223564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1acc014c-7960-49cd-bb68-3e77c370fd98 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:04.224086 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1acc014c-7960-49cd-bb68-3e77c370fd98 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:04.224964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1acc014c-7960-49cd-bb68-3e77c370fd98 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:04.225481 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1acc014c-7960-49cd-bb68-3e77c370fd98 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:04.237815 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3d6f6326-3613-4db7-a8aa-691756ed18a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:04.238689 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3d6f6326-3613-4db7-a8aa-691756ed18a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:04.245325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d6f6326-3613-4db7-a8aa-691756ed18a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:04.246661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d6f6326-3613-4db7-a8aa-691756ed18a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:04.249348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d6f6326-3613-4db7-a8aa-691756ed18a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:04.250024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d6f6326-3613-4db7-a8aa-691756ed18a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:04.434205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1acc014c-7960-49cd-bb68-3e77c370fd98 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:04.438400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3d6f6326-3613-4db7-a8aa-691756ed18a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:04.442835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1acc014c-7960-49cd-bb68-3e77c370fd98 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:04.444371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1acc014c-7960-49cd-bb68-3e77c370fd98 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:04.445532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1acc014c-7960-49cd-bb68-3e77c370fd98 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1748 microversion: 2.20 time: 0.233483 Jun 20 07:10:04.445894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3d6f6326-3613-4db7-a8aa-691756ed18a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.212227 Jun 20 07:10:04.446184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 233/463] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:04 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1748 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:04.446419 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 231/464] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:04 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:10:05.462177 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b742aa0-47de-4050-8aa7-520a42971c5b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:05.462948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b742aa0-47de-4050-8aa7-520a42971c5b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:05.464217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fdf3cb2a-dc82-4d52-8b7a-2d96867d62e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:05.464974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fdf3cb2a-dc82-4d52-8b7a-2d96867d62e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:05.469389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b742aa0-47de-4050-8aa7-520a42971c5b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:05.469831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b742aa0-47de-4050-8aa7-520a42971c5b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:05.470787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b742aa0-47de-4050-8aa7-520a42971c5b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:05.471230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b742aa0-47de-4050-8aa7-520a42971c5b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:05.473086 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdf3cb2a-dc82-4d52-8b7a-2d96867d62e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:05.473623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdf3cb2a-dc82-4d52-8b7a-2d96867d62e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:05.474656 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdf3cb2a-dc82-4d52-8b7a-2d96867d62e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:05.475328 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdf3cb2a-dc82-4d52-8b7a-2d96867d62e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:05.677791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b742aa0-47de-4050-8aa7-520a42971c5b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:05.685894 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b742aa0-47de-4050-8aa7-520a42971c5b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.227540 Jun 20 07:10:05.686835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 234/465] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:05 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:05.689461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fdf3cb2a-dc82-4d52-8b7a-2d96867d62e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:05.698211 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fdf3cb2a-dc82-4d52-8b7a-2d96867d62e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:05.699712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fdf3cb2a-dc82-4d52-8b7a-2d96867d62e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:05.700906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fdf3cb2a-dc82-4d52-8b7a-2d96867d62e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1750 microversion: 2.20 time: 0.241388 Jun 20 07:10:05.701468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 232/466] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:05 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1750 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:06.089929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c06732a7-a8e4-485e-8f88-85a57acba328 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:06.090437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c06732a7-a8e4-485e-8f88-85a57acba328 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:06.097343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c06732a7-a8e4-485e-8f88-85a57acba328 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:06.098464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c06732a7-a8e4-485e-8f88-85a57acba328 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:06.099252 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c06732a7-a8e4-485e-8f88-85a57acba328 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:06.099890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c06732a7-a8e4-485e-8f88-85a57acba328 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:06.126636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c06732a7-a8e4-485e-8f88-85a57acba328 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:10:06.157416 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:06.216950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c06732a7-a8e4-485e-8f88-85a57acba328 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 204 len: 0 microversion: 2.1 time: 0.130570 Jun 20 07:10:06.221542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 235/467] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:10:06 2022] DELETE /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:10:06.226884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3eaed96c-bfa4-4714-98f3-e69ac6cb03b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:06.227732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3eaed96c-bfa4-4714-98f3-e69ac6cb03b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:06.236504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3eaed96c-bfa4-4714-98f3-e69ac6cb03b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:06.237165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3eaed96c-bfa4-4714-98f3-e69ac6cb03b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:06.237976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3eaed96c-bfa4-4714-98f3-e69ac6cb03b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:06.238440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3eaed96c-bfa4-4714-98f3-e69ac6cb03b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:06.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3eaed96c-bfa4-4714-98f3-e69ac6cb03b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:06.395172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3eaed96c-bfa4-4714-98f3-e69ac6cb03b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1512 microversion: 2.1 time: 0.172171 Jun 20 07:10:06.396056 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 233/468] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:06 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:10:06.703002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3f92d7da-24f8-4270-aa20-5c20c520bd94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:06.703738 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3f92d7da-24f8-4270-aa20-5c20c520bd94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:06.710349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f92d7da-24f8-4270-aa20-5c20c520bd94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:06.710860 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f92d7da-24f8-4270-aa20-5c20c520bd94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:06.711650 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f92d7da-24f8-4270-aa20-5c20c520bd94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:06.712150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f92d7da-24f8-4270-aa20-5c20c520bd94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:06.721600 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-45a1d9ec-630d-419a-bd53-75ae341a67a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:06.722215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-45a1d9ec-630d-419a-bd53-75ae341a67a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:06.728616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45a1d9ec-630d-419a-bd53-75ae341a67a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:06.729054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45a1d9ec-630d-419a-bd53-75ae341a67a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:06.729810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45a1d9ec-630d-419a-bd53-75ae341a67a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:06.730239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45a1d9ec-630d-419a-bd53-75ae341a67a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:06.912633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3f92d7da-24f8-4270-aa20-5c20c520bd94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:06.915895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-45a1d9ec-630d-419a-bd53-75ae341a67a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:06.920028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3f92d7da-24f8-4270-aa20-5c20c520bd94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.221202 Jun 20 07:10:06.921159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 236/469] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:06 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:06.925170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-45a1d9ec-630d-419a-bd53-75ae341a67a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:06.926680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-45a1d9ec-630d-419a-bd53-75ae341a67a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:06.927830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-45a1d9ec-630d-419a-bd53-75ae341a67a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.211512 Jun 20 07:10:06.928550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 234/470] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:06 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:07.413668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-70ce44f7-647f-4f34-a94e-0ba39a7d9135 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:07.414561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-70ce44f7-647f-4f34-a94e-0ba39a7d9135 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:07.421872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70ce44f7-647f-4f34-a94e-0ba39a7d9135 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:07.422364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70ce44f7-647f-4f34-a94e-0ba39a7d9135 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:07.423452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70ce44f7-647f-4f34-a94e-0ba39a7d9135 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:07.423890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-70ce44f7-647f-4f34-a94e-0ba39a7d9135 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:07.580696 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-70ce44f7-647f-4f34-a94e-0ba39a7d9135 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:07.588317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-70ce44f7-647f-4f34-a94e-0ba39a7d9135 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1512 microversion: 2.1 time: 0.178812 Jun 20 07:10:07.588886 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 237/471] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:07 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:07.938009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-76606d5d-617a-4b6a-b7b8-88123e7ff4f7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:07.938594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-76606d5d-617a-4b6a-b7b8-88123e7ff4f7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:07.945866 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31b7fcc0-a510-4562-a350-4fa681a2f41e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:07.947017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-31b7fcc0-a510-4562-a350-4fa681a2f41e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:07.955318 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b7fcc0-a510-4562-a350-4fa681a2f41e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:07.959292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76606d5d-617a-4b6a-b7b8-88123e7ff4f7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:07.960171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b7fcc0-a510-4562-a350-4fa681a2f41e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:07.961154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b7fcc0-a510-4562-a350-4fa681a2f41e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:07.961817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76606d5d-617a-4b6a-b7b8-88123e7ff4f7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:07.962830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76606d5d-617a-4b6a-b7b8-88123e7ff4f7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:07.963508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b7fcc0-a510-4562-a350-4fa681a2f41e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:07.966765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76606d5d-617a-4b6a-b7b8-88123e7ff4f7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:08.185011 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31b7fcc0-a510-4562-a350-4fa681a2f41e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:08.189051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-76606d5d-617a-4b6a-b7b8-88123e7ff4f7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:08.193495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31b7fcc0-a510-4562-a350-4fa681a2f41e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:08.195012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31b7fcc0-a510-4562-a350-4fa681a2f41e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:08.196218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-31b7fcc0-a510-4562-a350-4fa681a2f41e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.254258 Jun 20 07:10:08.196648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-76606d5d-617a-4b6a-b7b8-88123e7ff4f7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.263103 Jun 20 07:10:08.197221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 235/472] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:07 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:08.207002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 238/473] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:07 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:08.605465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d498c7c4-341b-4c31-ba5a-784b6993e1da tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:08.606074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d498c7c4-341b-4c31-ba5a-784b6993e1da tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:08.611970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d498c7c4-341b-4c31-ba5a-784b6993e1da tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:08.612439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d498c7c4-341b-4c31-ba5a-784b6993e1da tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:08.613184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d498c7c4-341b-4c31-ba5a-784b6993e1da tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:08.613608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d498c7c4-341b-4c31-ba5a-784b6993e1da tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:08.756827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d498c7c4-341b-4c31-ba5a-784b6993e1da tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:08.764876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d498c7c4-341b-4c31-ba5a-784b6993e1da tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1512 microversion: 2.1 time: 0.162589 Jun 20 07:10:08.765459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 236/474] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:08 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:09.212856 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-424c7755-316b-44a8-85cc-3af252e8d3c2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:09.213472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-424c7755-316b-44a8-85cc-3af252e8d3c2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:09.214308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7b3012bb-07fc-4e8f-8566-1e615f25e57f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:09.214922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7b3012bb-07fc-4e8f-8566-1e615f25e57f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:09.219853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-424c7755-316b-44a8-85cc-3af252e8d3c2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:09.220332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-424c7755-316b-44a8-85cc-3af252e8d3c2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:09.221090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-424c7755-316b-44a8-85cc-3af252e8d3c2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:09.221295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b3012bb-07fc-4e8f-8566-1e615f25e57f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:09.221520 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-424c7755-316b-44a8-85cc-3af252e8d3c2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:09.221744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b3012bb-07fc-4e8f-8566-1e615f25e57f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:09.222516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b3012bb-07fc-4e8f-8566-1e615f25e57f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:09.222927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b3012bb-07fc-4e8f-8566-1e615f25e57f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:09.226905 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:09.595814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-424c7755-316b-44a8-85cc-3af252e8d3c2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:09.604184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-424c7755-316b-44a8-85cc-3af252e8d3c2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.394962 Jun 20 07:10:09.604770 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 239/475] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:09 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:09.637352 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b3012bb-07fc-4e8f-8566-1e615f25e57f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:09.646840 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b3012bb-07fc-4e8f-8566-1e615f25e57f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:09.648431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b3012bb-07fc-4e8f-8566-1e615f25e57f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:09.649601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7b3012bb-07fc-4e8f-8566-1e615f25e57f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.439228 Jun 20 07:10:09.650168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 237/476] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:09 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:09.782622 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-78ff1dd7-2147-4c8f-a452-fda9a402678a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:09.783539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-78ff1dd7-2147-4c8f-a452-fda9a402678a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:09.790718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78ff1dd7-2147-4c8f-a452-fda9a402678a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:09.791412 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78ff1dd7-2147-4c8f-a452-fda9a402678a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:09.792358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78ff1dd7-2147-4c8f-a452-fda9a402678a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:09.792943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78ff1dd7-2147-4c8f-a452-fda9a402678a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:10.217277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-78ff1dd7-2147-4c8f-a452-fda9a402678a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:10.226105 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-78ff1dd7-2147-4c8f-a452-fda9a402678a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1512 microversion: 2.1 time: 0.448564 Jun 20 07:10:10.226967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 240/477] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:09 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1512 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:10.544069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-265de527-4dd5-45a0-9f07-f15e36482f15 req-096e9624-8782-4495-a090-01dbf8f5e34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8beaf201-621c-45d2-beb4-4a93cae72cce", "name": "network-vif-deleted", "tag": "1d338244-3c45-4515-9a94-733bf4910333"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:10.558330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-265de527-4dd5-45a0-9f07-f15e36482f15 req-096e9624-8782-4495-a090-01dbf8f5e34a service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:10.558775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-265de527-4dd5-45a0-9f07-f15e36482f15 req-096e9624-8782-4495-a090-01dbf8f5e34a service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:10.571496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-265de527-4dd5-45a0-9f07-f15e36482f15 req-096e9624-8782-4495-a090-01dbf8f5e34a service nova] Creating event network-vif-deleted:1d338244-3c45-4515-9a94-733bf4910333 for instance 8beaf201-621c-45d2-beb4-4a93cae72cce on hv-cinder-77819 Jun 20 07:10:10.577983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-265de527-4dd5-45a0-9f07-f15e36482f15 req-096e9624-8782-4495-a090-01dbf8f5e34a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038296 Jun 20 07:10:10.579329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 238/478] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:10:10.622070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-127245f7-8cb4-4f37-8732-d19a1bb179cf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:10.622988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-127245f7-8cb4-4f37-8732-d19a1bb179cf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:10.630652 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-127245f7-8cb4-4f37-8732-d19a1bb179cf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:10.636596 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-127245f7-8cb4-4f37-8732-d19a1bb179cf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:10.637488 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-127245f7-8cb4-4f37-8732-d19a1bb179cf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:10.638109 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-127245f7-8cb4-4f37-8732-d19a1bb179cf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:10.673635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-73470bc2-1581-4aaf-af5d-f4c7d9998683 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:10.674365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-73470bc2-1581-4aaf-af5d-f4c7d9998683 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:10.683019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73470bc2-1581-4aaf-af5d-f4c7d9998683 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:10.683475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73470bc2-1581-4aaf-af5d-f4c7d9998683 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:10.684490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73470bc2-1581-4aaf-af5d-f4c7d9998683 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:10.684966 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73470bc2-1581-4aaf-af5d-f4c7d9998683 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:10.886924 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-127245f7-8cb4-4f37-8732-d19a1bb179cf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:10.891457 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-73470bc2-1581-4aaf-af5d-f4c7d9998683 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:10.899540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-127245f7-8cb4-4f37-8732-d19a1bb179cf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.281577 Jun 20 07:10:10.900147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 241/479] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:10 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:10.901381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-73470bc2-1581-4aaf-af5d-f4c7d9998683 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:10.902904 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-73470bc2-1581-4aaf-af5d-f4c7d9998683 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:10.904074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-73470bc2-1581-4aaf-af5d-f4c7d9998683 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.237312 Jun 20 07:10:10.905385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 239/480] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:10 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:11.244320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8220844d-d326-424e-8819-f5c419a62069 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:11.245038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8220844d-d326-424e-8819-f5c419a62069 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:11.254539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8220844d-d326-424e-8819-f5c419a62069 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:11.255263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8220844d-d326-424e-8819-f5c419a62069 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:11.256708 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8220844d-d326-424e-8819-f5c419a62069 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:11.257426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8220844d-d326-424e-8819-f5c419a62069 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:11.297907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8220844d-d326-424e-8819-f5c419a62069 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:11.298648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8220844d-d326-424e-8819-f5c419a62069 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:11.299267 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-8220844d-d326-424e-8819-f5c419a62069 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lazy-loading 'fault' on Instance uuid 8beaf201-621c-45d2-beb4-4a93cae72cce {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:10:11.349333 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8220844d-d326-424e-8819-f5c419a62069 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:11.357454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8220844d-d326-424e-8819-f5c419a62069 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 200 len: 1306 microversion: 2.1 time: 0.117473 Jun 20 07:10:11.358733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 242/481] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:11 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 1306 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:11.918881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e7ff85ee-2208-40cf-ac03-f34168004683 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:11.920138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e7ff85ee-2208-40cf-ac03-f34168004683 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:11.925732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1cc83921-ff5b-421c-af00-c93121427249 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:11.926816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1cc83921-ff5b-421c-af00-c93121427249 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:11.929402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7ff85ee-2208-40cf-ac03-f34168004683 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:11.938963 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cc83921-ff5b-421c-af00-c93121427249 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:11.939421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cc83921-ff5b-421c-af00-c93121427249 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:11.939863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7ff85ee-2208-40cf-ac03-f34168004683 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:11.940363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cc83921-ff5b-421c-af00-c93121427249 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:11.940661 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cc83921-ff5b-421c-af00-c93121427249 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:11.940793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7ff85ee-2208-40cf-ac03-f34168004683 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:11.941161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7ff85ee-2208-40cf-ac03-f34168004683 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:12.189978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1cc83921-ff5b-421c-af00-c93121427249 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:12.198781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1cc83921-ff5b-421c-af00-c93121427249 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:12.200334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1cc83921-ff5b-421c-af00-c93121427249 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:12.202549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1cc83921-ff5b-421c-af00-c93121427249 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.282525 Jun 20 07:10:12.203657 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 243/482] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:11 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:12.250457 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e7ff85ee-2208-40cf-ac03-f34168004683 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:12.259109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e7ff85ee-2208-40cf-ac03-f34168004683 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.346023 Jun 20 07:10:12.259686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 240/483] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:11 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:12.375335 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff78777d-a7bf-4c28-af36-30446add7f35 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:12.376060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff78777d-a7bf-4c28-af36-30446add7f35 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: 8beaf201-621c-45d2-beb4-4a93cae72cce] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:12.382561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff78777d-a7bf-4c28-af36-30446add7f35 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:12.383051 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff78777d-a7bf-4c28-af36-30446add7f35 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:12.383822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff78777d-a7bf-4c28-af36-30446add7f35 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:12.384295 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff78777d-a7bf-4c28-af36-30446add7f35 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:12.399073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-ff78777d-a7bf-4c28-af36-30446add7f35 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] HTTP exception thrown: Instance 8beaf201-621c-45d2-beb4-4a93cae72cce could not be found. Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff78777d-a7bf-4c28-af36-30446add7f35 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Request method failure captured: Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce HTTP/1.1 Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisBz47HIB8ZxJkWPj5ZLY_NsTpIgvWQZXKqonc3bKLxnwQuMaHGWlMg0NHsewOFBH8fRwvjVE8-76dCRN4LngC5Q4MhlNitbfKfwKLNwxzz0fwViP3sEWKk-bWLprMOdRhwpyXBAv96wQ88SFVbmY9WGj37T0HFlg-ZqLJp7aoUlv75c Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 1583bd5823544e54b32e1eaf308cd261 Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:10:12.400830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:10:12.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:10:12.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:10:12.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 1583bd5823544e54b32e1eaf308cd261 Jun 20 07:10:12.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:10:12.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesSnapshotTestJSON-672847046-project Jun 20 07:10:12.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:10:12.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:10:12.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: 0dbf681122194384812c2eb96d1adfbc Jun 20 07:10:12.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesSnapshotTestJSON-672847046-project Jun 20 07:10:12.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:10:12.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 8beaf201-621c-45d2-beb4-4a93cae72cce could not be found. Jun 20 07:10:12.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '8beaf201-621c-45d2-beb4-4a93cae72cce'} Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8beaf201-621c-45d2-beb4-4a93cae72cce could not be found. Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:10:12.404353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8beaf201-621c-45d2-beb4-4a93cae72cce could not be found. Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8beaf201-621c-45d2-beb4-4a93cae72cce could not be found. Jun 20 07:10:12.406385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:10:12.407448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff78777d-a7bf-4c28-af36-30446add7f35 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Returning 404 to user: Instance 8beaf201-621c-45d2-beb4-4a93cae72cce could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:10:12.407448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff78777d-a7bf-4c28-af36-30446add7f35 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce" status: 404 len: 111 microversion: 2.1 time: 0.031109 Jun 20 07:10:12.407448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 244/484] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:12 2022] GET /compute/v2.1/servers/8beaf201-621c-45d2-beb4-4a93cae72cce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:10:13.224319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ba6b4fa6-03fd-47fa-836a-45366b0ccc39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:13.225045 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ba6b4fa6-03fd-47fa-836a-45366b0ccc39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:13.231626 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba6b4fa6-03fd-47fa-836a-45366b0ccc39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:13.232353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba6b4fa6-03fd-47fa-836a-45366b0ccc39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:13.234155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba6b4fa6-03fd-47fa-836a-45366b0ccc39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:13.235086 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba6b4fa6-03fd-47fa-836a-45366b0ccc39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:13.275716 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-447366e7-1fb8-4720-b8cd-7acf1fb107de tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:13.278674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-447366e7-1fb8-4720-b8cd-7acf1fb107de tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:13.283792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-447366e7-1fb8-4720-b8cd-7acf1fb107de tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:13.284293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-447366e7-1fb8-4720-b8cd-7acf1fb107de tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:13.285056 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-447366e7-1fb8-4720-b8cd-7acf1fb107de tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:13.285490 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-447366e7-1fb8-4720-b8cd-7acf1fb107de tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:13.456456 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ba6b4fa6-03fd-47fa-836a-45366b0ccc39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:13.470318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ba6b4fa6-03fd-47fa-836a-45366b0ccc39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:13.473110 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ba6b4fa6-03fd-47fa-836a-45366b0ccc39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:13.474332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ba6b4fa6-03fd-47fa-836a-45366b0ccc39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.254610 Jun 20 07:10:13.478742 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 241/485] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:13 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:13.509815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-447366e7-1fb8-4720-b8cd-7acf1fb107de tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:13.523904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-447366e7-1fb8-4720-b8cd-7acf1fb107de tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.251890 Jun 20 07:10:13.533712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 245/486] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:13 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:10:14.060485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-f31bc154-81a5-411b-9058-e019a85009f3 req-df791cf5-0192-44a9-8725-3509f9a292e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de77ef2f-9577-403b-99e7-2540b785a6d3", "name": "network-vif-plugged", "status": "completed", "tag": "ad8416ab-dcec-4280-89aa-c020d26b2a20"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:14.090060 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f31bc154-81a5-411b-9058-e019a85009f3 req-df791cf5-0192-44a9-8725-3509f9a292e7 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:14.090511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f31bc154-81a5-411b-9058-e019a85009f3 req-df791cf5-0192-44a9-8725-3509f9a292e7 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:14.115147 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-f31bc154-81a5-411b-9058-e019a85009f3 req-df791cf5-0192-44a9-8725-3509f9a292e7 service nova] Creating event network-vif-plugged:ad8416ab-dcec-4280-89aa-c020d26b2a20 for instance de77ef2f-9577-403b-99e7-2540b785a6d3 on hv-cinder-77819 Jun 20 07:10:14.120054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-f31bc154-81a5-411b-9058-e019a85009f3 req-df791cf5-0192-44a9-8725-3509f9a292e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063994 Jun 20 07:10:14.120693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 242/487] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:14.493470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-48c7f18d-fc8c-4d20-8ebc-9a6d7cbfc636 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:14.494259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-48c7f18d-fc8c-4d20-8ebc-9a6d7cbfc636 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:14.501973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48c7f18d-fc8c-4d20-8ebc-9a6d7cbfc636 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:14.502672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48c7f18d-fc8c-4d20-8ebc-9a6d7cbfc636 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:14.503607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48c7f18d-fc8c-4d20-8ebc-9a6d7cbfc636 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:14.504399 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48c7f18d-fc8c-4d20-8ebc-9a6d7cbfc636 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:14.542502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac783eae-ddc7-4488-8354-16dc11999eb9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:14.543476 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ac783eae-ddc7-4488-8354-16dc11999eb9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:14.550941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac783eae-ddc7-4488-8354-16dc11999eb9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:14.555495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac783eae-ddc7-4488-8354-16dc11999eb9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:14.555495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac783eae-ddc7-4488-8354-16dc11999eb9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:14.555495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac783eae-ddc7-4488-8354-16dc11999eb9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:14.702490 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48c7f18d-fc8c-4d20-8ebc-9a6d7cbfc636 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:14.721233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48c7f18d-fc8c-4d20-8ebc-9a6d7cbfc636 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:14.723371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48c7f18d-fc8c-4d20-8ebc-9a6d7cbfc636 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:14.724789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-48c7f18d-fc8c-4d20-8ebc-9a6d7cbfc636 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.235340 Jun 20 07:10:14.725881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 246/488] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:14 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:14.745109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ac783eae-ddc7-4488-8354-16dc11999eb9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:14.752540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ac783eae-ddc7-4488-8354-16dc11999eb9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.214887 Jun 20 07:10:14.753101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 243/489] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:14 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:15.742704 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-86e19c7b-944e-46f1-b4ad-7063e50039ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:15.743320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-86e19c7b-944e-46f1-b4ad-7063e50039ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:15.750322 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86e19c7b-944e-46f1-b4ad-7063e50039ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:15.750799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86e19c7b-944e-46f1-b4ad-7063e50039ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:15.751558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86e19c7b-944e-46f1-b4ad-7063e50039ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:15.751998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86e19c7b-944e-46f1-b4ad-7063e50039ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:15.770948 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9a36e899-356b-48cb-b323-8f37050779db tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:15.771560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9a36e899-356b-48cb-b323-8f37050779db tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:15.778039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a36e899-356b-48cb-b323-8f37050779db tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:15.778528 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a36e899-356b-48cb-b323-8f37050779db tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:15.779279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a36e899-356b-48cb-b323-8f37050779db tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:15.779712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a36e899-356b-48cb-b323-8f37050779db tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:15.962984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-86e19c7b-944e-46f1-b4ad-7063e50039ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:15.967431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9a36e899-356b-48cb-b323-8f37050779db tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:15.971530 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-86e19c7b-944e-46f1-b4ad-7063e50039ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:15.973065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-86e19c7b-944e-46f1-b4ad-7063e50039ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:15.974235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-86e19c7b-944e-46f1-b4ad-7063e50039ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.235449 Jun 20 07:10:15.974796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 247/490] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:15 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:15.974952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9a36e899-356b-48cb-b323-8f37050779db tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.207998 Jun 20 07:10:15.975399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 244/491] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:15 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:10:16.995712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-979c4986-4747-4552-b2aa-bd622fc73e08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:16.997920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-669bca61-d5e4-493b-8364-7026cce41f91 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:16.998829 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-979c4986-4747-4552-b2aa-bd622fc73e08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:17.002685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-669bca61-d5e4-493b-8364-7026cce41f91 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:17.009900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-979c4986-4747-4552-b2aa-bd622fc73e08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:17.010696 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-979c4986-4747-4552-b2aa-bd622fc73e08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:17.011294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-669bca61-d5e4-493b-8364-7026cce41f91 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:17.011490 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-979c4986-4747-4552-b2aa-bd622fc73e08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:17.011746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-669bca61-d5e4-493b-8364-7026cce41f91 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:17.011937 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-979c4986-4747-4552-b2aa-bd622fc73e08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:17.012550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-669bca61-d5e4-493b-8364-7026cce41f91 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:17.012991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-669bca61-d5e4-493b-8364-7026cce41f91 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:17.229939 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-979c4986-4747-4552-b2aa-bd622fc73e08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:17.232805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-669bca61-d5e4-493b-8364-7026cce41f91 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:17.238597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-979c4986-4747-4552-b2aa-bd622fc73e08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.250582 Jun 20 07:10:17.239207 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 248/492] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:16 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:17.242452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-669bca61-d5e4-493b-8364-7026cce41f91 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:17.244129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-669bca61-d5e4-493b-8364-7026cce41f91 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:17.245461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-669bca61-d5e4-493b-8364-7026cce41f91 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.256078 Jun 20 07:10:17.246086 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 245/493] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:16 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:18.255930 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-72931305-3838-4ae5-8b96-664fee5694a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:18.256878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-72931305-3838-4ae5-8b96-664fee5694a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:18.263872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72931305-3838-4ae5-8b96-664fee5694a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:18.264326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa91ad8b-2a82-406a-bf6d-eba728ffc485 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:18.264801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72931305-3838-4ae5-8b96-664fee5694a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:18.264922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aa91ad8b-2a82-406a-bf6d-eba728ffc485 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:18.265150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72931305-3838-4ae5-8b96-664fee5694a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:18.265587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72931305-3838-4ae5-8b96-664fee5694a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:18.271693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa91ad8b-2a82-406a-bf6d-eba728ffc485 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:18.272238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa91ad8b-2a82-406a-bf6d-eba728ffc485 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:18.273008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa91ad8b-2a82-406a-bf6d-eba728ffc485 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:18.273445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa91ad8b-2a82-406a-bf6d-eba728ffc485 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:18.466646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-72931305-3838-4ae5-8b96-664fee5694a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:18.477197 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-72931305-3838-4ae5-8b96-664fee5694a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.225354 Jun 20 07:10:18.478227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 249/494] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:18 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:18.479034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-aa91ad8b-2a82-406a-bf6d-eba728ffc485 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:18.488777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-aa91ad8b-2a82-406a-bf6d-eba728ffc485 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:18.490398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-aa91ad8b-2a82-406a-bf6d-eba728ffc485 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:18.491598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aa91ad8b-2a82-406a-bf6d-eba728ffc485 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.231208 Jun 20 07:10:18.492359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 246/495] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:18 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:19.494511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e1d69ac7-9c9f-484e-a58d-70b7071b2a53 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:19.495129 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e1d69ac7-9c9f-484e-a58d-70b7071b2a53 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:19.501936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1d69ac7-9c9f-484e-a58d-70b7071b2a53 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:19.502598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1d69ac7-9c9f-484e-a58d-70b7071b2a53 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:19.507578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1d69ac7-9c9f-484e-a58d-70b7071b2a53 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:19.510023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1d69ac7-9c9f-484e-a58d-70b7071b2a53 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:19.512268 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fb114bfc-edc5-445c-a457-492aef61a6d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:19.513051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fb114bfc-edc5-445c-a457-492aef61a6d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:19.521666 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb114bfc-edc5-445c-a457-492aef61a6d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:19.522358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb114bfc-edc5-445c-a457-492aef61a6d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:19.523585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb114bfc-edc5-445c-a457-492aef61a6d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:19.524272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb114bfc-edc5-445c-a457-492aef61a6d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:19.743783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fb114bfc-edc5-445c-a457-492aef61a6d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:19.754768 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fb114bfc-edc5-445c-a457-492aef61a6d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:19.755376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e1d69ac7-9c9f-484e-a58d-70b7071b2a53 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:19.757088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fb114bfc-edc5-445c-a457-492aef61a6d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:19.758436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fb114bfc-edc5-445c-a457-492aef61a6d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.251436 Jun 20 07:10:19.763044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e1d69ac7-9c9f-484e-a58d-70b7071b2a53 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.272390 Jun 20 07:10:19.773844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 250/496] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:19 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:19.774030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 247/497] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:19 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:20.785101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9bc528da-f56c-4437-8cd0-daee7aaee4e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:20.787236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bb31c778-ce61-4722-8318-165aa8e82c8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:20.787982 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bb31c778-ce61-4722-8318-165aa8e82c8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:20.792327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9bc528da-f56c-4437-8cd0-daee7aaee4e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:20.795040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=82 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:20.810337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb31c778-ce61-4722-8318-165aa8e82c8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:20.812886 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb31c778-ce61-4722-8318-165aa8e82c8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:20.814657 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb31c778-ce61-4722-8318-165aa8e82c8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:20.815555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bc528da-f56c-4437-8cd0-daee7aaee4e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:20.816412 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb31c778-ce61-4722-8318-165aa8e82c8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:20.818243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bc528da-f56c-4437-8cd0-daee7aaee4e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:20.819335 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bc528da-f56c-4437-8cd0-daee7aaee4e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:20.821828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bc528da-f56c-4437-8cd0-daee7aaee4e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:21.079335 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9bc528da-f56c-4437-8cd0-daee7aaee4e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:21.088719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9bc528da-f56c-4437-8cd0-daee7aaee4e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.307779 Jun 20 07:10:21.108260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 248/498] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:20 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:21.110941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bb31c778-ce61-4722-8318-165aa8e82c8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:21.115283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:21.127186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bb31c778-ce61-4722-8318-165aa8e82c8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:21.128717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bb31c778-ce61-4722-8318-165aa8e82c8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:21.130206 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bb31c778-ce61-4722-8318-165aa8e82c8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.353931 Jun 20 07:10:21.130765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 251/499] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:20 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:21.476705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-22500008-c328-4c73-acd4-1425e384d45b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:21.477201 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-22500008-c328-4c73-acd4-1425e384d45b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:21.493498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22500008-c328-4c73-acd4-1425e384d45b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:21.493914 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22500008-c328-4c73-acd4-1425e384d45b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:21.494693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22500008-c328-4c73-acd4-1425e384d45b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:21.495125 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22500008-c328-4c73-acd4-1425e384d45b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:21.524970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-22500008-c328-4c73-acd4-1425e384d45b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2/ips" status: 200 len: 149 microversion: 2.1 time: 0.059239 Jun 20 07:10:21.525759 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 249/500] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 07:10:21 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2/ips => generated 149 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:21.536793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-538fe6dc-2514-42ff-965a-ed06c131b323 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e16eaeed-7bc9-4197-8190-4863c7c5c28b"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:21.538648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-538fe6dc-2514-42ff-965a-ed06c131b323 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:21.548067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-538fe6dc-2514-42ff-965a-ed06c131b323 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:21.548810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-538fe6dc-2514-42ff-965a-ed06c131b323 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:21.549960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-538fe6dc-2514-42ff-965a-ed06c131b323 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:21.550407 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-538fe6dc-2514-42ff-965a-ed06c131b323 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:21.646536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-538fe6dc-2514-42ff-965a-ed06c131b323 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Invalid volume: volume e16eaeed-7bc9-4197-8190-4863c7c5c28b is already attached to instances: b09ad717-132f-4b7d-896e-48b569f56e34 Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-538fe6dc-2514-42ff-965a-ed06c131b323 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2/os-volume_attachments HTTP/1.1 Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 74 Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:10:21.648145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:10:21.649792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:10:21.649792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:10:21.649792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:10:21.649792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:10:21.649792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:10:21.649792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:10:21.649792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:10:21.649792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:10:21.649792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:10:21.649792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Jun 20 07:10:21.649792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {"volumeAttachment": {"volumeId": "e16eaeed-7bc9-4197-8190-4863c7c5c28b"}} Jun 20 07:10:21.649792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Invalid volume: volume e16eaeed-7bc9-4197-8190-4863c7c5c28b is already attached to instances: b09ad717-132f-4b7d-896e-48b569f56e34 Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'server_id': '53321809-7dd1-4d7b-b6b8-5a58b1e907f2', 'body': {'volumeAttachment': {'volumeId': 'e16eaeed-7bc9-4197-8190-4863c7c5c28b'}}} Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e16eaeed-7bc9-4197-8190-4863c7c5c28b is already attached to instances: b09ad717-132f-4b7d-896e-48b569f56e34 Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:10:21.651432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e16eaeed-7bc9-4197-8190-4863c7c5c28b is already attached to instances: b09ad717-132f-4b7d-896e-48b569f56e34 Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:10:21.652984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:10:21.656313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:10:21.656313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:10:21.656313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:10:21.656313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e16eaeed-7bc9-4197-8190-4863c7c5c28b is already attached to instances: b09ad717-132f-4b7d-896e-48b569f56e34 Jun 20 07:10:21.656313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:10:21.656313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-538fe6dc-2514-42ff-965a-ed06c131b323 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 400 to user: Invalid volume: volume e16eaeed-7bc9-4197-8190-4863c7c5c28b is already attached to instances: b09ad717-132f-4b7d-896e-48b569f56e34 {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:10:21.656313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-538fe6dc-2514-42ff-965a-ed06c131b323 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "POST /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117425 Jun 20 07:10:21.656313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 252/501] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 07:10:21 2022] POST /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 07:10:21.658744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a1a325ca-62ce-4db1-998b-99a50e10b782 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:21.659269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a1a325ca-62ce-4db1-998b-99a50e10b782 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:21.665588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1a325ca-62ce-4db1-998b-99a50e10b782 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:21.666122 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1a325ca-62ce-4db1-998b-99a50e10b782 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:21.667182 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1a325ca-62ce-4db1-998b-99a50e10b782 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:21.667436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1a325ca-62ce-4db1-998b-99a50e10b782 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:21.702901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a1a325ca-62ce-4db1-998b-99a50e10b782 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:10:21.798496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a1a325ca-62ce-4db1-998b-99a50e10b782 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 204 len: 0 microversion: 2.1 time: 0.143445 Jun 20 07:10:21.799194 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 250/502] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:10:21 2022] DELETE /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:10:21.807221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eeca52e7-9d96-4061-be20-7e7f930fe690 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:21.807828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eeca52e7-9d96-4061-be20-7e7f930fe690 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:21.818158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eeca52e7-9d96-4061-be20-7e7f930fe690 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:21.819074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eeca52e7-9d96-4061-be20-7e7f930fe690 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:21.819847 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eeca52e7-9d96-4061-be20-7e7f930fe690 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:21.820339 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eeca52e7-9d96-4061-be20-7e7f930fe690 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:21.957281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eeca52e7-9d96-4061-be20-7e7f930fe690 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:21.965304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eeca52e7-9d96-4061-be20-7e7f930fe690 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1681 microversion: 2.1 time: 0.161928 Jun 20 07:10:21.966058 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 253/503] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:21 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:22.114916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-460c029a-ed54-485e-9947-8d69a4ddf5e0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:22.115645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-460c029a-ed54-485e-9947-8d69a4ddf5e0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:22.121983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-460c029a-ed54-485e-9947-8d69a4ddf5e0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:22.122476 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-460c029a-ed54-485e-9947-8d69a4ddf5e0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:22.123848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-460c029a-ed54-485e-9947-8d69a4ddf5e0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:22.124319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-460c029a-ed54-485e-9947-8d69a4ddf5e0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:22.160151 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4a98cc5f-00b2-4ce7-af49-2570bbf2931c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:22.163421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4a98cc5f-00b2-4ce7-af49-2570bbf2931c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:22.181785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a98cc5f-00b2-4ce7-af49-2570bbf2931c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:22.182493 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a98cc5f-00b2-4ce7-af49-2570bbf2931c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:22.183506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a98cc5f-00b2-4ce7-af49-2570bbf2931c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:22.184051 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a98cc5f-00b2-4ce7-af49-2570bbf2931c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:22.314586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-460c029a-ed54-485e-9947-8d69a4ddf5e0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:22.322703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-460c029a-ed54-485e-9947-8d69a4ddf5e0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.211897 Jun 20 07:10:22.329307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 251/504] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:22 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:22.380764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4a98cc5f-00b2-4ce7-af49-2570bbf2931c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:22.390610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4a98cc5f-00b2-4ce7-af49-2570bbf2931c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:22.392497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4a98cc5f-00b2-4ce7-af49-2570bbf2931c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:22.393574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4a98cc5f-00b2-4ce7-af49-2570bbf2931c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.247516 Jun 20 07:10:22.394469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 254/505] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:22.434346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-752633373", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "networks": [{"uuid": "1d69be69-f5b1-49b8-b0ff-8267bcc521f1"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:22.487242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] validate_networks() for [('1d69be69-f5b1-49b8-b0ff-8267bcc521f1', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:10:22.855662 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:10:22.856272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:10:22.856573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:10:22.856983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:10:22.857397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:10:22.875133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:22.875733 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:22.877200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:22.878141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:22.902278 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Getting quotas for project 1583bd5823544e54b32e1eaf308cd261. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:10:22.907262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Getting quotas for user 0dbf681122194384812c2eb96d1adfbc and project 1583bd5823544e54b32e1eaf308cd261. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:10:22.921446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:10:22.924053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:10:22.974132 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-16475350-c7ca-4575-8382-3db6db43b0dd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543284 Jun 20 07:10:22.974704 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 252/506] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:10:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:10:22.984328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-81899244-730c-4855-99f6-f49ce1e6f6a7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:22.984865 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac4ff869-01b5-43bf-bf41-f5f31f29caf0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:22.984973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ac4ff869-01b5-43bf-bf41-f5f31f29caf0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:22.985373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-81899244-730c-4855-99f6-f49ce1e6f6a7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:22.991717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81899244-730c-4855-99f6-f49ce1e6f6a7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:22.992653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81899244-730c-4855-99f6-f49ce1e6f6a7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:23.000214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81899244-730c-4855-99f6-f49ce1e6f6a7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:23.000756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81899244-730c-4855-99f6-f49ce1e6f6a7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:23.043024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ac4ff869-01b5-43bf-bf41-f5f31f29caf0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:23.050409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ac4ff869-01b5-43bf-bf41-f5f31f29caf0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1218 microversion: 2.1 time: 0.069688 Jun 20 07:10:23.059662 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 253/507] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:22 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:10:23.154947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-81899244-730c-4855-99f6-f49ce1e6f6a7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:23.163473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-81899244-730c-4855-99f6-f49ce1e6f6a7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1681 microversion: 2.1 time: 0.184047 Jun 20 07:10:23.164137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 255/508] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:22 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:23.345584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0fe5cd60-5bdb-4ad5-8147-08658d1c3446 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:23.346222 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0fe5cd60-5bdb-4ad5-8147-08658d1c3446 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:23.352284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fe5cd60-5bdb-4ad5-8147-08658d1c3446 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:23.352731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fe5cd60-5bdb-4ad5-8147-08658d1c3446 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:23.353493 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fe5cd60-5bdb-4ad5-8147-08658d1c3446 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:23.353925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fe5cd60-5bdb-4ad5-8147-08658d1c3446 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:23.411862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f38506f9-7cc1-4981-b7fc-c3b938da07ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:23.412603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f38506f9-7cc1-4981-b7fc-c3b938da07ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:23.418731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f38506f9-7cc1-4981-b7fc-c3b938da07ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:23.419247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f38506f9-7cc1-4981-b7fc-c3b938da07ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:23.420628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f38506f9-7cc1-4981-b7fc-c3b938da07ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:23.421125 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f38506f9-7cc1-4981-b7fc-c3b938da07ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:23.524811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0fe5cd60-5bdb-4ad5-8147-08658d1c3446 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:23.532431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0fe5cd60-5bdb-4ad5-8147-08658d1c3446 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.190681 Jun 20 07:10:23.533007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 254/509] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:23 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:23.569930 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f38506f9-7cc1-4981-b7fc-c3b938da07ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:23.578425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f38506f9-7cc1-4981-b7fc-c3b938da07ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:23.579930 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f38506f9-7cc1-4981-b7fc-c3b938da07ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:23.581148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f38506f9-7cc1-4981-b7fc-c3b938da07ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.173224 Jun 20 07:10:23.581722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 256/510] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:23 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:24.066834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f0f9f857-ea4e-44df-bc53-4a0b52df52de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:24.067445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0f9f857-ea4e-44df-bc53-4a0b52df52de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:24.073827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0f9f857-ea4e-44df-bc53-4a0b52df52de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:24.074275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0f9f857-ea4e-44df-bc53-4a0b52df52de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:24.075027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0f9f857-ea4e-44df-bc53-4a0b52df52de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:24.075454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0f9f857-ea4e-44df-bc53-4a0b52df52de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:24.095164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:24.142365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f0f9f857-ea4e-44df-bc53-4a0b52df52de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:24.150225 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f0f9f857-ea4e-44df-bc53-4a0b52df52de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1222 microversion: 2.1 time: 0.087163 Jun 20 07:10:24.150790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 255/511] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:24 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:24.183111 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2fecd433-00f0-4671-a661-45451d7cb615 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:24.184359 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2fecd433-00f0-4671-a661-45451d7cb615 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:24.187530 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:24.193102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fecd433-00f0-4671-a661-45451d7cb615 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:24.193865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fecd433-00f0-4671-a661-45451d7cb615 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:24.194712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fecd433-00f0-4671-a661-45451d7cb615 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:24.195211 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fecd433-00f0-4671-a661-45451d7cb615 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:24.397739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2fecd433-00f0-4671-a661-45451d7cb615 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:24.405726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2fecd433-00f0-4671-a661-45451d7cb615 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1681 microversion: 2.1 time: 0.227281 Jun 20 07:10:24.411197 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 257/512] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:24 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:24.550941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c94e1241-1838-4d01-85d1-2247fe799dbf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:24.552024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c94e1241-1838-4d01-85d1-2247fe799dbf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:24.558702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c94e1241-1838-4d01-85d1-2247fe799dbf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:24.559149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c94e1241-1838-4d01-85d1-2247fe799dbf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:24.559901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c94e1241-1838-4d01-85d1-2247fe799dbf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:24.560360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c94e1241-1838-4d01-85d1-2247fe799dbf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:24.600437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a0e5f80d-fdb2-404f-8454-6fe9ae23caea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:24.601163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a0e5f80d-fdb2-404f-8454-6fe9ae23caea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:24.608499 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0e5f80d-fdb2-404f-8454-6fe9ae23caea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:24.608954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0e5f80d-fdb2-404f-8454-6fe9ae23caea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:24.609709 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0e5f80d-fdb2-404f-8454-6fe9ae23caea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:24.610381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0e5f80d-fdb2-404f-8454-6fe9ae23caea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:24.752212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c94e1241-1838-4d01-85d1-2247fe799dbf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:24.762348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c94e1241-1838-4d01-85d1-2247fe799dbf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.215981 Jun 20 07:10:24.763463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 256/513] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:24 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:24.797602 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a0e5f80d-fdb2-404f-8454-6fe9ae23caea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:24.808880 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a0e5f80d-fdb2-404f-8454-6fe9ae23caea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:24.810478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a0e5f80d-fdb2-404f-8454-6fe9ae23caea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:24.811715 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a0e5f80d-fdb2-404f-8454-6fe9ae23caea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.216102 Jun 20 07:10:24.812495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 258/514] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:24 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:25.166654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-95504360-671f-4dbe-931f-dd546ba94b29 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:25.167269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-95504360-671f-4dbe-931f-dd546ba94b29 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:25.179438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95504360-671f-4dbe-931f-dd546ba94b29 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:25.180092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95504360-671f-4dbe-931f-dd546ba94b29 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:25.181035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95504360-671f-4dbe-931f-dd546ba94b29 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:25.181762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95504360-671f-4dbe-931f-dd546ba94b29 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:25.262711 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-95504360-671f-4dbe-931f-dd546ba94b29 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:25.271158 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-95504360-671f-4dbe-931f-dd546ba94b29 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1270 microversion: 2.1 time: 0.108299 Jun 20 07:10:25.271725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 257/515] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:25 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:25.423028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d9efd5d4-16f8-43d1-95a8-55294dcaa52f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:25.424002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d9efd5d4-16f8-43d1-95a8-55294dcaa52f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:25.430475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9efd5d4-16f8-43d1-95a8-55294dcaa52f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:25.430918 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9efd5d4-16f8-43d1-95a8-55294dcaa52f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:25.431674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9efd5d4-16f8-43d1-95a8-55294dcaa52f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:25.432101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9efd5d4-16f8-43d1-95a8-55294dcaa52f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:25.697585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d9efd5d4-16f8-43d1-95a8-55294dcaa52f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:25.718900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d9efd5d4-16f8-43d1-95a8-55294dcaa52f tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1681 microversion: 2.1 time: 0.299855 Jun 20 07:10:25.719634 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 259/516] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:25 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1681 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:25.780037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7b724383-ddbb-4df4-b967-3cc4711377dd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:25.780920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7b724383-ddbb-4df4-b967-3cc4711377dd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:25.787927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b724383-ddbb-4df4-b967-3cc4711377dd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:25.788417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b724383-ddbb-4df4-b967-3cc4711377dd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:25.789185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b724383-ddbb-4df4-b967-3cc4711377dd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:25.789625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b724383-ddbb-4df4-b967-3cc4711377dd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:25.845554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d424d52-78ec-4088-979f-af2b534f687f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:25.846171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d424d52-78ec-4088-979f-af2b534f687f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:25.858506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d424d52-78ec-4088-979f-af2b534f687f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:25.858954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d424d52-78ec-4088-979f-af2b534f687f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:25.859909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d424d52-78ec-4088-979f-af2b534f687f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:25.860428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d424d52-78ec-4088-979f-af2b534f687f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:26.417261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d424d52-78ec-4088-979f-af2b534f687f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:26.426455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d424d52-78ec-4088-979f-af2b534f687f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:26.428822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d424d52-78ec-4088-979f-af2b534f687f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:26.430080 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d424d52-78ec-4088-979f-af2b534f687f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.603706 Jun 20 07:10:26.430868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 260/517] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:25 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:26.436206 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-44d72850-351f-457a-ac1c-ccaadf56d56c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:26.437074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-44d72850-351f-457a-ac1c-ccaadf56d56c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:26.444562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44d72850-351f-457a-ac1c-ccaadf56d56c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:26.445063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44d72850-351f-457a-ac1c-ccaadf56d56c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:26.445911 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44d72850-351f-457a-ac1c-ccaadf56d56c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:26.446411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-44d72850-351f-457a-ac1c-ccaadf56d56c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:26.468531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b724383-ddbb-4df4-b967-3cc4711377dd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:26.477222 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7b724383-ddbb-4df4-b967-3cc4711377dd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1264 microversion: 2.1 time: 0.700924 Jun 20 07:10:26.487518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 258/518] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:25 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1264 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:26.557428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-44d72850-351f-457a-ac1c-ccaadf56d56c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:26.565663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-44d72850-351f-457a-ac1c-ccaadf56d56c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1276 microversion: 2.1 time: 0.133516 Jun 20 07:10:26.566231 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 261/519] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:26 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:26.737123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-58f396f4-0335-416b-b365-8034f9a4ea2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:26.737776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-58f396f4-0335-416b-b365-8034f9a4ea2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:26.744204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58f396f4-0335-416b-b365-8034f9a4ea2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:26.744829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58f396f4-0335-416b-b365-8034f9a4ea2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:26.745558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58f396f4-0335-416b-b365-8034f9a4ea2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:26.746039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58f396f4-0335-416b-b365-8034f9a4ea2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:26.766329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-fc5f5757-d092-434d-a9dd-3f839922d3eb req-be489ec7-6ae4-4a95-8d2d-627055d4adb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53321809-7dd1-4d7b-b6b8-5a58b1e907f2", "name": "network-vif-deleted", "tag": "aa136057-a2bf-4714-9bf0-13fed4a7b779"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:26.780733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-fc5f5757-d092-434d-a9dd-3f839922d3eb req-be489ec7-6ae4-4a95-8d2d-627055d4adb1 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:26.781596 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-fc5f5757-d092-434d-a9dd-3f839922d3eb req-be489ec7-6ae4-4a95-8d2d-627055d4adb1 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:26.815112 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-fc5f5757-d092-434d-a9dd-3f839922d3eb req-be489ec7-6ae4-4a95-8d2d-627055d4adb1 service nova] Creating event network-vif-deleted:aa136057-a2bf-4714-9bf0-13fed4a7b779 for instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 on hv-cinder-77819 Jun 20 07:10:26.835878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-fc5f5757-d092-434d-a9dd-3f839922d3eb req-be489ec7-6ae4-4a95-8d2d-627055d4adb1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074174 Jun 20 07:10:26.838245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 262/520] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:10:26.840340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-58f396f4-0335-416b-b365-8034f9a4ea2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:26.873577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-58f396f4-0335-416b-b365-8034f9a4ea2b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 200 len: 1613 microversion: 2.1 time: 0.140210 Jun 20 07:10:26.880729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 259/521] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:26 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 1613 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:27.450444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-12d9a88f-8fe7-4b44-a656-67372102df86 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:27.452900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-12d9a88f-8fe7-4b44-a656-67372102df86 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:27.466669 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12d9a88f-8fe7-4b44-a656-67372102df86 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:27.468015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12d9a88f-8fe7-4b44-a656-67372102df86 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:27.468854 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12d9a88f-8fe7-4b44-a656-67372102df86 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:27.469298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12d9a88f-8fe7-4b44-a656-67372102df86 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:27.503618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-228eb594-829c-4616-8aaa-33b55346186b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:27.504359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-228eb594-829c-4616-8aaa-33b55346186b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:27.534746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-228eb594-829c-4616-8aaa-33b55346186b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:27.535310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-228eb594-829c-4616-8aaa-33b55346186b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:27.536137 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-228eb594-829c-4616-8aaa-33b55346186b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:27.536578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-228eb594-829c-4616-8aaa-33b55346186b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:27.913890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-12d9a88f-8fe7-4b44-a656-67372102df86 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:27.924486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-12d9a88f-8fe7-4b44-a656-67372102df86 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:27.926683 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-12d9a88f-8fe7-4b44-a656-67372102df86 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:27.928219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-12d9a88f-8fe7-4b44-a656-67372102df86 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.482569 Jun 20 07:10:27.928940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 263/522] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:27 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:27.933998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-228eb594-829c-4616-8aaa-33b55346186b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:27.936478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf7f38ff-ef7f-4ec7-a8d2-be374c27aa8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:27.941435 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bf7f38ff-ef7f-4ec7-a8d2-be374c27aa8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:27.946996 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-228eb594-829c-4616-8aaa-33b55346186b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1450 microversion: 2.1 time: 0.456266 Jun 20 07:10:27.948317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 260/523] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:27 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1450 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:10:27.953624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-632e560a-8341-4bcd-b6c3-e9f223d9b5ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:27.954236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-632e560a-8341-4bcd-b6c3-e9f223d9b5ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:27.961231 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf7f38ff-ef7f-4ec7-a8d2-be374c27aa8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:27.962056 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf7f38ff-ef7f-4ec7-a8d2-be374c27aa8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:27.963053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf7f38ff-ef7f-4ec7-a8d2-be374c27aa8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:27.963167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-632e560a-8341-4bcd-b6c3-e9f223d9b5ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:27.963591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-632e560a-8341-4bcd-b6c3-e9f223d9b5ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:27.964053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf7f38ff-ef7f-4ec7-a8d2-be374c27aa8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:27.964411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-632e560a-8341-4bcd-b6c3-e9f223d9b5ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:27.964846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-632e560a-8341-4bcd-b6c3-e9f223d9b5ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:27.983168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-632e560a-8341-4bcd-b6c3-e9f223d9b5ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-632e560a-8341-4bcd-b6c3-e9f223d9b5ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 HTTP/1.1 Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:10:27.985484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:10:27.986765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:10:27.986765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:10:27.986765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:10:27.986765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:10:27.986765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:10:27.986765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:10:27.986765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:10:27.986765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:10:27.986765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:10:27.986765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:10:27.986765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:10:27.986765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '53321809-7dd1-4d7b-b6b8-5a58b1e907f2'} Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:10:27.987471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:10:27.989143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:10:27.993952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-632e560a-8341-4bcd-b6c3-e9f223d9b5ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:10:27.995027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-632e560a-8341-4bcd-b6c3-e9f223d9b5ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 404 len: 111 microversion: 2.1 time: 0.045407 Jun 20 07:10:27.995695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 261/524] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:27 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:10:28.001603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fbf31054-34d5-4ccd-ae2f-1f58976cf6be tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:28.002296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fbf31054-34d5-4ccd-ae2f-1f58976cf6be tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:28.011894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbf31054-34d5-4ccd-ae2f-1f58976cf6be tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:28.012372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbf31054-34d5-4ccd-ae2f-1f58976cf6be tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:28.013250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbf31054-34d5-4ccd-ae2f-1f58976cf6be tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:28.013712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbf31054-34d5-4ccd-ae2f-1f58976cf6be tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:28.236752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bf7f38ff-ef7f-4ec7-a8d2-be374c27aa8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:28.252282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bf7f38ff-ef7f-4ec7-a8d2-be374c27aa8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1318 microversion: 2.1 time: 0.319587 Jun 20 07:10:28.252282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 264/525] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:27 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:28.255741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0d46d5fe-d966-4129-83ba-7f5054683a65 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '.version_select at 0x7ffa1fc774c0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:28.278119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0d46d5fe-d966-4129-83ba-7f5054683a65 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487374024" status: 202 len: 0 microversion: 2.1 time: 0.026140 Jun 20 07:10:28.278715 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 265/526] 10.222.0.23 () {58 vars in 1220 bytes} [Mon Jun 20 07:10:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487374024 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:10:28.313063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fbf31054-34d5-4ccd-ae2f-1f58976cf6be tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:28.321313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fbf31054-34d5-4ccd-ae2f-1f58976cf6be tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1450 microversion: 2.1 time: 0.323910 Jun 20 07:10:28.332770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 262/527] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:27 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1450 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:28.852158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-6dc5b143-08d7-4056-9b24-758c5d7beca2 req-492e9033-27d0-4617-8c98-38c252e4eb98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec0ea04e-5c9f-4536-b200-1eaf64edef9c", "tag": "7ad9a67b-4e75-4ed0-914e-85eca4e84023"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:28.862118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-6dc5b143-08d7-4056-9b24-758c5d7beca2 req-492e9033-27d0-4617-8c98-38c252e4eb98 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:28.862808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-6dc5b143-08d7-4056-9b24-758c5d7beca2 req-492e9033-27d0-4617-8c98-38c252e4eb98 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:28.874011 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-6dc5b143-08d7-4056-9b24-758c5d7beca2 req-492e9033-27d0-4617-8c98-38c252e4eb98 service nova] Creating event network-changed:7ad9a67b-4e75-4ed0-914e-85eca4e84023 for instance ec0ea04e-5c9f-4536-b200-1eaf64edef9c on hv-cinder-77819 Jun 20 07:10:28.878799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-6dc5b143-08d7-4056-9b24-758c5d7beca2 req-492e9033-27d0-4617-8c98-38c252e4eb98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031066 Jun 20 07:10:28.880010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 266/528] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:28.947357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4a2da66f-c78a-490c-9976-014e7a44df02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:28.947357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4a2da66f-c78a-490c-9976-014e7a44df02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:28.956157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a2da66f-c78a-490c-9976-014e7a44df02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:28.956598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a2da66f-c78a-490c-9976-014e7a44df02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:28.957365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a2da66f-c78a-490c-9976-014e7a44df02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:28.957794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a2da66f-c78a-490c-9976-014e7a44df02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:29.232987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4a2da66f-c78a-490c-9976-014e7a44df02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:29.248909 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4a2da66f-c78a-490c-9976-014e7a44df02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:29.254833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4a2da66f-c78a-490c-9976-014e7a44df02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:29.256269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4a2da66f-c78a-490c-9976-014e7a44df02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.313377 Jun 20 07:10:29.257119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 263/529] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:28 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:29.273588 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75c14d2a-5a31-4fc9-acad-b7ba25d4ec02 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:29.274482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-75c14d2a-5a31-4fc9-acad-b7ba25d4ec02 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:29.294747 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75c14d2a-5a31-4fc9-acad-b7ba25d4ec02 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:29.295282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75c14d2a-5a31-4fc9-acad-b7ba25d4ec02 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:29.296138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75c14d2a-5a31-4fc9-acad-b7ba25d4ec02 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:29.296567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75c14d2a-5a31-4fc9-acad-b7ba25d4ec02 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:29.477463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-75c14d2a-5a31-4fc9-acad-b7ba25d4ec02 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:29.485761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-75c14d2a-5a31-4fc9-acad-b7ba25d4ec02 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1318 microversion: 2.1 time: 0.218647 Jun 20 07:10:29.488624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 267/530] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:29 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:29.507783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2ea64f3c-f7ca-42e3-b8ed-78ac98003529 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:29.508439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2ea64f3c-f7ca-42e3-b8ed-78ac98003529 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:29.514608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ea64f3c-f7ca-42e3-b8ed-78ac98003529 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:29.515037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ea64f3c-f7ca-42e3-b8ed-78ac98003529 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:29.516193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ea64f3c-f7ca-42e3-b8ed-78ac98003529 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:29.517068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ea64f3c-f7ca-42e3-b8ed-78ac98003529 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:29.604551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-2ea64f3c-f7ca-42e3-b8ed-78ac98003529 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lazy-loading 'services' on Instance uuid b09ad717-132f-4b7d-896e-48b569f56e34 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:10:29.674791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2ea64f3c-f7ca-42e3-b8ed-78ac98003529 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/os-volume_attachments/e16eaeed-7bc9-4197-8190-4863c7c5c28b" status: 202 len: 0 microversion: 2.1 time: 0.170837 Jun 20 07:10:29.675597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 264/531] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:10:29 2022] DELETE /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/os-volume_attachments/e16eaeed-7bc9-4197-8190-4863c7c5c28b => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:10:29.683955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cdb8f1fb-cdcd-4eb1-b9ae-cadd0e146009 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:29.684933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cdb8f1fb-cdcd-4eb1-b9ae-cadd0e146009 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:29.691492 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cdb8f1fb-cdcd-4eb1-b9ae-cadd0e146009 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:29.691944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cdb8f1fb-cdcd-4eb1-b9ae-cadd0e146009 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:29.692785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cdb8f1fb-cdcd-4eb1-b9ae-cadd0e146009 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:29.693224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cdb8f1fb-cdcd-4eb1-b9ae-cadd0e146009 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:29.724722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cdb8f1fb-cdcd-4eb1-b9ae-cadd0e146009 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Jun 20 07:10:29.725375 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 268/532] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:10:29 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:30.280835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8cddff2b-2a6a-474c-beff-6aa25b4aee0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:30.281738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8cddff2b-2a6a-474c-beff-6aa25b4aee0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:30.289210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8cddff2b-2a6a-474c-beff-6aa25b4aee0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:30.289656 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8cddff2b-2a6a-474c-beff-6aa25b4aee0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:30.290635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8cddff2b-2a6a-474c-beff-6aa25b4aee0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:30.291079 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8cddff2b-2a6a-474c-beff-6aa25b4aee0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:30.503020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-acd86288-62ef-45e8-ad39-eccd9f022165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:30.504177 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-acd86288-62ef-45e8-ad39-eccd9f022165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:30.507546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8cddff2b-2a6a-474c-beff-6aa25b4aee0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:30.512672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acd86288-62ef-45e8-ad39-eccd9f022165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:30.513377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acd86288-62ef-45e8-ad39-eccd9f022165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:30.514917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acd86288-62ef-45e8-ad39-eccd9f022165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:30.515573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acd86288-62ef-45e8-ad39-eccd9f022165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:30.523742 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8cddff2b-2a6a-474c-beff-6aa25b4aee0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:30.525380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8cddff2b-2a6a-474c-beff-6aa25b4aee0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:30.526823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8cddff2b-2a6a-474c-beff-6aa25b4aee0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.252220 Jun 20 07:10:30.538067 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 265/533] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:30 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:30.663828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-d61b7363-be34-4edd-b1ad-7bd60fd76749 req-6b4bdb47-c062-43eb-878c-001879c9e9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de77ef2f-9577-403b-99e7-2540b785a6d3", "tag": "ad8416ab-dcec-4280-89aa-c020d26b2a20"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:30.675240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d61b7363-be34-4edd-b1ad-7bd60fd76749 req-6b4bdb47-c062-43eb-878c-001879c9e9f0 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:30.675932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d61b7363-be34-4edd-b1ad-7bd60fd76749 req-6b4bdb47-c062-43eb-878c-001879c9e9f0 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:30.691970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-d61b7363-be34-4edd-b1ad-7bd60fd76749 req-6b4bdb47-c062-43eb-878c-001879c9e9f0 service nova] Creating event network-changed:ad8416ab-dcec-4280-89aa-c020d26b2a20 for instance de77ef2f-9577-403b-99e7-2540b785a6d3 on hv-cinder-77819 Jun 20 07:10:30.696007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-acd86288-62ef-45e8-ad39-eccd9f022165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:30.706976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-acd86288-62ef-45e8-ad39-eccd9f022165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1318 microversion: 2.1 time: 0.208923 Jun 20 07:10:30.716482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 269/534] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:30 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:10:30.717212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-d61b7363-be34-4edd-b1ad-7bd60fd76749 req-6b4bdb47-c062-43eb-878c-001879c9e9f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053757 Jun 20 07:10:30.717212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 266/535] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:10:30.736435 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0cb1ef4e-03a9-4d19-bcfa-5dd494b034ee tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:30.737802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0cb1ef4e-03a9-4d19-bcfa-5dd494b034ee tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:30.744409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cb1ef4e-03a9-4d19-bcfa-5dd494b034ee tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:30.745264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cb1ef4e-03a9-4d19-bcfa-5dd494b034ee tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:30.746265 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cb1ef4e-03a9-4d19-bcfa-5dd494b034ee tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:30.746890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cb1ef4e-03a9-4d19-bcfa-5dd494b034ee tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:30.775876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:30.781067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0cb1ef4e-03a9-4d19-bcfa-5dd494b034ee tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048584 Jun 20 07:10:30.782062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 270/536] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:10:30 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:31.547203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6871fcac-5557-42dc-8a61-2dceede099fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:31.548141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6871fcac-5557-42dc-8a61-2dceede099fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:31.563537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6871fcac-5557-42dc-8a61-2dceede099fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:31.563996 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6871fcac-5557-42dc-8a61-2dceede099fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:31.565003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6871fcac-5557-42dc-8a61-2dceede099fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:31.565254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6871fcac-5557-42dc-8a61-2dceede099fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:31.724857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bed682d4-b752-41ce-a446-727284db74c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:31.726310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bed682d4-b752-41ce-a446-727284db74c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:31.748903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bed682d4-b752-41ce-a446-727284db74c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:31.749627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bed682d4-b752-41ce-a446-727284db74c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:31.750651 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bed682d4-b752-41ce-a446-727284db74c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:31.751324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bed682d4-b752-41ce-a446-727284db74c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:32.270707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bed682d4-b752-41ce-a446-727284db74c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:32.278762 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bed682d4-b752-41ce-a446-727284db74c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1318 microversion: 2.1 time: 0.558236 Jun 20 07:10:32.287993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 271/537] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:31 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:10:32.293604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a30d9f74-7755-41b7-b26f-316b743b0026 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:32.294549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a30d9f74-7755-41b7-b26f-316b743b0026 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:32.301155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a30d9f74-7755-41b7-b26f-316b743b0026 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:32.301603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a30d9f74-7755-41b7-b26f-316b743b0026 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:32.302389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a30d9f74-7755-41b7-b26f-316b743b0026 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:32.302817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a30d9f74-7755-41b7-b26f-316b743b0026 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:32.332678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a30d9f74-7755-41b7-b26f-316b743b0026 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051142 Jun 20 07:10:32.333250 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 272/538] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:10:32 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 07:10:32.357925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6871fcac-5557-42dc-8a61-2dceede099fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:32.367162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6871fcac-5557-42dc-8a61-2dceede099fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:32.368813 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6871fcac-5557-42dc-8a61-2dceede099fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:32.370094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6871fcac-5557-42dc-8a61-2dceede099fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.828459 Jun 20 07:10:32.371254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 267/539] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:31 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:32.395192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-23059db2-4011-4e87-b458-7123840dafe3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:32.395794 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-23059db2-4011-4e87-b458-7123840dafe3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:32.401878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23059db2-4011-4e87-b458-7123840dafe3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:32.402401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23059db2-4011-4e87-b458-7123840dafe3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:32.403180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23059db2-4011-4e87-b458-7123840dafe3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:32.403632 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23059db2-4011-4e87-b458-7123840dafe3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:32.428300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-23059db2-4011-4e87-b458-7123840dafe3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:10:32.507725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-23059db2-4011-4e87-b458-7123840dafe3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 204 len: 0 microversion: 2.1 time: 0.116222 Jun 20 07:10:32.508659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 273/540] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:10:32 2022] DELETE /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 07:10:32.520421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9238f4fa-5e16-4dbd-b755-28b2466ad60e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:32.521229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9238f4fa-5e16-4dbd-b755-28b2466ad60e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:32.527397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9238f4fa-5e16-4dbd-b755-28b2466ad60e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:32.527913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9238f4fa-5e16-4dbd-b755-28b2466ad60e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:32.528803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9238f4fa-5e16-4dbd-b755-28b2466ad60e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:32.529369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9238f4fa-5e16-4dbd-b755-28b2466ad60e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:32.677036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9238f4fa-5e16-4dbd-b755-28b2466ad60e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:32.684399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9238f4fa-5e16-4dbd-b755-28b2466ad60e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1680 microversion: 2.1 time: 0.170291 Jun 20 07:10:32.684950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 268/541] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:32 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:33.295348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-df6942e6-9884-4e20-b73e-451fd79bbd11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:33.296055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-df6942e6-9884-4e20-b73e-451fd79bbd11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:33.302478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df6942e6-9884-4e20-b73e-451fd79bbd11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:33.302926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df6942e6-9884-4e20-b73e-451fd79bbd11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:33.303689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df6942e6-9884-4e20-b73e-451fd79bbd11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:33.304145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df6942e6-9884-4e20-b73e-451fd79bbd11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:33.381764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-d3a2eca9-b2e2-4fb0-a11d-620c9d00ad41 req-02b5b0f3-2d26-4a14-979b-ab05bf73643e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0ea04e-5c9f-4536-b200-1eaf64edef9c", "name": "network-vif-plugged", "status": "completed", "tag": "7ad9a67b-4e75-4ed0-914e-85eca4e84023"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:33.387490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:33.388346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=8 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:33.395614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d3a2eca9-b2e2-4fb0-a11d-620c9d00ad41 req-02b5b0f3-2d26-4a14-979b-ab05bf73643e service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:33.396359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d3a2eca9-b2e2-4fb0-a11d-620c9d00ad41 req-02b5b0f3-2d26-4a14-979b-ab05bf73643e service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:33.411955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-d3a2eca9-b2e2-4fb0-a11d-620c9d00ad41 req-02b5b0f3-2d26-4a14-979b-ab05bf73643e service nova] Creating event network-vif-plugged:7ad9a67b-4e75-4ed0-914e-85eca4e84023 for instance ec0ea04e-5c9f-4536-b200-1eaf64edef9c on hv-cinder-77819 Jun 20 07:10:33.417049 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-d3a2eca9-b2e2-4fb0-a11d-620c9d00ad41 req-02b5b0f3-2d26-4a14-979b-ab05bf73643e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039095 Jun 20 07:10:33.417831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 269/542] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:10:33.424424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-da1a9d6f-ba42-4676-a244-035b1438e799 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:33.425295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-da1a9d6f-ba42-4676-a244-035b1438e799 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:33.432478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da1a9d6f-ba42-4676-a244-035b1438e799 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:33.433380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da1a9d6f-ba42-4676-a244-035b1438e799 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:33.434482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da1a9d6f-ba42-4676-a244-035b1438e799 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:33.434632 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da1a9d6f-ba42-4676-a244-035b1438e799 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:33.446495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-df6942e6-9884-4e20-b73e-451fd79bbd11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:33.454752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-df6942e6-9884-4e20-b73e-451fd79bbd11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1318 microversion: 2.1 time: 0.163686 Jun 20 07:10:33.455325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 274/543] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:33 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:33.595441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-da1a9d6f-ba42-4676-a244-035b1438e799 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:33.603968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-da1a9d6f-ba42-4676-a244-035b1438e799 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:33.605552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-da1a9d6f-ba42-4676-a244-035b1438e799 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:33.606659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-da1a9d6f-ba42-4676-a244-035b1438e799 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.187617 Jun 20 07:10:33.607229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 270/544] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:33 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:33.702814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ea43a2c1-40c6-40a6-bb40-dc67264d8e59 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:33.703447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ea43a2c1-40c6-40a6-bb40-dc67264d8e59 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:33.709534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea43a2c1-40c6-40a6-bb40-dc67264d8e59 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:33.709884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea43a2c1-40c6-40a6-bb40-dc67264d8e59 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:33.710635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea43a2c1-40c6-40a6-bb40-dc67264d8e59 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:33.711085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea43a2c1-40c6-40a6-bb40-dc67264d8e59 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:33.851820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ea43a2c1-40c6-40a6-bb40-dc67264d8e59 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:33.860001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ea43a2c1-40c6-40a6-bb40-dc67264d8e59 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1680 microversion: 2.1 time: 0.161630 Jun 20 07:10:33.860527 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 275/545] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:33 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:34.471401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7ffe81ee-d948-48f4-9808-6cad47aaae23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:34.471941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7ffe81ee-d948-48f4-9808-6cad47aaae23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:34.478099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ffe81ee-d948-48f4-9808-6cad47aaae23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:34.478546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ffe81ee-d948-48f4-9808-6cad47aaae23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:34.479305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ffe81ee-d948-48f4-9808-6cad47aaae23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:34.479735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ffe81ee-d948-48f4-9808-6cad47aaae23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:34.615649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7ffe81ee-d948-48f4-9808-6cad47aaae23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:34.623591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7ffe81ee-d948-48f4-9808-6cad47aaae23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1318 microversion: 2.1 time: 0.155446 Jun 20 07:10:34.624175 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 271/546] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:34 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:34.628798 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a8fb1a79-0f7a-43ff-81d8-ab143c323116 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:34.629416 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a8fb1a79-0f7a-43ff-81d8-ab143c323116 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:34.636042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8fb1a79-0f7a-43ff-81d8-ab143c323116 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:34.636503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8fb1a79-0f7a-43ff-81d8-ab143c323116 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:34.637263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8fb1a79-0f7a-43ff-81d8-ab143c323116 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:34.637696 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8fb1a79-0f7a-43ff-81d8-ab143c323116 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:34.821198 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a8fb1a79-0f7a-43ff-81d8-ab143c323116 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:34.830631 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a8fb1a79-0f7a-43ff-81d8-ab143c323116 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:34.832232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a8fb1a79-0f7a-43ff-81d8-ab143c323116 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:34.833430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a8fb1a79-0f7a-43ff-81d8-ab143c323116 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.208488 Jun 20 07:10:34.844168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 276/547] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:34 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:34.878591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fa98797f-7bed-4b0a-b654-f610e6a418d8 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:34.879453 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fa98797f-7bed-4b0a-b654-f610e6a418d8 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:34.886896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa98797f-7bed-4b0a-b654-f610e6a418d8 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:34.888551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa98797f-7bed-4b0a-b654-f610e6a418d8 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:34.889497 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa98797f-7bed-4b0a-b654-f610e6a418d8 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:34.890096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa98797f-7bed-4b0a-b654-f610e6a418d8 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:35.120137 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fa98797f-7bed-4b0a-b654-f610e6a418d8 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:35.128215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fa98797f-7bed-4b0a-b654-f610e6a418d8 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1680 microversion: 2.1 time: 0.254225 Jun 20 07:10:35.128791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 272/548] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:34 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:35.433416 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-271f0de9-268b-4918-9c85-6b52f1e0b517 req-0c5fcd99-6f17-46da-bbdb-07ba77a637a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e214060-f046-41a1-b243-020c88edde42", "name": "network-vif-plugged", "status": "completed", "tag": "316c2317-90c4-4b27-bb5e-34a3153b065e"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:35.441698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-271f0de9-268b-4918-9c85-6b52f1e0b517 req-0c5fcd99-6f17-46da-bbdb-07ba77a637a0 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:35.442148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-271f0de9-268b-4918-9c85-6b52f1e0b517 req-0c5fcd99-6f17-46da-bbdb-07ba77a637a0 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:35.453601 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-271f0de9-268b-4918-9c85-6b52f1e0b517 req-0c5fcd99-6f17-46da-bbdb-07ba77a637a0 service nova] Creating event network-vif-plugged:316c2317-90c4-4b27-bb5e-34a3153b065e for instance 0e214060-f046-41a1-b243-020c88edde42 on hv-cinder-77819 Jun 20 07:10:35.458383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-271f0de9-268b-4918-9c85-6b52f1e0b517 req-0c5fcd99-6f17-46da-bbdb-07ba77a637a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028653 Jun 20 07:10:35.459150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 277/549] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:35.612857 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-d70d2b38-788b-4d11-b029-0d7aaef8b58b req-73fcf6ad-4ddd-4a98-b141-9d731aad05d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09ad717-132f-4b7d-896e-48b569f56e34", "name": "network-vif-deleted", "tag": "d4ec0034-9c02-41b8-881f-5fa07d109509"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:35.622513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d70d2b38-788b-4d11-b029-0d7aaef8b58b req-73fcf6ad-4ddd-4a98-b141-9d731aad05d1 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:35.623045 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d70d2b38-788b-4d11-b029-0d7aaef8b58b req-73fcf6ad-4ddd-4a98-b141-9d731aad05d1 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:35.640838 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-d70d2b38-788b-4d11-b029-0d7aaef8b58b req-73fcf6ad-4ddd-4a98-b141-9d731aad05d1 service nova] Creating event network-vif-deleted:d4ec0034-9c02-41b8-881f-5fa07d109509 for instance b09ad717-132f-4b7d-896e-48b569f56e34 on hv-cinder-77819 Jun 20 07:10:35.643578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e288d5bf-e134-4b56-8b6d-1899632b1aa2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:35.644389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e288d5bf-e134-4b56-8b6d-1899632b1aa2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:35.646151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-d70d2b38-788b-4d11-b029-0d7aaef8b58b req-73fcf6ad-4ddd-4a98-b141-9d731aad05d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037977 Jun 20 07:10:35.646847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 273/550] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:35.652357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e288d5bf-e134-4b56-8b6d-1899632b1aa2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:35.652853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e288d5bf-e134-4b56-8b6d-1899632b1aa2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:35.653774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e288d5bf-e134-4b56-8b6d-1899632b1aa2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:35.654880 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e288d5bf-e134-4b56-8b6d-1899632b1aa2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:35.798019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e288d5bf-e134-4b56-8b6d-1899632b1aa2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:35.805827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e288d5bf-e134-4b56-8b6d-1899632b1aa2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1318 microversion: 2.1 time: 0.167885 Jun 20 07:10:35.815931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 278/551] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:35 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:10:35.860618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6251adbf-7b92-4729-99da-51e85dfb2c7c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:35.861414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6251adbf-7b92-4729-99da-51e85dfb2c7c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:35.874715 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6251adbf-7b92-4729-99da-51e85dfb2c7c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:35.875164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6251adbf-7b92-4729-99da-51e85dfb2c7c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:35.875926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6251adbf-7b92-4729-99da-51e85dfb2c7c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:35.876379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6251adbf-7b92-4729-99da-51e85dfb2c7c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:35.892153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:36.039025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6251adbf-7b92-4729-99da-51e85dfb2c7c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:36.047687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6251adbf-7b92-4729-99da-51e85dfb2c7c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:36.049839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6251adbf-7b92-4729-99da-51e85dfb2c7c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:36.051008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6251adbf-7b92-4729-99da-51e85dfb2c7c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.202816 Jun 20 07:10:36.051570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 274/552] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:35 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:36.146279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5b404f5a-4c2f-4637-a62f-1536c08b53bc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:36.146926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5b404f5a-4c2f-4637-a62f-1536c08b53bc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:36.153060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b404f5a-4c2f-4637-a62f-1536c08b53bc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:36.153514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b404f5a-4c2f-4637-a62f-1536c08b53bc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:36.154281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b404f5a-4c2f-4637-a62f-1536c08b53bc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:36.154719 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b404f5a-4c2f-4637-a62f-1536c08b53bc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:36.216429 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5b404f5a-4c2f-4637-a62f-1536c08b53bc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:36.225157 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5b404f5a-4c2f-4637-a62f-1536c08b53bc tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 200 len: 1325 microversion: 2.1 time: 0.082955 Jun 20 07:10:36.226098 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 279/553] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:36 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 1325 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:36.822834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3909054b-a4ea-4914-8c3e-8515e2be7cf7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:36.823476 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3909054b-a4ea-4914-8c3e-8515e2be7cf7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:36.831621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3909054b-a4ea-4914-8c3e-8515e2be7cf7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:36.832270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3909054b-a4ea-4914-8c3e-8515e2be7cf7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:36.832872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3909054b-a4ea-4914-8c3e-8515e2be7cf7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:36.833353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3909054b-a4ea-4914-8c3e-8515e2be7cf7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:36.973170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3909054b-a4ea-4914-8c3e-8515e2be7cf7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:36.980641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3909054b-a4ea-4914-8c3e-8515e2be7cf7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1507 microversion: 2.1 time: 0.161693 Jun 20 07:10:36.981212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 275/554] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:36 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:36.997100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a49ec0b9-33fb-4215-9f22-f959263b5369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1506b860-9804-4937-91ad-42a1a0896204", "device": "/dev/sdb"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:36.999368 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a49ec0b9-33fb-4215-9f22-f959263b5369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:37.005786 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a49ec0b9-33fb-4215-9f22-f959263b5369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:37.006241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a49ec0b9-33fb-4215-9f22-f959263b5369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:37.007003 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a49ec0b9-33fb-4215-9f22-f959263b5369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:37.007445 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a49ec0b9-33fb-4215-9f22-f959263b5369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:37.069738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f23c6d2d-171e-4850-ac24-8a6535514d68 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:37.070462 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f23c6d2d-171e-4850-ac24-8a6535514d68 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:37.076511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f23c6d2d-171e-4850-ac24-8a6535514d68 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:37.076954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f23c6d2d-171e-4850-ac24-8a6535514d68 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:37.077707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f23c6d2d-171e-4850-ac24-8a6535514d68 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:37.078136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f23c6d2d-171e-4850-ac24-8a6535514d68 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:37.224771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f23c6d2d-171e-4850-ac24-8a6535514d68 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:37.238088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f23c6d2d-171e-4850-ac24-8a6535514d68 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:37.239815 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f23c6d2d-171e-4850-ac24-8a6535514d68 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:37.241667 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f23c6d2d-171e-4850-ac24-8a6535514d68 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.175608 Jun 20 07:10:37.242859 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 276/555] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:37 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:37.249994 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e3ae34a3-9075-4491-acfe-d6cad23cbe23 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:37.250975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e3ae34a3-9075-4491-acfe-d6cad23cbe23 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:37.260024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3ae34a3-9075-4491-acfe-d6cad23cbe23 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:37.260718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3ae34a3-9075-4491-acfe-d6cad23cbe23 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:37.261989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3ae34a3-9075-4491-acfe-d6cad23cbe23 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:37.262568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3ae34a3-9075-4491-acfe-d6cad23cbe23 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:37.277364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-e3ae34a3-9075-4491-acfe-d6cad23cbe23 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e3ae34a3-9075-4491-acfe-d6cad23cbe23 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 HTTP/1.1 Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:10:37.280084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:10:37.281445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:10:37.281445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:10:37.281445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:10:37.281445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:10:37.281445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:10:37.281445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:10:37.281445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:10:37.281445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:10:37.281445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:10:37.281445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:10:37.281445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:10:37.281445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': 'b09ad717-132f-4b7d-896e-48b569f56e34'} Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:10:37.282498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:10:37.284101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:10:37.285434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e3ae34a3-9075-4491-acfe-d6cad23cbe23 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:10:37.285434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e3ae34a3-9075-4491-acfe-d6cad23cbe23 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 404 len: 111 microversion: 2.1 time: 0.035450 Jun 20 07:10:37.285434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 277/556] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:37 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:10:37.290429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-436c2a68-ab15-45cb-a663-271dde6a6cf0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '.version_select at 0x7ffa1fca7ee0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:37.311969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-436c2a68-ab15-45cb-a663-271dde6a6cf0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-625940569" status: 202 len: 0 microversion: 2.1 time: 0.024656 Jun 20 07:10:37.312938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 278/557] 10.222.0.23 () {58 vars in 1217 bytes} [Mon Jun 20 07:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-625940569 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 07:10:37.318761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a49ec0b9-33fb-4215-9f22-f959263b5369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "POST /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325148 Jun 20 07:10:37.319380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 280/558] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 07:10:36 2022] POST /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:37.941608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-79757277-b43d-4587-a230-11e9d3a0089d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Action: 'create', calling method: .version_select at 0x7ffa1fc28310>, body: {"keypair": {"name": "tempest-keypair-1576413692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzgOm06gW8obKzW5RK8l9mmZBaFgt2H+gZxQKkezeBZbmHqqWNwxAP3Zr8Ip4utFYiVxgA2Qo0GDsiuiKb2QcbYJEoxwB9eStu4azuqEgtRwuDwsGycDTNas2+qr/q5aA=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:37.956278 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-79757277-b43d-4587-a230-11e9d3a0089d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:10:37.960070 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-79757277-b43d-4587-a230-11e9d3a0089d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for user f66183ca9d884f43befaace02099c7f2 and project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:10:37.980903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-79757277-b43d-4587-a230-11e9d3a0089d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043676 Jun 20 07:10:37.981470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 279/559] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 07:10:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:38.260781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-198b5bab-b089-4f53-81fc-0ce532533310 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:38.261641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-198b5bab-b089-4f53-81fc-0ce532533310 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:38.269658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-198b5bab-b089-4f53-81fc-0ce532533310 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:38.270117 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-198b5bab-b089-4f53-81fc-0ce532533310 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:38.270883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-198b5bab-b089-4f53-81fc-0ce532533310 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:38.271319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-198b5bab-b089-4f53-81fc-0ce532533310 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:38.452649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-198b5bab-b089-4f53-81fc-0ce532533310 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:38.461088 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-198b5bab-b089-4f53-81fc-0ce532533310 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:38.462598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-198b5bab-b089-4f53-81fc-0ce532533310 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:38.463953 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-198b5bab-b089-4f53-81fc-0ce532533310 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.207585 Jun 20 07:10:38.464558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 281/560] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:38 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:39.484066 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d52cce95-76c5-4c2f-88b7-08c0bbc418e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:39.488160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d52cce95-76c5-4c2f-88b7-08c0bbc418e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:39.496309 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d52cce95-76c5-4c2f-88b7-08c0bbc418e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:39.496838 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d52cce95-76c5-4c2f-88b7-08c0bbc418e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:39.498318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d52cce95-76c5-4c2f-88b7-08c0bbc418e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:39.498832 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d52cce95-76c5-4c2f-88b7-08c0bbc418e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:39.644951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d52cce95-76c5-4c2f-88b7-08c0bbc418e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:39.656545 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d52cce95-76c5-4c2f-88b7-08c0bbc418e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:39.658332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d52cce95-76c5-4c2f-88b7-08c0bbc418e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:39.659613 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d52cce95-76c5-4c2f-88b7-08c0bbc418e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1806 microversion: 2.20 time: 0.180654 Jun 20 07:10:39.660301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 280/561] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:39 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:10:39.783589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2123212543", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "882e9092-6971-4957-9705-059b858de12f"}], "security_groups": [{"name": "tempest-securitygroup--552554310"}], "key_name": "tempest-keypair-1576413692", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:39.888996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] validate_networks() for [('882e9092-6971-4957-9705-059b858de12f', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:10:40.243028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:10:40.243458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:10:40.243938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:10:40.244404 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:10:40.244822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:10:40.253548 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:40.254005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:40.254805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:40.255247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:40.272173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:10:40.276089 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for user f66183ca9d884f43befaace02099c7f2 and project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:10:40.287387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:10:40.289781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:10:40.335462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-60b6b29f-8cfb-4f59-b747-f575bb92e414 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.556150 Jun 20 07:10:40.336226 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 282/562] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:10:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:10:40.346689 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-65d9316b-e47d-409f-8ff1-e6fb758f3955 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:40.347520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-65d9316b-e47d-409f-8ff1-e6fb758f3955 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:40.349488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:40.403379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-65d9316b-e47d-409f-8ff1-e6fb758f3955 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:40.410658 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-65d9316b-e47d-409f-8ff1-e6fb758f3955 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 200 len: 1242 microversion: 2.1 time: 0.067890 Jun 20 07:10:40.411224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 281/563] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:40 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:40.678561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-af9a7435-df96-4b2c-a492-cfe3b8f719a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:40.679176 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-af9a7435-df96-4b2c-a492-cfe3b8f719a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:40.687770 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af9a7435-df96-4b2c-a492-cfe3b8f719a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:40.688247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af9a7435-df96-4b2c-a492-cfe3b8f719a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:40.689019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af9a7435-df96-4b2c-a492-cfe3b8f719a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:40.689461 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af9a7435-df96-4b2c-a492-cfe3b8f719a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:40.824048 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-af9a7435-df96-4b2c-a492-cfe3b8f719a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:40.833467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-af9a7435-df96-4b2c-a492-cfe3b8f719a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:40.834973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-af9a7435-df96-4b2c-a492-cfe3b8f719a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:40.836362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-af9a7435-df96-4b2c-a492-cfe3b8f719a7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1793 microversion: 2.20 time: 0.161848 Jun 20 07:10:40.836953 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 283/564] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:10:40 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1793 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:10:41.428437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-de542fc5-78b6-4f0a-813d-644ec6e03c7b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:41.429797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-de542fc5-78b6-4f0a-813d-644ec6e03c7b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:41.437097 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de542fc5-78b6-4f0a-813d-644ec6e03c7b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:41.437546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de542fc5-78b6-4f0a-813d-644ec6e03c7b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:41.438485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de542fc5-78b6-4f0a-813d-644ec6e03c7b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:41.439066 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de542fc5-78b6-4f0a-813d-644ec6e03c7b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:41.506259 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-de542fc5-78b6-4f0a-813d-644ec6e03c7b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:41.513621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-de542fc5-78b6-4f0a-813d-644ec6e03c7b tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 200 len: 1312 microversion: 2.1 time: 0.089141 Jun 20 07:10:41.514179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 282/565] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:41 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:42.530676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e31dfffd-2936-46e2-9a8e-759bfae06fe2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:42.531610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e31dfffd-2936-46e2-9a8e-759bfae06fe2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:42.538327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e31dfffd-2936-46e2-9a8e-759bfae06fe2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:42.538776 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e31dfffd-2936-46e2-9a8e-759bfae06fe2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:42.539535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e31dfffd-2936-46e2-9a8e-759bfae06fe2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:42.539969 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e31dfffd-2936-46e2-9a8e-759bfae06fe2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:42.751941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e31dfffd-2936-46e2-9a8e-759bfae06fe2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:42.759294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e31dfffd-2936-46e2-9a8e-759bfae06fe2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 200 len: 1367 microversion: 2.1 time: 0.232443 Jun 20 07:10:42.759858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 284/566] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:42 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:42.864966 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-68d83b7e-cf6f-4534-8e3a-66f6843d03af req-6b6d01cc-a1d9-4056-8b2d-bc91ce4d17b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11509895-4f58-4838-bae7-bf59aa04d5a8", "tag": "ea93bf77-b0f2-4c02-a76e-ff9278bd79a1"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:42.882659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-68d83b7e-cf6f-4534-8e3a-66f6843d03af req-6b6d01cc-a1d9-4056-8b2d-bc91ce4d17b7 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:42.883133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-68d83b7e-cf6f-4534-8e3a-66f6843d03af req-6b6d01cc-a1d9-4056-8b2d-bc91ce4d17b7 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:42.895484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-68d83b7e-cf6f-4534-8e3a-66f6843d03af req-6b6d01cc-a1d9-4056-8b2d-bc91ce4d17b7 service nova] Creating event network-changed:ea93bf77-b0f2-4c02-a76e-ff9278bd79a1 for instance 11509895-4f58-4838-bae7-bf59aa04d5a8 on hv-cinder-77819 Jun 20 07:10:42.900208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-68d83b7e-cf6f-4534-8e3a-66f6843d03af req-6b6d01cc-a1d9-4056-8b2d-bc91ce4d17b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039920 Jun 20 07:10:42.900795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 283/567] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:43.777153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7c5a916f-8bc9-4b7c-b8a3-a7565a38bfc7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:43.777715 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7c5a916f-8bc9-4b7c-b8a3-a7565a38bfc7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:43.784834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c5a916f-8bc9-4b7c-b8a3-a7565a38bfc7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:43.785286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c5a916f-8bc9-4b7c-b8a3-a7565a38bfc7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:43.786046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c5a916f-8bc9-4b7c-b8a3-a7565a38bfc7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:43.786486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c5a916f-8bc9-4b7c-b8a3-a7565a38bfc7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:43.912565 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7c5a916f-8bc9-4b7c-b8a3-a7565a38bfc7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:43.916128 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:43.921181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7c5a916f-8bc9-4b7c-b8a3-a7565a38bfc7 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 200 len: 1367 microversion: 2.1 time: 0.147951 Jun 20 07:10:43.921732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 285/568] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:43 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:44.238351 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-13856b4f-27e9-44be-80ae-ae08045970b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14acc9ca-9ac6-446e-b502-951bbf9876ac"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:44.239412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-13856b4f-27e9-44be-80ae-ae08045970b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:44.245628 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13856b4f-27e9-44be-80ae-ae08045970b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:44.246081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13856b4f-27e9-44be-80ae-ae08045970b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:44.246844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13856b4f-27e9-44be-80ae-ae08045970b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:44.247280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13856b4f-27e9-44be-80ae-ae08045970b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:44.938711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-783c9bd8-145f-4d9e-8cf0-baaacbc60cb0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:44.939329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-783c9bd8-145f-4d9e-8cf0-baaacbc60cb0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:44.947194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-783c9bd8-145f-4d9e-8cf0-baaacbc60cb0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:44.947582 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-783c9bd8-145f-4d9e-8cf0-baaacbc60cb0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:44.948377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-783c9bd8-145f-4d9e-8cf0-baaacbc60cb0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:44.948820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-783c9bd8-145f-4d9e-8cf0-baaacbc60cb0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:45.082793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-783c9bd8-145f-4d9e-8cf0-baaacbc60cb0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:45.090174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-783c9bd8-145f-4d9e-8cf0-baaacbc60cb0 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 200 len: 1367 microversion: 2.1 time: 0.156064 Jun 20 07:10:45.090749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 286/569] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:44 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:10:45.230104 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-13856b4f-27e9-44be-80ae-ae08045970b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "POST /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.996546 Jun 20 07:10:45.230751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 284/570] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 07:10:44 2022] POST /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 194 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:46.108657 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b3b6be11-db79-4bb1-a40b-0d839d412dd5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:46.109177 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b3b6be11-db79-4bb1-a40b-0d839d412dd5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:46.115552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3b6be11-db79-4bb1-a40b-0d839d412dd5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:46.116005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3b6be11-db79-4bb1-a40b-0d839d412dd5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:46.116804 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3b6be11-db79-4bb1-a40b-0d839d412dd5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:46.117255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3b6be11-db79-4bb1-a40b-0d839d412dd5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:46.250262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b3b6be11-db79-4bb1-a40b-0d839d412dd5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:46.257721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b3b6be11-db79-4bb1-a40b-0d839d412dd5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 200 len: 1367 microversion: 2.1 time: 0.153324 Jun 20 07:10:46.258291 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 287/571] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:46 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:47.277069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d7d450e5-3ad1-45ca-af07-48c32b8af250 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:47.278023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d7d450e5-3ad1-45ca-af07-48c32b8af250 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:47.284488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7d450e5-3ad1-45ca-af07-48c32b8af250 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:47.284935 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7d450e5-3ad1-45ca-af07-48c32b8af250 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:47.285710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7d450e5-3ad1-45ca-af07-48c32b8af250 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:47.286145 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7d450e5-3ad1-45ca-af07-48c32b8af250 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:47.342408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-0878c697-1c1f-47dc-9865-5b28e85c31c6 req-2ceb7d9a-d65d-48b1-846c-03d45c1ff315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11509895-4f58-4838-bae7-bf59aa04d5a8", "name": "network-vif-plugged", "status": "completed", "tag": "ea93bf77-b0f2-4c02-a76e-ff9278bd79a1"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:47.355193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-0878c697-1c1f-47dc-9865-5b28e85c31c6 req-2ceb7d9a-d65d-48b1-846c-03d45c1ff315 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:47.355890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-0878c697-1c1f-47dc-9865-5b28e85c31c6 req-2ceb7d9a-d65d-48b1-846c-03d45c1ff315 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:47.376281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-0878c697-1c1f-47dc-9865-5b28e85c31c6 req-2ceb7d9a-d65d-48b1-846c-03d45c1ff315 service nova] Creating event network-vif-plugged:ea93bf77-b0f2-4c02-a76e-ff9278bd79a1 for instance 11509895-4f58-4838-bae7-bf59aa04d5a8 on hv-cinder-77819 Jun 20 07:10:47.382260 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-0878c697-1c1f-47dc-9865-5b28e85c31c6 req-2ceb7d9a-d65d-48b1-846c-03d45c1ff315 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044171 Jun 20 07:10:47.383189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 288/572] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:10:47.436437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d7d450e5-3ad1-45ca-af07-48c32b8af250 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:47.443955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d7d450e5-3ad1-45ca-af07-48c32b8af250 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 200 len: 1367 microversion: 2.1 time: 0.172124 Jun 20 07:10:47.444552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 285/573] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:47 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:48.461536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0aca7d74-8546-4700-9e9d-826e02b5e00c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:48.462239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0aca7d74-8546-4700-9e9d-826e02b5e00c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:48.469203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aca7d74-8546-4700-9e9d-826e02b5e00c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:48.469654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aca7d74-8546-4700-9e9d-826e02b5e00c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:48.470405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aca7d74-8546-4700-9e9d-826e02b5e00c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:48.470841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aca7d74-8546-4700-9e9d-826e02b5e00c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:48.598545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0aca7d74-8546-4700-9e9d-826e02b5e00c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:48.605925 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0aca7d74-8546-4700-9e9d-826e02b5e00c tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 200 len: 1367 microversion: 2.1 time: 0.149061 Jun 20 07:10:48.606483 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 289/574] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:48 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:49.623223 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-856f0020-4a8f-48fc-ac81-f32f4f638e99 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:49.623866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-856f0020-4a8f-48fc-ac81-f32f4f638e99 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:49.630301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-856f0020-4a8f-48fc-ac81-f32f4f638e99 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:49.630740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-856f0020-4a8f-48fc-ac81-f32f4f638e99 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:49.631491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-856f0020-4a8f-48fc-ac81-f32f4f638e99 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:49.631918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-856f0020-4a8f-48fc-ac81-f32f4f638e99 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:49.762973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-856f0020-4a8f-48fc-ac81-f32f4f638e99 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:10:49.770687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-856f0020-4a8f-48fc-ac81-f32f4f638e99 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 200 len: 1557 microversion: 2.1 time: 0.152024 Jun 20 07:10:49.771254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 286/575] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:10:49 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:10:49.787155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1bd37af-eb92-4fd7-a347-42e455e8eb94 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:49.787661 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a1bd37af-eb92-4fd7-a347-42e455e8eb94 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:49.794011 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1bd37af-eb92-4fd7-a347-42e455e8eb94 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:49.794992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1bd37af-eb92-4fd7-a347-42e455e8eb94 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:49.795748 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1bd37af-eb92-4fd7-a347-42e455e8eb94 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:49.796205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1bd37af-eb92-4fd7-a347-42e455e8eb94 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:49.875931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a1bd37af-eb92-4fd7-a347-42e455e8eb94 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092516 Jun 20 07:10:49.876554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 290/576] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 07:10:49 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:50.781375 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-0b8f32b2-6914-4c0b-b7ce-534b7a93b576 req-f3d98ca2-6484-449a-854a-27a91d3a5a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11509895-4f58-4838-bae7-bf59aa04d5a8", "tag": "ea93bf77-b0f2-4c02-a76e-ff9278bd79a1"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:10:50.785380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=6 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:50.791208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-0b8f32b2-6914-4c0b-b7ce-534b7a93b576 req-f3d98ca2-6484-449a-854a-27a91d3a5a49 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:50.791658 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-0b8f32b2-6914-4c0b-b7ce-534b7a93b576 req-f3d98ca2-6484-449a-854a-27a91d3a5a49 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:50.803154 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-0b8f32b2-6914-4c0b-b7ce-534b7a93b576 req-f3d98ca2-6484-449a-854a-27a91d3a5a49 service nova] Creating event network-changed:ea93bf77-b0f2-4c02-a76e-ff9278bd79a1 for instance 11509895-4f58-4838-bae7-bf59aa04d5a8 on hv-cinder-77819 Jun 20 07:10:50.809580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-0b8f32b2-6914-4c0b-b7ce-534b7a93b576 req-f3d98ca2-6484-449a-854a-27a91d3a5a49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032496 Jun 20 07:10:50.810414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 287/577] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:10:55.110891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:55.111484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:55.116169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-730c2383-51e1-4abe-a821-02dae7febca8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:10:55.116659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-730c2383-51e1-4abe-a821-02dae7febca8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:10:55.118437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:10:55.124968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-730c2383-51e1-4abe-a821-02dae7febca8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:55.125414 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-730c2383-51e1-4abe-a821-02dae7febca8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:55.126162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-730c2383-51e1-4abe-a821-02dae7febca8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:10:55.126592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-730c2383-51e1-4abe-a821-02dae7febca8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:10:55.259835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-730c2383-51e1-4abe-a821-02dae7febca8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lazy-loading 'services' on Instance uuid 184f7c82-c8b4-45cf-ba43-b6f17794e153 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:10:55.369440 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-730c2383-51e1-4abe-a821-02dae7febca8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "DELETE /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments/05455fe2-2e36-4c3a-a39a-6de007f437d1" status: 202 len: 0 microversion: 2.1 time: 0.259276 Jun 20 07:10:55.369951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 291/578] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:10:55 2022] DELETE /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments/05455fe2-2e36-4c3a-a39a-6de007f437d1 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:11:22.059577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=15 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:11:22.060404 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:11:22.064833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-48f4cb40-deb9-46ec-becf-d5593426f265 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:22.065433 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-48f4cb40-deb9-46ec-becf-d5593426f265 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:22.073144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-48f4cb40-deb9-46ec-becf-d5593426f265 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:22.073593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-48f4cb40-deb9-46ec-becf-d5593426f265 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:22.074349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-48f4cb40-deb9-46ec-becf-d5593426f265 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:22.075294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-48f4cb40-deb9-46ec-becf-d5593426f265 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:22.105104 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-48f4cb40-deb9-46ec-becf-d5593426f265 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments/2f92cbd0-785e-45ac-9bc3-dbd94807f366" status: 200 len: 194 microversion: 2.20 time: 0.046987 Jun 20 07:11:22.105698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 288/579] 10.222.0.23 () {60 vars in 1453 bytes} [Mon Jun 20 07:11:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments/2f92cbd0-785e-45ac-9bc3-dbd94807f366 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:22.165530 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:11:22.166306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:11:22.170788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d8f6c88-254f-4173-9144-8499857ad054 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:22.171374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1d8f6c88-254f-4173-9144-8499857ad054 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:22.178732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d8f6c88-254f-4173-9144-8499857ad054 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:22.179183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d8f6c88-254f-4173-9144-8499857ad054 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:22.179945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d8f6c88-254f-4173-9144-8499857ad054 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:22.180406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d8f6c88-254f-4173-9144-8499857ad054 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:22.258245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-1d8f6c88-254f-4173-9144-8499857ad054 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lazy-loading 'services' on Instance uuid 0e214060-f046-41a1-b243-020c88edde42 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:11:22.334499 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1d8f6c88-254f-4173-9144-8499857ad054 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments/2f92cbd0-785e-45ac-9bc3-dbd94807f366" status: 202 len: 0 microversion: 2.20 time: 0.170349 Jun 20 07:11:22.335090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 292/580] 10.222.0.23 () {60 vars in 1456 bytes} [Mon Jun 20 07:11:22 2022] DELETE /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments/2f92cbd0-785e-45ac-9bc3-dbd94807f366 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:11:22.343513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6fe80576-ffff-4fb5-b8ca-9bbfc6d59315 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:22.344496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6fe80576-ffff-4fb5-b8ca-9bbfc6d59315 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:22.350437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6fe80576-ffff-4fb5-b8ca-9bbfc6d59315 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:22.350882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6fe80576-ffff-4fb5-b8ca-9bbfc6d59315 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:22.351636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6fe80576-ffff-4fb5-b8ca-9bbfc6d59315 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:22.352068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6fe80576-ffff-4fb5-b8ca-9bbfc6d59315 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:22.382244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6fe80576-ffff-4fb5-b8ca-9bbfc6d59315 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042772 Jun 20 07:11:22.382788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 289/581] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:23.395071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c01933a8-993b-4481-bb48-c6ba5ab0c5ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:23.396159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c01933a8-993b-4481-bb48-c6ba5ab0c5ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:23.402391 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c01933a8-993b-4481-bb48-c6ba5ab0c5ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:23.402844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c01933a8-993b-4481-bb48-c6ba5ab0c5ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:23.403605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c01933a8-993b-4481-bb48-c6ba5ab0c5ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:23.404041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c01933a8-993b-4481-bb48-c6ba5ab0c5ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:23.432543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c01933a8-993b-4481-bb48-c6ba5ab0c5ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042486 Jun 20 07:11:23.433085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 293/582] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:23 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:24.444791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-116b264d-cf99-4526-b41f-f99fff0585be tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:24.445733 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-116b264d-cf99-4526-b41f-f99fff0585be tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:24.452776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-116b264d-cf99-4526-b41f-f99fff0585be tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:24.453227 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-116b264d-cf99-4526-b41f-f99fff0585be tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:24.453988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-116b264d-cf99-4526-b41f-f99fff0585be tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:24.454425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-116b264d-cf99-4526-b41f-f99fff0585be tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:24.482825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-116b264d-cf99-4526-b41f-f99fff0585be tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041926 Jun 20 07:11:24.483307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 290/583] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:24 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:25.494556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d5d9a16c-4457-4165-962c-8abe2fa2bb41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:25.495377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d5d9a16c-4457-4165-962c-8abe2fa2bb41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:25.501917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5d9a16c-4457-4165-962c-8abe2fa2bb41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:25.502367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5d9a16c-4457-4165-962c-8abe2fa2bb41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:25.503121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5d9a16c-4457-4165-962c-8abe2fa2bb41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:25.503552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5d9a16c-4457-4165-962c-8abe2fa2bb41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:25.534978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d5d9a16c-4457-4165-962c-8abe2fa2bb41 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044443 Jun 20 07:11:25.535518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 294/584] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:25 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:26.547666 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c348eeb6-27a5-4d82-acc2-56c3d07ef43e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:26.548576 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c348eeb6-27a5-4d82-acc2-56c3d07ef43e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:26.555017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c348eeb6-27a5-4d82-acc2-56c3d07ef43e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:26.555473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c348eeb6-27a5-4d82-acc2-56c3d07ef43e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:26.556268 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c348eeb6-27a5-4d82-acc2-56c3d07ef43e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:26.556705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c348eeb6-27a5-4d82-acc2-56c3d07ef43e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:26.584819 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c348eeb6-27a5-4d82-acc2-56c3d07ef43e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041254 Jun 20 07:11:26.585365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 291/585] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:26 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:27.596554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0c92a546-adee-4865-a7e8-3e3d52ff22de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:27.597394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0c92a546-adee-4865-a7e8-3e3d52ff22de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:27.603726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c92a546-adee-4865-a7e8-3e3d52ff22de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:27.604197 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c92a546-adee-4865-a7e8-3e3d52ff22de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:27.604951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c92a546-adee-4865-a7e8-3e3d52ff22de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:27.605410 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c92a546-adee-4865-a7e8-3e3d52ff22de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:27.633845 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0c92a546-adee-4865-a7e8-3e3d52ff22de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041542 Jun 20 07:11:27.634387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 295/586] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:27 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:28.646038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3e6d0a63-020b-4a3f-a9ff-91a44a5c705a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:28.646889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3e6d0a63-020b-4a3f-a9ff-91a44a5c705a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:28.653342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e6d0a63-020b-4a3f-a9ff-91a44a5c705a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:28.653792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e6d0a63-020b-4a3f-a9ff-91a44a5c705a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:28.654556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e6d0a63-020b-4a3f-a9ff-91a44a5c705a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:28.654997 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e6d0a63-020b-4a3f-a9ff-91a44a5c705a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:28.683166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3e6d0a63-020b-4a3f-a9ff-91a44a5c705a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041463 Jun 20 07:11:28.683713 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 292/587] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:28 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:29.694839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3325c191-f0ac-4f29-aa7d-64a5ceb1df35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:29.695815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3325c191-f0ac-4f29-aa7d-64a5ceb1df35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:29.702778 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3325c191-f0ac-4f29-aa7d-64a5ceb1df35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:29.703224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3325c191-f0ac-4f29-aa7d-64a5ceb1df35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:29.703980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3325c191-f0ac-4f29-aa7d-64a5ceb1df35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:29.704431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3325c191-f0ac-4f29-aa7d-64a5ceb1df35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:29.732904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3325c191-f0ac-4f29-aa7d-64a5ceb1df35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041999 Jun 20 07:11:29.733447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 296/588] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:29 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:30.744531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d6411faa-554a-4f95-9d5e-cc818f7d0c63 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:30.745486 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d6411faa-554a-4f95-9d5e-cc818f7d0c63 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:30.752050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6411faa-554a-4f95-9d5e-cc818f7d0c63 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:30.752478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6411faa-554a-4f95-9d5e-cc818f7d0c63 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:30.753239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6411faa-554a-4f95-9d5e-cc818f7d0c63 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:30.753682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6411faa-554a-4f95-9d5e-cc818f7d0c63 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:30.782223 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d6411faa-554a-4f95-9d5e-cc818f7d0c63 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041698 Jun 20 07:11:30.782773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 293/589] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:30 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:31.793740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0dc0f6a-de0b-4075-b5cd-08c95acac24a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:31.794665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f0dc0f6a-de0b-4075-b5cd-08c95acac24a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:31.801203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0dc0f6a-de0b-4075-b5cd-08c95acac24a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:31.801597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0dc0f6a-de0b-4075-b5cd-08c95acac24a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:31.802362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0dc0f6a-de0b-4075-b5cd-08c95acac24a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:31.802825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0dc0f6a-de0b-4075-b5cd-08c95acac24a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:31.831695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f0dc0f6a-de0b-4075-b5cd-08c95acac24a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042480 Jun 20 07:11:31.832266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 297/590] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:31 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:11:32.843797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac48ef61-cede-4dda-89c0-3767b79de379 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:32.844741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ac48ef61-cede-4dda-89c0-3767b79de379 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:32.851327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac48ef61-cede-4dda-89c0-3767b79de379 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:32.851710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac48ef61-cede-4dda-89c0-3767b79de379 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:32.852487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac48ef61-cede-4dda-89c0-3767b79de379 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:32.852917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac48ef61-cede-4dda-89c0-3767b79de379 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:32.881146 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ac48ef61-cede-4dda-89c0-3767b79de379 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041868 Jun 20 07:11:32.881688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 294/591] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:32 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:33.892981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b139965b-4d31-4668-beb4-e9e870fc787f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:33.893903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b139965b-4d31-4668-beb4-e9e870fc787f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:33.900561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b139965b-4d31-4668-beb4-e9e870fc787f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:33.900960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b139965b-4d31-4668-beb4-e9e870fc787f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:33.901723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b139965b-4d31-4668-beb4-e9e870fc787f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:33.902162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b139965b-4d31-4668-beb4-e9e870fc787f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:33.933536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b139965b-4d31-4668-beb4-e9e870fc787f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044752 Jun 20 07:11:33.934692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 298/592] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:33 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:34.318949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-606949b0-577f-454f-a550-04c4cda385ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:34.319452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-606949b0-577f-454f-a550-04c4cda385ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:34.325460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-606949b0-577f-454f-a550-04c4cda385ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:34.325897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-606949b0-577f-454f-a550-04c4cda385ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:34.326646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-606949b0-577f-454f-a550-04c4cda385ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:34.327074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-606949b0-577f-454f-a550-04c4cda385ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:34.349742 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-606949b0-577f-454f-a550-04c4cda385ef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8/ips" status: 200 len: 110 microversion: 2.1 time: 0.034579 Jun 20 07:11:34.350307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 295/593] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 07:11:34 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8/ips => generated 110 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:11:34.945710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5bb26dff-a939-45be-ad78-8a286a16aab2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:34.946678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5bb26dff-a939-45be-ad78-8a286a16aab2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:34.953528 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5bb26dff-a939-45be-ad78-8a286a16aab2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:34.953973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5bb26dff-a939-45be-ad78-8a286a16aab2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:34.954723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5bb26dff-a939-45be-ad78-8a286a16aab2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:34.955152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5bb26dff-a939-45be-ad78-8a286a16aab2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:34.984790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5bb26dff-a939-45be-ad78-8a286a16aab2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042868 Jun 20 07:11:34.985267 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 299/594] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:34 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:35.997091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cab9f454-feb6-47c2-bf55-dffb595194d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:35.997924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cab9f454-feb6-47c2-bf55-dffb595194d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:36.004559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cab9f454-feb6-47c2-bf55-dffb595194d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:36.005009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cab9f454-feb6-47c2-bf55-dffb595194d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:36.005810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cab9f454-feb6-47c2-bf55-dffb595194d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:36.006248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cab9f454-feb6-47c2-bf55-dffb595194d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:36.035465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cab9f454-feb6-47c2-bf55-dffb595194d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042951 Jun 20 07:11:36.036018 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 296/595] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:35 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:11:37.047122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9613e578-caa0-427d-acda-b658a11bc581 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:37.048077 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9613e578-caa0-427d-acda-b658a11bc581 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:37.054539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9613e578-caa0-427d-acda-b658a11bc581 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:37.054989 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9613e578-caa0-427d-acda-b658a11bc581 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:37.055747 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9613e578-caa0-427d-acda-b658a11bc581 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:37.056212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9613e578-caa0-427d-acda-b658a11bc581 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:37.084085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9613e578-caa0-427d-acda-b658a11bc581 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040917 Jun 20 07:11:37.084641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 300/596] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:37 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:38.095823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-79dad062-530a-499e-b267-79575c674ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:38.096752 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-79dad062-530a-499e-b267-79575c674ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:38.103096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79dad062-530a-499e-b267-79575c674ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:38.103538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79dad062-530a-499e-b267-79575c674ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:38.104325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79dad062-530a-499e-b267-79575c674ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:38.104752 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79dad062-530a-499e-b267-79575c674ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:38.132747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-79dad062-530a-499e-b267-79575c674ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040907 Jun 20 07:11:38.133279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 297/597] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:38 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:39.144618 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c95976fd-05e7-4749-9070-82d46521c48e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:39.145460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c95976fd-05e7-4749-9070-82d46521c48e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:39.152398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c95976fd-05e7-4749-9070-82d46521c48e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:39.152842 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c95976fd-05e7-4749-9070-82d46521c48e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:39.153598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c95976fd-05e7-4749-9070-82d46521c48e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:39.154035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c95976fd-05e7-4749-9070-82d46521c48e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:39.182233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c95976fd-05e7-4749-9070-82d46521c48e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042027 Jun 20 07:11:39.182781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 301/598] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:39 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:40.195020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f6ce05e6-8c80-4d70-b835-fa3071777abf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:40.195872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f6ce05e6-8c80-4d70-b835-fa3071777abf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:40.202804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6ce05e6-8c80-4d70-b835-fa3071777abf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:40.203285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6ce05e6-8c80-4d70-b835-fa3071777abf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:40.204044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6ce05e6-8c80-4d70-b835-fa3071777abf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:40.204504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6ce05e6-8c80-4d70-b835-fa3071777abf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:40.232800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f6ce05e6-8c80-4d70-b835-fa3071777abf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041778 Jun 20 07:11:40.233343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 298/599] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:40 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:41.244516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0917dabc-3476-4631-a272-bb1d079798b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:41.245365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0917dabc-3476-4631-a272-bb1d079798b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:41.251831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0917dabc-3476-4631-a272-bb1d079798b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:41.252335 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0917dabc-3476-4631-a272-bb1d079798b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:41.253109 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0917dabc-3476-4631-a272-bb1d079798b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:41.253550 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0917dabc-3476-4631-a272-bb1d079798b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:41.282062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0917dabc-3476-4631-a272-bb1d079798b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041639 Jun 20 07:11:41.282608 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 302/600] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:41 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:42.294219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9ba4856b-1ba3-4971-b83c-fd6de66299c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:42.295141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9ba4856b-1ba3-4971-b83c-fd6de66299c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:42.301600 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ba4856b-1ba3-4971-b83c-fd6de66299c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:42.302050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ba4856b-1ba3-4971-b83c-fd6de66299c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:42.302809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ba4856b-1ba3-4971-b83c-fd6de66299c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:42.303244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9ba4856b-1ba3-4971-b83c-fd6de66299c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:42.331716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9ba4856b-1ba3-4971-b83c-fd6de66299c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042006 Jun 20 07:11:42.332276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 299/601] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:43.343407 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-55a13cc3-e8e7-4309-bc4c-a246db7c26fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:43.344379 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-55a13cc3-e8e7-4309-bc4c-a246db7c26fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:43.350734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55a13cc3-e8e7-4309-bc4c-a246db7c26fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:43.351179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55a13cc3-e8e7-4309-bc4c-a246db7c26fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:43.351924 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55a13cc3-e8e7-4309-bc4c-a246db7c26fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:43.352406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55a13cc3-e8e7-4309-bc4c-a246db7c26fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:43.380557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-55a13cc3-e8e7-4309-bc4c-a246db7c26fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041587 Jun 20 07:11:43.381093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 303/602] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:43 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:44.307181 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8774e55a-453f-4659-aa98-3b5eb9f48c91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:11:44.308138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8774e55a-453f-4659-aa98-3b5eb9f48c91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:44.315031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8774e55a-453f-4659-aa98-3b5eb9f48c91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:44.315364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8774e55a-453f-4659-aa98-3b5eb9f48c91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:44.316138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8774e55a-453f-4659-aa98-3b5eb9f48c91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:44.316571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8774e55a-453f-4659-aa98-3b5eb9f48c91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:44.339367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-8774e55a-453f-4659-aa98-3b5eb9f48c91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'flavor' on Instance uuid b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:11:44.392943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-21a9c4f4-b1f7-45e0-9c0e-2c5347d45553 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:44.393869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-21a9c4f4-b1f7-45e0-9c0e-2c5347d45553 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:44.400558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21a9c4f4-b1f7-45e0-9c0e-2c5347d45553 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:44.401012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21a9c4f4-b1f7-45e0-9c0e-2c5347d45553 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:44.401789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21a9c4f4-b1f7-45e0-9c0e-2c5347d45553 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:44.402264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21a9c4f4-b1f7-45e0-9c0e-2c5347d45553 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:44.437749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-21a9c4f4-b1f7-45e0-9c0e-2c5347d45553 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049013 Jun 20 07:11:44.438527 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 304/603] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:44 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:11:44.465325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8774e55a-453f-4659-aa98-3b5eb9f48c91 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "POST /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/action" status: 200 len: 32 microversion: 2.1 time: 0.161481 Jun 20 07:11:44.466075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 300/604] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:11:44 2022] POST /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 07:11:44.484213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bc90be33-4aa6-4fe0-87b1-0c0581f9bf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:44.484927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bc90be33-4aa6-4fe0-87b1-0c0581f9bf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:44.494417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc90be33-4aa6-4fe0-87b1-0c0581f9bf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:44.495126 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc90be33-4aa6-4fe0-87b1-0c0581f9bf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:44.495879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc90be33-4aa6-4fe0-87b1-0c0581f9bf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:44.496714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc90be33-4aa6-4fe0-87b1-0c0581f9bf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:44.660494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bc90be33-4aa6-4fe0-87b1-0c0581f9bf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:44.668949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bc90be33-4aa6-4fe0-87b1-0c0581f9bf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.192306 Jun 20 07:11:44.669520 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 305/605] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:11:45.450704 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d953a7a2-c381-46ca-8e4d-875350a915c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:45.451718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d953a7a2-c381-46ca-8e4d-875350a915c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:45.458866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d953a7a2-c381-46ca-8e4d-875350a915c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:45.459314 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d953a7a2-c381-46ca-8e4d-875350a915c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:45.460076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d953a7a2-c381-46ca-8e4d-875350a915c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:45.460530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d953a7a2-c381-46ca-8e4d-875350a915c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:45.491217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d953a7a2-c381-46ca-8e4d-875350a915c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045383 Jun 20 07:11:45.491787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 301/606] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:45 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:45.686826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a68e7d2e-7017-4cdc-b6e2-1ed45543dcaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:45.687455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a68e7d2e-7017-4cdc-b6e2-1ed45543dcaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:45.694169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a68e7d2e-7017-4cdc-b6e2-1ed45543dcaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:45.694621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a68e7d2e-7017-4cdc-b6e2-1ed45543dcaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:45.695397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a68e7d2e-7017-4cdc-b6e2-1ed45543dcaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:45.695841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a68e7d2e-7017-4cdc-b6e2-1ed45543dcaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:45.827564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a68e7d2e-7017-4cdc-b6e2-1ed45543dcaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:45.835471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a68e7d2e-7017-4cdc-b6e2-1ed45543dcaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152988 Jun 20 07:11:45.836043 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 306/607] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:11:46.502822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-46ca70cf-d194-459f-8772-ee69b73f8467 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:46.503741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-46ca70cf-d194-459f-8772-ee69b73f8467 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:46.510208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46ca70cf-d194-459f-8772-ee69b73f8467 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:46.510655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46ca70cf-d194-459f-8772-ee69b73f8467 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:46.511450 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46ca70cf-d194-459f-8772-ee69b73f8467 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:46.511884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46ca70cf-d194-459f-8772-ee69b73f8467 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:46.536905 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:11:46.547248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-46ca70cf-d194-459f-8772-ee69b73f8467 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048347 Jun 20 07:11:46.547839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 302/608] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:46 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:46.851678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d1acd289-9714-4d09-9d51-c9f3cc85ea78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:46.852330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d1acd289-9714-4d09-9d51-c9f3cc85ea78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:46.858748 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1acd289-9714-4d09-9d51-c9f3cc85ea78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:46.859201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1acd289-9714-4d09-9d51-c9f3cc85ea78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:46.859957 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1acd289-9714-4d09-9d51-c9f3cc85ea78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:46.860431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1acd289-9714-4d09-9d51-c9f3cc85ea78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:46.991667 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d1acd289-9714-4d09-9d51-c9f3cc85ea78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:46.995165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:11:47.000984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d1acd289-9714-4d09-9d51-c9f3cc85ea78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.153173 Jun 20 07:11:47.001550 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 307/609] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:11:47.559053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea143718-8a12-4cc3-afe1-2013dfff2132 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:47.560562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ea143718-8a12-4cc3-afe1-2013dfff2132 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:47.567928 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea143718-8a12-4cc3-afe1-2013dfff2132 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:47.568416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea143718-8a12-4cc3-afe1-2013dfff2132 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:47.569247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea143718-8a12-4cc3-afe1-2013dfff2132 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:47.569670 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea143718-8a12-4cc3-afe1-2013dfff2132 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:47.601557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea143718-8a12-4cc3-afe1-2013dfff2132 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046534 Jun 20 07:11:47.602120 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 303/610] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:47 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:48.018556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cd50a0c1-2ee3-4dac-8afe-ffcc844956a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:48.019278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cd50a0c1-2ee3-4dac-8afe-ffcc844956a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:48.025890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd50a0c1-2ee3-4dac-8afe-ffcc844956a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:48.026334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd50a0c1-2ee3-4dac-8afe-ffcc844956a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:48.027599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd50a0c1-2ee3-4dac-8afe-ffcc844956a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:48.028030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd50a0c1-2ee3-4dac-8afe-ffcc844956a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:48.153926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cd50a0c1-2ee3-4dac-8afe-ffcc844956a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:48.162362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cd50a0c1-2ee3-4dac-8afe-ffcc844956a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148463 Jun 20 07:11:48.162925 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 308/611] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:48 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:11:48.617650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aae74ebd-9508-450a-adcf-7e25a79de13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:48.618569 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aae74ebd-9508-450a-adcf-7e25a79de13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:48.625504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aae74ebd-9508-450a-adcf-7e25a79de13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:48.625954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aae74ebd-9508-450a-adcf-7e25a79de13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:48.626705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aae74ebd-9508-450a-adcf-7e25a79de13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:48.627138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aae74ebd-9508-450a-adcf-7e25a79de13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:48.655604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aae74ebd-9508-450a-adcf-7e25a79de13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046079 Jun 20 07:11:48.656166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 304/612] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:48 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:49.179616 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d29dc03-fc5a-4a48-8999-baecd5de3b39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:49.180286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d29dc03-fc5a-4a48-8999-baecd5de3b39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:49.187532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d29dc03-fc5a-4a48-8999-baecd5de3b39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:49.187989 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d29dc03-fc5a-4a48-8999-baecd5de3b39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:49.188800 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d29dc03-fc5a-4a48-8999-baecd5de3b39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:49.189237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d29dc03-fc5a-4a48-8999-baecd5de3b39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:49.319306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d29dc03-fc5a-4a48-8999-baecd5de3b39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:49.327179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d29dc03-fc5a-4a48-8999-baecd5de3b39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151602 Jun 20 07:11:49.327750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 309/613] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:11:49.666689 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8ab0f3b2-91ad-4849-9d4b-2442215df10e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:49.667596 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8ab0f3b2-91ad-4849-9d4b-2442215df10e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:49.673940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ab0f3b2-91ad-4849-9d4b-2442215df10e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:49.674386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ab0f3b2-91ad-4849-9d4b-2442215df10e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:49.675135 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ab0f3b2-91ad-4849-9d4b-2442215df10e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:49.675565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8ab0f3b2-91ad-4849-9d4b-2442215df10e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:49.703987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8ab0f3b2-91ad-4849-9d4b-2442215df10e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041152 Jun 20 07:11:49.704912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 305/614] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:49 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:50.344708 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6ad087a6-c056-49d3-95aa-dd5e6b000f4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:50.345265 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6ad087a6-c056-49d3-95aa-dd5e6b000f4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:50.351492 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ad087a6-c056-49d3-95aa-dd5e6b000f4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:50.351949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ad087a6-c056-49d3-95aa-dd5e6b000f4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:50.352739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ad087a6-c056-49d3-95aa-dd5e6b000f4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:50.353181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ad087a6-c056-49d3-95aa-dd5e6b000f4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:50.478870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ad087a6-c056-49d3-95aa-dd5e6b000f4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:50.486750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6ad087a6-c056-49d3-95aa-dd5e6b000f4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145860 Jun 20 07:11:50.487319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 310/615] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:11:50.715464 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fc01061f-e250-4564-8962-42db0dc94640 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:50.716449 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fc01061f-e250-4564-8962-42db0dc94640 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:50.722983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc01061f-e250-4564-8962-42db0dc94640 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:50.723436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc01061f-e250-4564-8962-42db0dc94640 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:50.724236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc01061f-e250-4564-8962-42db0dc94640 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:50.724673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc01061f-e250-4564-8962-42db0dc94640 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:50.752779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fc01061f-e250-4564-8962-42db0dc94640 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041914 Jun 20 07:11:50.753324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 306/616] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:50 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:51.503240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cabe844c-c5a1-4039-82c6-3346d69d843b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:51.503787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cabe844c-c5a1-4039-82c6-3346d69d843b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:51.510285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cabe844c-c5a1-4039-82c6-3346d69d843b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:51.510734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cabe844c-c5a1-4039-82c6-3346d69d843b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:51.511507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cabe844c-c5a1-4039-82c6-3346d69d843b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:51.511924 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cabe844c-c5a1-4039-82c6-3346d69d843b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:51.640860 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cabe844c-c5a1-4039-82c6-3346d69d843b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:51.649739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cabe844c-c5a1-4039-82c6-3346d69d843b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150288 Jun 20 07:11:51.650327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 311/617] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:11:51.764307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fdf20c0f-45af-4232-be14-2cf32bfc19ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:51.765240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fdf20c0f-45af-4232-be14-2cf32bfc19ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:51.771852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdf20c0f-45af-4232-be14-2cf32bfc19ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:51.772336 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdf20c0f-45af-4232-be14-2cf32bfc19ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:51.773087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdf20c0f-45af-4232-be14-2cf32bfc19ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:51.773517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fdf20c0f-45af-4232-be14-2cf32bfc19ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:51.802460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fdf20c0f-45af-4232-be14-2cf32bfc19ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042257 Jun 20 07:11:51.803000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 307/618] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:51 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:52.667312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3f95bafe-8495-4669-bcb5-3126402500f5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:52.668473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3f95bafe-8495-4669-bcb5-3126402500f5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:52.670736 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=41 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:11:52.675973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f95bafe-8495-4669-bcb5-3126402500f5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:52.676459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f95bafe-8495-4669-bcb5-3126402500f5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:52.677223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f95bafe-8495-4669-bcb5-3126402500f5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:52.677666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f95bafe-8495-4669-bcb5-3126402500f5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:52.814314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3f95bafe-8495-4669-bcb5-3126402500f5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:52.814624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7d665fc8-f145-4091-a97b-f64c0a0636cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:52.815537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7d665fc8-f145-4091-a97b-f64c0a0636cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:52.817848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=41 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:11:52.822423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3f95bafe-8495-4669-bcb5-3126402500f5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.158966 Jun 20 07:11:52.823098 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 312/619] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:11:52.823514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d665fc8-f145-4091-a97b-f64c0a0636cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:52.824053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d665fc8-f145-4091-a97b-f64c0a0636cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:52.824882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d665fc8-f145-4091-a97b-f64c0a0636cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:52.825320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d665fc8-f145-4091-a97b-f64c0a0636cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:52.853707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7d665fc8-f145-4091-a97b-f64c0a0636cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043006 Jun 20 07:11:52.854251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 308/620] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:52 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:11:53.839078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e86f8725-0ca5-4c5b-81b4-a0da2293c557 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:53.839713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e86f8725-0ca5-4c5b-81b4-a0da2293c557 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:53.846076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e86f8725-0ca5-4c5b-81b4-a0da2293c557 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:53.846520 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e86f8725-0ca5-4c5b-81b4-a0da2293c557 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:53.847271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e86f8725-0ca5-4c5b-81b4-a0da2293c557 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:53.847700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e86f8725-0ca5-4c5b-81b4-a0da2293c557 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:53.866225 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b98ad581-931b-4df4-bd78-47f43120f3bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:53.867140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b98ad581-931b-4df4-bd78-47f43120f3bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:53.873991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b98ad581-931b-4df4-bd78-47f43120f3bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:53.874437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b98ad581-931b-4df4-bd78-47f43120f3bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:53.875201 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b98ad581-931b-4df4-bd78-47f43120f3bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:53.875639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b98ad581-931b-4df4-bd78-47f43120f3bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:53.905159 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b98ad581-931b-4df4-bd78-47f43120f3bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043167 Jun 20 07:11:53.905702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 309/621] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:53 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:11:54.129441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e86f8725-0ca5-4c5b-81b4-a0da2293c557 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:54.137376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e86f8725-0ca5-4c5b-81b4-a0da2293c557 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.302074 Jun 20 07:11:54.137933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 313/622] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:11:54.915948 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-16323978-9574-4b0e-9a59-c91ccf86f45d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:54.916925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-16323978-9574-4b0e-9a59-c91ccf86f45d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:54.923529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16323978-9574-4b0e-9a59-c91ccf86f45d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:54.923978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16323978-9574-4b0e-9a59-c91ccf86f45d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:54.924786 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16323978-9574-4b0e-9a59-c91ccf86f45d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:54.925223 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16323978-9574-4b0e-9a59-c91ccf86f45d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:54.953606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-16323978-9574-4b0e-9a59-c91ccf86f45d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041646 Jun 20 07:11:54.954151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 310/623] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:54 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:55.155525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ccb43fcd-b430-4814-a677-bb8b1372e30c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:55.156168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ccb43fcd-b430-4814-a677-bb8b1372e30c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:55.162769 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccb43fcd-b430-4814-a677-bb8b1372e30c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:55.163227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccb43fcd-b430-4814-a677-bb8b1372e30c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:55.163997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccb43fcd-b430-4814-a677-bb8b1372e30c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:55.164464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccb43fcd-b430-4814-a677-bb8b1372e30c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:55.296913 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ccb43fcd-b430-4814-a677-bb8b1372e30c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:55.304775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ccb43fcd-b430-4814-a677-bb8b1372e30c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.153666 Jun 20 07:11:55.305373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 314/624] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:55 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:11:55.965940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4a3bb798-35c0-41d1-ad42-a86c7c5f9cb1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:55.966770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4a3bb798-35c0-41d1-ad42-a86c7c5f9cb1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:55.974709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a3bb798-35c0-41d1-ad42-a86c7c5f9cb1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:55.975427 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a3bb798-35c0-41d1-ad42-a86c7c5f9cb1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:55.976211 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a3bb798-35c0-41d1-ad42-a86c7c5f9cb1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:55.976646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a3bb798-35c0-41d1-ad42-a86c7c5f9cb1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:56.005191 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4a3bb798-35c0-41d1-ad42-a86c7c5f9cb1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043825 Jun 20 07:11:56.005749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 311/625] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:55 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:56.322384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d9e41cdc-526a-4e6c-9c5e-2cff805f1b1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:56.323001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d9e41cdc-526a-4e6c-9c5e-2cff805f1b1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:56.330019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9e41cdc-526a-4e6c-9c5e-2cff805f1b1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:56.330476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9e41cdc-526a-4e6c-9c5e-2cff805f1b1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:56.331236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9e41cdc-526a-4e6c-9c5e-2cff805f1b1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:56.331677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9e41cdc-526a-4e6c-9c5e-2cff805f1b1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:56.457905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d9e41cdc-526a-4e6c-9c5e-2cff805f1b1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:56.466365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d9e41cdc-526a-4e6c-9c5e-2cff805f1b1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147797 Jun 20 07:11:56.466917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 315/626] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:11:57.017524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-75c274e7-09d8-4541-9354-a86553f960ed tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:57.018449 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-75c274e7-09d8-4541-9354-a86553f960ed tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:57.024985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75c274e7-09d8-4541-9354-a86553f960ed tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:57.025437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75c274e7-09d8-4541-9354-a86553f960ed tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:57.026195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75c274e7-09d8-4541-9354-a86553f960ed tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:57.026634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75c274e7-09d8-4541-9354-a86553f960ed tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:57.055237 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-75c274e7-09d8-4541-9354-a86553f960ed tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041888 Jun 20 07:11:57.055800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 312/627] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:57 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:57.486270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe3ba180-7243-476e-bc40-e1ea15c350d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:57.486877 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe3ba180-7243-476e-bc40-e1ea15c350d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:57.493386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe3ba180-7243-476e-bc40-e1ea15c350d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:57.494102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe3ba180-7243-476e-bc40-e1ea15c350d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:57.495109 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe3ba180-7243-476e-bc40-e1ea15c350d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:57.495746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe3ba180-7243-476e-bc40-e1ea15c350d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:57.624802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe3ba180-7243-476e-bc40-e1ea15c350d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:57.632663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe3ba180-7243-476e-bc40-e1ea15c350d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150118 Jun 20 07:11:57.633223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 316/628] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:57 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:11:58.067224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-be3524b6-6c33-49d8-977d-bdb06d0132f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:58.068165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-be3524b6-6c33-49d8-977d-bdb06d0132f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:58.075135 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be3524b6-6c33-49d8-977d-bdb06d0132f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:58.075539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be3524b6-6c33-49d8-977d-bdb06d0132f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:58.076331 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be3524b6-6c33-49d8-977d-bdb06d0132f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:58.076772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be3524b6-6c33-49d8-977d-bdb06d0132f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:58.105247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-be3524b6-6c33-49d8-977d-bdb06d0132f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041992 Jun 20 07:11:58.105783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 313/629] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:58 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:58.649789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-76b0fe29-b6f1-4719-b290-8856ecf2101e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:58.650440 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-76b0fe29-b6f1-4719-b290-8856ecf2101e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:58.657039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76b0fe29-b6f1-4719-b290-8856ecf2101e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:58.657555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76b0fe29-b6f1-4719-b290-8856ecf2101e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:58.658335 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76b0fe29-b6f1-4719-b290-8856ecf2101e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:58.658773 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76b0fe29-b6f1-4719-b290-8856ecf2101e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:58.789865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-76b0fe29-b6f1-4719-b290-8856ecf2101e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:58.798181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-76b0fe29-b6f1-4719-b290-8856ecf2101e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152272 Jun 20 07:11:58.798739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 317/630] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:11:59.116890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-febdb86c-0a11-40a0-ab43-02867f1ae129 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:59.117804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-febdb86c-0a11-40a0-ab43-02867f1ae129 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:59.124261 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-febdb86c-0a11-40a0-ab43-02867f1ae129 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:59.124712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-febdb86c-0a11-40a0-ab43-02867f1ae129 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:59.125474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-febdb86c-0a11-40a0-ab43-02867f1ae129 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:59.125908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-febdb86c-0a11-40a0-ab43-02867f1ae129 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:59.154369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-febdb86c-0a11-40a0-ab43-02867f1ae129 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041581 Jun 20 07:11:59.154908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 314/631] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:11:59 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:11:59.815254 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e601ba48-2398-41b1-9d50-4d7604e08286 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:11:59.815814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e601ba48-2398-41b1-9d50-4d7604e08286 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:11:59.822334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e601ba48-2398-41b1-9d50-4d7604e08286 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:59.822785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e601ba48-2398-41b1-9d50-4d7604e08286 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:59.824235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e601ba48-2398-41b1-9d50-4d7604e08286 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:11:59.824684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e601ba48-2398-41b1-9d50-4d7604e08286 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:11:59.959420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e601ba48-2398-41b1-9d50-4d7604e08286 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:11:59.967221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e601ba48-2398-41b1-9d50-4d7604e08286 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.155878 Jun 20 07:11:59.967778 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 318/632] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:11:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:00.166252 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8451404e-97b9-45b5-9dae-b65c3e39f667 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:00.167080 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8451404e-97b9-45b5-9dae-b65c3e39f667 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:00.174110 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8451404e-97b9-45b5-9dae-b65c3e39f667 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:00.174547 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8451404e-97b9-45b5-9dae-b65c3e39f667 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:00.175292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8451404e-97b9-45b5-9dae-b65c3e39f667 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:00.175718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8451404e-97b9-45b5-9dae-b65c3e39f667 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:00.203869 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8451404e-97b9-45b5-9dae-b65c3e39f667 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041819 Jun 20 07:12:00.204440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 315/633] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:00 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:00.983782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d48633fb-0bf7-478a-b68e-fe2032259fc7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:00.984431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d48633fb-0bf7-478a-b68e-fe2032259fc7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:00.990858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d48633fb-0bf7-478a-b68e-fe2032259fc7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:00.991332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d48633fb-0bf7-478a-b68e-fe2032259fc7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:00.992143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d48633fb-0bf7-478a-b68e-fe2032259fc7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:00.992592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d48633fb-0bf7-478a-b68e-fe2032259fc7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:01.121028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d48633fb-0bf7-478a-b68e-fe2032259fc7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:01.128932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d48633fb-0bf7-478a-b68e-fe2032259fc7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149004 Jun 20 07:12:01.129536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 319/634] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:00 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:01.215437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c5b85de0-c94f-42db-8f7f-8811b79a9032 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:01.216403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c5b85de0-c94f-42db-8f7f-8811b79a9032 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:01.222774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5b85de0-c94f-42db-8f7f-8811b79a9032 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:01.223215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5b85de0-c94f-42db-8f7f-8811b79a9032 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:01.223958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5b85de0-c94f-42db-8f7f-8811b79a9032 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:01.224418 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5b85de0-c94f-42db-8f7f-8811b79a9032 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:01.252172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c5b85de0-c94f-42db-8f7f-8811b79a9032 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041296 Jun 20 07:12:01.252731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 316/635] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:01 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:02.147344 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-81c2811f-498b-4596-80d4-39aa8dc9f791 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:02.147965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-81c2811f-498b-4596-80d4-39aa8dc9f791 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:02.155055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81c2811f-498b-4596-80d4-39aa8dc9f791 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:02.155511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81c2811f-498b-4596-80d4-39aa8dc9f791 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:02.156352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81c2811f-498b-4596-80d4-39aa8dc9f791 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:02.156796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81c2811f-498b-4596-80d4-39aa8dc9f791 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:02.262992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cfaa1911-01bb-478a-9cc9-4f152269746f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:02.263915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cfaa1911-01bb-478a-9cc9-4f152269746f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:02.270820 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cfaa1911-01bb-478a-9cc9-4f152269746f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:02.271271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cfaa1911-01bb-478a-9cc9-4f152269746f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:02.272046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cfaa1911-01bb-478a-9cc9-4f152269746f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:02.272509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cfaa1911-01bb-478a-9cc9-4f152269746f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:02.300789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-81c2811f-498b-4596-80d4-39aa8dc9f791 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:02.302287 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cfaa1911-01bb-478a-9cc9-4f152269746f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043224 Jun 20 07:12:02.302869 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 317/636] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:02 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:12:02.308827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-81c2811f-498b-4596-80d4-39aa8dc9f791 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.165810 Jun 20 07:12:02.309411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 320/637] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:03.314592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-96a997f2-164f-4c81-a0b9-cac882fa2fb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:03.315512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-96a997f2-164f-4c81-a0b9-cac882fa2fb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:03.322429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96a997f2-164f-4c81-a0b9-cac882fa2fb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:03.322878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96a997f2-164f-4c81-a0b9-cac882fa2fb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:03.323654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96a997f2-164f-4c81-a0b9-cac882fa2fb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:03.324219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96a997f2-164f-4c81-a0b9-cac882fa2fb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:03.326737 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-021a8e43-5dde-485e-8f00-2299d4e4d5e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:03.327363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-021a8e43-5dde-485e-8f00-2299d4e4d5e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:03.333842 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-021a8e43-5dde-485e-8f00-2299d4e4d5e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:03.334293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-021a8e43-5dde-485e-8f00-2299d4e4d5e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:03.335060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-021a8e43-5dde-485e-8f00-2299d4e4d5e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:03.335495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-021a8e43-5dde-485e-8f00-2299d4e4d5e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:03.353580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-96a997f2-164f-4c81-a0b9-cac882fa2fb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042938 Jun 20 07:12:03.354148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 318/638] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:03 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:03.460616 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-021a8e43-5dde-485e-8f00-2299d4e4d5e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:03.468947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-021a8e43-5dde-485e-8f00-2299d4e4d5e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147113 Jun 20 07:12:03.469505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 321/639] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:03 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:12:04.466369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5430768f-220c-4838-980c-ada5fb001ae6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:04.467428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5430768f-220c-4838-980c-ada5fb001ae6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:04.473553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5430768f-220c-4838-980c-ada5fb001ae6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:04.474076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5430768f-220c-4838-980c-ada5fb001ae6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:04.474900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5430768f-220c-4838-980c-ada5fb001ae6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:04.475405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5430768f-220c-4838-980c-ada5fb001ae6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:04.485750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-181bee17-a71a-47f5-9394-390f45d2e1a2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:04.486379 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-181bee17-a71a-47f5-9394-390f45d2e1a2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:04.493172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:12:04.493370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-181bee17-a71a-47f5-9394-390f45d2e1a2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:04.493631 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-181bee17-a71a-47f5-9394-390f45d2e1a2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:04.494404 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-181bee17-a71a-47f5-9394-390f45d2e1a2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:04.495608 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-181bee17-a71a-47f5-9394-390f45d2e1a2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:04.507893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5430768f-220c-4838-980c-ada5fb001ae6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.146412 Jun 20 07:12:04.508488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 319/640] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:04 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:04.630420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-181bee17-a71a-47f5-9394-390f45d2e1a2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:04.638357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-181bee17-a71a-47f5-9394-390f45d2e1a2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1715 microversion: 2.1 time: 0.156387 Jun 20 07:12:04.638923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 322/641] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:04 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:12:04.740655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2051a3a6-f3d6-4b3f-954f-37af889403d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:04.741152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2051a3a6-f3d6-4b3f-954f-37af889403d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:04.747756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2051a3a6-f3d6-4b3f-954f-37af889403d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:04.748234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2051a3a6-f3d6-4b3f-954f-37af889403d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:04.749028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2051a3a6-f3d6-4b3f-954f-37af889403d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:04.749466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2051a3a6-f3d6-4b3f-954f-37af889403d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:04.877930 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-2051a3a6-f3d6-4b3f-954f-37af889403d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] HTTP exception thrown: Cannot 'detach_volume' instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 while it is in vm_state rescued Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2051a3a6-f3d6-4b3f-954f-37af889403d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Request method failure captured: Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac HTTP/1.1 Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisBydWR9hXTdRdgEMgIPM-1lAL620VtySsJQPtX3E4eETT6X1pqkxCAdBrQ05QM3sLf2M6w4suLslwDczM450U7T03NmXju7Tum6YsJN5wR3uh9QywM_y5Z98mk3Ttcwbp4tjIhwIlNWuRc740_x69DYuTSos87GlveyHMBK04lJyYJs Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:12:04.879874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:12:04.881530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:12:04.881530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:12:04.881530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:12:04.881530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:12:04.881530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:12:04.881530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:12:04.881530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:12:04.881530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: af0dee4e1dfb4f879dfe41622a9e23b1 Jun 20 07:12:04.881530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:12:04.881530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:12:04.881530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Cannot 'detach_volume' instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 while it is in vm_state rescued Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'server_id': 'b2be05cc-d645-4d3b-9fcb-dbacd92e2f75', 'id': '14acc9ca-9ac6-446e-b502-951bbf9876ac'} Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:12:04.882316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 while it is in vm_state rescued Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 while it is in vm_state rescued Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:12:04.883722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2051a3a6-f3d6-4b3f-954f-37af889403d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Returning 409 to user: Cannot 'detach_volume' instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 while it is in vm_state rescued {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:12:04.884897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2051a3a6-f3d6-4b3f-954f-37af889403d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac" status: 409 len: 152 microversion: 2.1 time: 0.144641 Jun 20 07:12:04.884897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 320/642] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:12:04 2022] DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 07:12:04.890289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-600c5b3d-fb57-4360-9ec0-a876eda39ffc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:12:04.890833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-600c5b3d-fb57-4360-9ec0-a876eda39ffc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:04.897059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-600c5b3d-fb57-4360-9ec0-a876eda39ffc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:04.897515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-600c5b3d-fb57-4360-9ec0-a876eda39ffc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:04.898290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-600c5b3d-fb57-4360-9ec0-a876eda39ffc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:04.898733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-600c5b3d-fb57-4360-9ec0-a876eda39ffc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:04.944673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:12:04.966595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-600c5b3d-fb57-4360-9ec0-a876eda39ffc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "POST /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/action" status: 202 len: 0 microversion: 2.1 time: 0.079932 Jun 20 07:12:04.967485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 323/643] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:12:04 2022] POST /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:12:04.975423 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-21c38136-f941-4696-8467-9d26116cb40d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:04.984352 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-21c38136-f941-4696-8467-9d26116cb40d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:04.990964 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-21c38136-f941-4696-8467-9d26116cb40d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:04.991501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-21c38136-f941-4696-8467-9d26116cb40d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:04.992325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-21c38136-f941-4696-8467-9d26116cb40d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:04.992762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-21c38136-f941-4696-8467-9d26116cb40d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:05.207736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-21c38136-f941-4696-8467-9d26116cb40d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:05.216411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-21c38136-f941-4696-8467-9d26116cb40d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1723 microversion: 2.1 time: 0.244794 Jun 20 07:12:05.216977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 321/644] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:04 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:05.521540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6a2e68e-9175-4553-a445-8923c05a5d83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:05.522532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e6a2e68e-9175-4553-a445-8923c05a5d83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:05.529234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6a2e68e-9175-4553-a445-8923c05a5d83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:05.529680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6a2e68e-9175-4553-a445-8923c05a5d83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:05.530434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6a2e68e-9175-4553-a445-8923c05a5d83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:05.530865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6a2e68e-9175-4553-a445-8923c05a5d83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:05.560689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e6a2e68e-9175-4553-a445-8923c05a5d83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044178 Jun 20 07:12:05.561257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 324/645] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:05 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:06.234195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-03206a03-fcdb-45cc-96d9-7fe6784660d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:06.234806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-03206a03-fcdb-45cc-96d9-7fe6784660d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:06.241332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03206a03-fcdb-45cc-96d9-7fe6784660d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:06.241777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03206a03-fcdb-45cc-96d9-7fe6784660d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:06.242529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03206a03-fcdb-45cc-96d9-7fe6784660d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:06.242960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03206a03-fcdb-45cc-96d9-7fe6784660d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:06.371236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-03206a03-fcdb-45cc-96d9-7fe6784660d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:06.379071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-03206a03-fcdb-45cc-96d9-7fe6784660d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1723 microversion: 2.1 time: 0.148662 Jun 20 07:12:06.379636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 322/646] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:06 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:06.572290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3b829cb2-c570-47fe-8f39-b586da2c9f45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:06.573133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3b829cb2-c570-47fe-8f39-b586da2c9f45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:06.579467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b829cb2-c570-47fe-8f39-b586da2c9f45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:06.579914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b829cb2-c570-47fe-8f39-b586da2c9f45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:06.580700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b829cb2-c570-47fe-8f39-b586da2c9f45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:06.581167 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b829cb2-c570-47fe-8f39-b586da2c9f45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:06.609909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3b829cb2-c570-47fe-8f39-b586da2c9f45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041643 Jun 20 07:12:06.610452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 325/647] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:06 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:07.396599 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4a4c1326-8efa-45d6-b2e0-c6913a93839e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:07.397123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4a4c1326-8efa-45d6-b2e0-c6913a93839e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:07.404026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a4c1326-8efa-45d6-b2e0-c6913a93839e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:07.404504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a4c1326-8efa-45d6-b2e0-c6913a93839e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:07.405251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a4c1326-8efa-45d6-b2e0-c6913a93839e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:07.405683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a4c1326-8efa-45d6-b2e0-c6913a93839e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:07.536455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4a4c1326-8efa-45d6-b2e0-c6913a93839e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:07.545077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4a4c1326-8efa-45d6-b2e0-c6913a93839e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1723 microversion: 2.1 time: 0.152396 Jun 20 07:12:07.545640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 323/648] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:07 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:07.621583 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-28235b1e-9207-4745-b8f6-6a7a508f05dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:07.622548 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-28235b1e-9207-4745-b8f6-6a7a508f05dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:07.629044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28235b1e-9207-4745-b8f6-6a7a508f05dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:07.629494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28235b1e-9207-4745-b8f6-6a7a508f05dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:07.630257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28235b1e-9207-4745-b8f6-6a7a508f05dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:07.630697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28235b1e-9207-4745-b8f6-6a7a508f05dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:07.661591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-28235b1e-9207-4745-b8f6-6a7a508f05dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043934 Jun 20 07:12:07.662068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 326/649] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:07 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:08.610794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d62af75e-7744-40b0-83ff-ca4eb9ebad14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:08.611409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d62af75e-7744-40b0-83ff-ca4eb9ebad14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:08.617473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d62af75e-7744-40b0-83ff-ca4eb9ebad14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:08.617920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d62af75e-7744-40b0-83ff-ca4eb9ebad14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:08.618674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d62af75e-7744-40b0-83ff-ca4eb9ebad14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:08.619102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d62af75e-7744-40b0-83ff-ca4eb9ebad14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:08.673291 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-600339f2-f0f9-458f-b773-a582ec3d0d1a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:08.674208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-600339f2-f0f9-458f-b773-a582ec3d0d1a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:08.680623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-600339f2-f0f9-458f-b773-a582ec3d0d1a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:08.681078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-600339f2-f0f9-458f-b773-a582ec3d0d1a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:08.681836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-600339f2-f0f9-458f-b773-a582ec3d0d1a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:08.682272 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-600339f2-f0f9-458f-b773-a582ec3d0d1a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:08.712491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-600339f2-f0f9-458f-b773-a582ec3d0d1a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043130 Jun 20 07:12:08.713071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 327/650] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:08 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:12:08.755389 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d62af75e-7744-40b0-83ff-ca4eb9ebad14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:08.763857 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d62af75e-7744-40b0-83ff-ca4eb9ebad14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1729 microversion: 2.1 time: 0.205500 Jun 20 07:12:08.764451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 324/651] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:08 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:08.780310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-205e031f-2540-4654-816c-75e1e5042ddb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:08.780814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-205e031f-2540-4654-816c-75e1e5042ddb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:08.786840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-205e031f-2540-4654-816c-75e1e5042ddb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:08.787289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-205e031f-2540-4654-816c-75e1e5042ddb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:08.788050 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-205e031f-2540-4654-816c-75e1e5042ddb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:08.788518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-205e031f-2540-4654-816c-75e1e5042ddb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:08.866239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-205e031f-2540-4654-816c-75e1e5042ddb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089771 Jun 20 07:12:08.866831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 328/652] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 07:12:08 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:12:09.720094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-8197677b-5dfd-42c2-a98a-8c5396e04d42 req-c2e8658c-1abc-4f8a-997f-03dd470f8b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2be05cc-d645-4d3b-9fcb-dbacd92e2f75", "tag": "f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:12:09.726056 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fd98c4a3-a565-4c19-8ef0-73a9d2919620 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:09.728590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fd98c4a3-a565-4c19-8ef0-73a9d2919620 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:09.740156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-8197677b-5dfd-42c2-a98a-8c5396e04d42 req-c2e8658c-1abc-4f8a-997f-03dd470f8b44 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:09.744253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd98c4a3-a565-4c19-8ef0-73a9d2919620 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:09.744735 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd98c4a3-a565-4c19-8ef0-73a9d2919620 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:09.745517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd98c4a3-a565-4c19-8ef0-73a9d2919620 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:09.745951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd98c4a3-a565-4c19-8ef0-73a9d2919620 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:09.748476 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-8197677b-5dfd-42c2-a98a-8c5396e04d42 req-c2e8658c-1abc-4f8a-997f-03dd470f8b44 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:09.772644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-8197677b-5dfd-42c2-a98a-8c5396e04d42 req-c2e8658c-1abc-4f8a-997f-03dd470f8b44 service nova] Creating event network-changed:f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad for instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 on hv-cinder-77819 Jun 20 07:12:09.778785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-8197677b-5dfd-42c2-a98a-8c5396e04d42 req-c2e8658c-1abc-4f8a-997f-03dd470f8b44 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062856 Jun 20 07:12:09.779957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 325/653] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:12:09.795021 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fd98c4a3-a565-4c19-8ef0-73a9d2919620 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073264 Jun 20 07:12:09.796013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 329/654] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:09 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:12:10.808633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3db0387f-3ae8-402d-9a49-eac9b79a6737 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:10.809627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3db0387f-3ae8-402d-9a49-eac9b79a6737 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:10.815802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3db0387f-3ae8-402d-9a49-eac9b79a6737 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:10.816284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3db0387f-3ae8-402d-9a49-eac9b79a6737 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:10.817041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3db0387f-3ae8-402d-9a49-eac9b79a6737 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:10.817476 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3db0387f-3ae8-402d-9a49-eac9b79a6737 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:10.846350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3db0387f-3ae8-402d-9a49-eac9b79a6737 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043087 Jun 20 07:12:10.846905 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 326/655] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:10 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:11.858062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4dc4761b-6329-4b4f-b74d-204b1abbb2e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:11.858981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4dc4761b-6329-4b4f-b74d-204b1abbb2e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:11.865454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dc4761b-6329-4b4f-b74d-204b1abbb2e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:11.865903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dc4761b-6329-4b4f-b74d-204b1abbb2e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:11.866653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dc4761b-6329-4b4f-b74d-204b1abbb2e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:11.867088 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dc4761b-6329-4b4f-b74d-204b1abbb2e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:11.896572 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4dc4761b-6329-4b4f-b74d-204b1abbb2e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042427 Jun 20 07:12:11.897122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 330/656] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:11 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:11.983917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-2b3032a1-02ae-4bec-9094-32af783e633c req-fa0aadcc-a6eb-452f-a759-37ff422b3b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2be05cc-d645-4d3b-9fcb-dbacd92e2f75", "tag": "f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:12:11.992295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-2b3032a1-02ae-4bec-9094-32af783e633c req-fa0aadcc-a6eb-452f-a759-37ff422b3b51 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:11.992734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-2b3032a1-02ae-4bec-9094-32af783e633c req-fa0aadcc-a6eb-452f-a759-37ff422b3b51 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:12.003653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-2b3032a1-02ae-4bec-9094-32af783e633c req-fa0aadcc-a6eb-452f-a759-37ff422b3b51 service nova] Creating event network-changed:f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad for instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 on hv-cinder-77819 Jun 20 07:12:12.008356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-2b3032a1-02ae-4bec-9094-32af783e633c req-fa0aadcc-a6eb-452f-a759-37ff422b3b51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028005 Jun 20 07:12:12.008944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 327/657] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:12:12.908625 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-03e94b79-809e-4a8a-b93f-ddcd2ae78173 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:12.909467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-03e94b79-809e-4a8a-b93f-ddcd2ae78173 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:12.915916 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03e94b79-809e-4a8a-b93f-ddcd2ae78173 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:12.916403 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03e94b79-809e-4a8a-b93f-ddcd2ae78173 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:12.917173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03e94b79-809e-4a8a-b93f-ddcd2ae78173 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:12.917608 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03e94b79-809e-4a8a-b93f-ddcd2ae78173 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:12.945297 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-03e94b79-809e-4a8a-b93f-ddcd2ae78173 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040868 Jun 20 07:12:12.945849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 331/658] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:12 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:13.958607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0e3b5302-76f7-42a5-8423-8b640fb8b29a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:13.959526 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0e3b5302-76f7-42a5-8423-8b640fb8b29a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:13.966227 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e3b5302-76f7-42a5-8423-8b640fb8b29a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:13.966676 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e3b5302-76f7-42a5-8423-8b640fb8b29a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:13.967430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e3b5302-76f7-42a5-8423-8b640fb8b29a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:13.967867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e3b5302-76f7-42a5-8423-8b640fb8b29a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:13.996153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0e3b5302-76f7-42a5-8423-8b640fb8b29a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042440 Jun 20 07:12:13.996696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 328/659] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:13 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:15.007438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fa90b2b2-4533-4930-bbc7-12d7886bee5a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:15.008425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fa90b2b2-4533-4930-bbc7-12d7886bee5a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:15.015484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa90b2b2-4533-4930-bbc7-12d7886bee5a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:15.015934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa90b2b2-4533-4930-bbc7-12d7886bee5a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:15.016997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa90b2b2-4533-4930-bbc7-12d7886bee5a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:15.017441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa90b2b2-4533-4930-bbc7-12d7886bee5a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:15.045137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fa90b2b2-4533-4930-bbc7-12d7886bee5a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041683 Jun 20 07:12:15.045672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 332/660] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:15 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:16.056286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0faee7e8-ba67-4e30-80d5-315aa6bc4159 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:16.057118 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0faee7e8-ba67-4e30-80d5-315aa6bc4159 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:16.063650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0faee7e8-ba67-4e30-80d5-315aa6bc4159 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:16.064093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0faee7e8-ba67-4e30-80d5-315aa6bc4159 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:16.064874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0faee7e8-ba67-4e30-80d5-315aa6bc4159 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:16.065333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0faee7e8-ba67-4e30-80d5-315aa6bc4159 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:16.094043 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0faee7e8-ba67-4e30-80d5-315aa6bc4159 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041822 Jun 20 07:12:16.094585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 329/661] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:16 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:17.106549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3df1d052-2bf2-41b4-b8b5-225007a6a73a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:17.107467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3df1d052-2bf2-41b4-b8b5-225007a6a73a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:17.114015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3df1d052-2bf2-41b4-b8b5-225007a6a73a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:17.114463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3df1d052-2bf2-41b4-b8b5-225007a6a73a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:17.115218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3df1d052-2bf2-41b4-b8b5-225007a6a73a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:17.115660 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3df1d052-2bf2-41b4-b8b5-225007a6a73a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:17.143538 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3df1d052-2bf2-41b4-b8b5-225007a6a73a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041651 Jun 20 07:12:17.144073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 333/662] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:17 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:18.155319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0c8e851f-6c9a-4246-828a-a3fa6f82ec1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:18.156193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0c8e851f-6c9a-4246-828a-a3fa6f82ec1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:18.162631 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c8e851f-6c9a-4246-828a-a3fa6f82ec1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:18.163070 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c8e851f-6c9a-4246-828a-a3fa6f82ec1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:18.163815 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c8e851f-6c9a-4246-828a-a3fa6f82ec1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:18.164276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c8e851f-6c9a-4246-828a-a3fa6f82ec1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:18.193721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0c8e851f-6c9a-4246-828a-a3fa6f82ec1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043144 Jun 20 07:12:18.194258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 330/663] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:18 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:19.205434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fc3630d5-bb15-44a9-a48f-5b4f638085ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:19.206388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fc3630d5-bb15-44a9-a48f-5b4f638085ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:19.212820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc3630d5-bb15-44a9-a48f-5b4f638085ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:19.213270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc3630d5-bb15-44a9-a48f-5b4f638085ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:19.214617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc3630d5-bb15-44a9-a48f-5b4f638085ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:19.215054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc3630d5-bb15-44a9-a48f-5b4f638085ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:19.243195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fc3630d5-bb15-44a9-a48f-5b4f638085ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041755 Jun 20 07:12:19.243742 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 334/664] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:19 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:20.254999 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-622eb74a-2a1b-4985-befe-42a61b781681 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:20.255906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-622eb74a-2a1b-4985-befe-42a61b781681 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:20.262369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-622eb74a-2a1b-4985-befe-42a61b781681 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:20.262818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-622eb74a-2a1b-4985-befe-42a61b781681 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:20.263608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-622eb74a-2a1b-4985-befe-42a61b781681 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:20.264037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-622eb74a-2a1b-4985-befe-42a61b781681 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:20.293246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-622eb74a-2a1b-4985-befe-42a61b781681 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042235 Jun 20 07:12:20.293792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 331/665] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:20 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:21.304927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f3538c36-a368-4d06-8bf3-af27d0d7a808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:21.305862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f3538c36-a368-4d06-8bf3-af27d0d7a808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:21.312020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3538c36-a368-4d06-8bf3-af27d0d7a808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:21.312569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3538c36-a368-4d06-8bf3-af27d0d7a808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:21.313330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3538c36-a368-4d06-8bf3-af27d0d7a808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:21.313768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3538c36-a368-4d06-8bf3-af27d0d7a808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:21.342935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f3538c36-a368-4d06-8bf3-af27d0d7a808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041985 Jun 20 07:12:21.343485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 335/666] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:21 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:22.354512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2613f814-89a0-4e32-bf9d-072f2af7f442 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:22.355341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2613f814-89a0-4e32-bf9d-072f2af7f442 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:22.361756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2613f814-89a0-4e32-bf9d-072f2af7f442 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:22.362203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2613f814-89a0-4e32-bf9d-072f2af7f442 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:22.362959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2613f814-89a0-4e32-bf9d-072f2af7f442 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:22.363393 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2613f814-89a0-4e32-bf9d-072f2af7f442 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:22.392297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2613f814-89a0-4e32-bf9d-072f2af7f442 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041536 Jun 20 07:12:22.392839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 332/667] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:23.404711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bdae8e8e-d2f5-4e17-a0f1-202b66f3eb02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:23.405629 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bdae8e8e-d2f5-4e17-a0f1-202b66f3eb02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:23.408028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=48 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:12:23.413463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bdae8e8e-d2f5-4e17-a0f1-202b66f3eb02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:23.413916 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bdae8e8e-d2f5-4e17-a0f1-202b66f3eb02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:23.414727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bdae8e8e-d2f5-4e17-a0f1-202b66f3eb02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:23.415162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bdae8e8e-d2f5-4e17-a0f1-202b66f3eb02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:23.443179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bdae8e8e-d2f5-4e17-a0f1-202b66f3eb02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043173 Jun 20 07:12:23.443730 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 336/668] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:23 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:24.455238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e1565d2b-b232-4b4a-aa21-e8c1dc31f73b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:24.456185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e1565d2b-b232-4b4a-aa21-e8c1dc31f73b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:24.458593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=50 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:12:24.464524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1565d2b-b232-4b4a-aa21-e8c1dc31f73b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:24.464969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1565d2b-b232-4b4a-aa21-e8c1dc31f73b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:24.465727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1565d2b-b232-4b4a-aa21-e8c1dc31f73b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:24.466167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1565d2b-b232-4b4a-aa21-e8c1dc31f73b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:24.494746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e1565d2b-b232-4b4a-aa21-e8c1dc31f73b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043725 Jun 20 07:12:24.495296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 333/669] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:24 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:25.506552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c40e114a-aeca-490f-98ec-2ebb742f2678 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:25.507471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c40e114a-aeca-490f-98ec-2ebb742f2678 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:25.513902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c40e114a-aeca-490f-98ec-2ebb742f2678 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:25.514354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c40e114a-aeca-490f-98ec-2ebb742f2678 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:25.515110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c40e114a-aeca-490f-98ec-2ebb742f2678 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:25.515549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c40e114a-aeca-490f-98ec-2ebb742f2678 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:25.544558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c40e114a-aeca-490f-98ec-2ebb742f2678 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042003 Jun 20 07:12:25.545097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 337/670] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:25 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:12:26.556462 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9bc37964-6d17-428b-8cd8-8d1e646e49b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:26.557398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9bc37964-6d17-428b-8cd8-8d1e646e49b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:26.563890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bc37964-6d17-428b-8cd8-8d1e646e49b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:26.564378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bc37964-6d17-428b-8cd8-8d1e646e49b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:26.565140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bc37964-6d17-428b-8cd8-8d1e646e49b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:26.565582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bc37964-6d17-428b-8cd8-8d1e646e49b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:26.594411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9bc37964-6d17-428b-8cd8-8d1e646e49b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042204 Jun 20 07:12:26.594958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 334/671] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:26 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:27.606849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-546adb54-3fb5-4126-8f17-b1b28480a6c5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:27.607773 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-546adb54-3fb5-4126-8f17-b1b28480a6c5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:27.614304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-546adb54-3fb5-4126-8f17-b1b28480a6c5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:27.614759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-546adb54-3fb5-4126-8f17-b1b28480a6c5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:27.615521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-546adb54-3fb5-4126-8f17-b1b28480a6c5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:27.615962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-546adb54-3fb5-4126-8f17-b1b28480a6c5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:27.644639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-546adb54-3fb5-4126-8f17-b1b28480a6c5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042526 Jun 20 07:12:27.645190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 338/672] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:27 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:28.656315 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a3391b1b-95a8-40ee-b7f9-fcb593de3b30 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:28.657232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a3391b1b-95a8-40ee-b7f9-fcb593de3b30 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:28.663605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3391b1b-95a8-40ee-b7f9-fcb593de3b30 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:28.664050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3391b1b-95a8-40ee-b7f9-fcb593de3b30 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:28.664834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3391b1b-95a8-40ee-b7f9-fcb593de3b30 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:28.665266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3391b1b-95a8-40ee-b7f9-fcb593de3b30 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:28.694143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a3391b1b-95a8-40ee-b7f9-fcb593de3b30 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041841 Jun 20 07:12:28.694755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 335/673] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:28 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:12:29.705262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f92af8be-c592-4a33-bfe8-eed73852ed40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:29.706203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f92af8be-c592-4a33-bfe8-eed73852ed40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:29.712762 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f92af8be-c592-4a33-bfe8-eed73852ed40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:29.713723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f92af8be-c592-4a33-bfe8-eed73852ed40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:29.714515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f92af8be-c592-4a33-bfe8-eed73852ed40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:29.714954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f92af8be-c592-4a33-bfe8-eed73852ed40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:29.744875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f92af8be-c592-4a33-bfe8-eed73852ed40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043917 Jun 20 07:12:29.745423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 339/674] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:29 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:30.756727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-432cd512-33a9-4acd-a4f4-47ba19cfc5cd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:30.757648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-432cd512-33a9-4acd-a4f4-47ba19cfc5cd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:30.764055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-432cd512-33a9-4acd-a4f4-47ba19cfc5cd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:30.764535 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-432cd512-33a9-4acd-a4f4-47ba19cfc5cd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:30.765295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-432cd512-33a9-4acd-a4f4-47ba19cfc5cd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:30.765729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-432cd512-33a9-4acd-a4f4-47ba19cfc5cd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:30.795330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-432cd512-33a9-4acd-a4f4-47ba19cfc5cd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042576 Jun 20 07:12:30.795910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 336/675] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:30 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:31.808292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-46749559-5d5e-408e-ab32-3f4f1a59b304 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:31.808863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-46749559-5d5e-408e-ab32-3f4f1a59b304 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:31.815179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46749559-5d5e-408e-ab32-3f4f1a59b304 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:31.815624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46749559-5d5e-408e-ab32-3f4f1a59b304 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:31.816388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46749559-5d5e-408e-ab32-3f4f1a59b304 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:31.816820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46749559-5d5e-408e-ab32-3f4f1a59b304 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:31.832688 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:12:31.846292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-46749559-5d5e-408e-ab32-3f4f1a59b304 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042978 Jun 20 07:12:31.846832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 340/676] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:31 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:32.857966 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7a5b5728-899d-4b02-9ea9-41aecbad7274 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:32.858895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7a5b5728-899d-4b02-9ea9-41aecbad7274 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:32.865254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a5b5728-899d-4b02-9ea9-41aecbad7274 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:32.865696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a5b5728-899d-4b02-9ea9-41aecbad7274 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:32.866440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a5b5728-899d-4b02-9ea9-41aecbad7274 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:32.866868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a5b5728-899d-4b02-9ea9-41aecbad7274 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:32.883975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:12:32.897954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7a5b5728-899d-4b02-9ea9-41aecbad7274 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043949 Jun 20 07:12:32.898507 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 337/677] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:32 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:33.909986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-14486887-ff98-428f-93c4-6b80cdaaae0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:33.910908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-14486887-ff98-428f-93c4-6b80cdaaae0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:33.917402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14486887-ff98-428f-93c4-6b80cdaaae0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:33.917848 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14486887-ff98-428f-93c4-6b80cdaaae0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:33.918607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14486887-ff98-428f-93c4-6b80cdaaae0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:33.919044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14486887-ff98-428f-93c4-6b80cdaaae0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:33.946927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-14486887-ff98-428f-93c4-6b80cdaaae0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040974 Jun 20 07:12:33.948057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 341/678] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:33 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:34.959161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2916fc18-cffd-4959-bb71-fe990d5e8b9c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:34.959983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2916fc18-cffd-4959-bb71-fe990d5e8b9c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:34.966501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2916fc18-cffd-4959-bb71-fe990d5e8b9c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:34.966938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2916fc18-cffd-4959-bb71-fe990d5e8b9c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:34.967684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2916fc18-cffd-4959-bb71-fe990d5e8b9c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:34.968125 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2916fc18-cffd-4959-bb71-fe990d5e8b9c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:34.996532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2916fc18-cffd-4959-bb71-fe990d5e8b9c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041554 Jun 20 07:12:34.997071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 338/679] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:34 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:36.008434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e4a15db1-edcd-451b-a701-f6682d50578a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:36.009373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e4a15db1-edcd-451b-a701-f6682d50578a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:36.015720 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4a15db1-edcd-451b-a701-f6682d50578a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:36.016198 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4a15db1-edcd-451b-a701-f6682d50578a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:36.017230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4a15db1-edcd-451b-a701-f6682d50578a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:36.017658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4a15db1-edcd-451b-a701-f6682d50578a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:36.046346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e4a15db1-edcd-451b-a701-f6682d50578a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042072 Jun 20 07:12:36.046873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 342/680] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:36 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:36.163827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5a181192-9296-48ee-b2ca-1f7d5212e09f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:36.164352 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5a181192-9296-48ee-b2ca-1f7d5212e09f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:36.170683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a181192-9296-48ee-b2ca-1f7d5212e09f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:36.171134 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a181192-9296-48ee-b2ca-1f7d5212e09f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:36.171893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a181192-9296-48ee-b2ca-1f7d5212e09f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:36.172353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a181192-9296-48ee-b2ca-1f7d5212e09f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:36.201685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5a181192-9296-48ee-b2ca-1f7d5212e09f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:12:36.274236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5a181192-9296-48ee-b2ca-1f7d5212e09f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "DELETE /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 204 len: 0 microversion: 2.1 time: 0.114100 Jun 20 07:12:36.274843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 339/681] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:12:36 2022] DELETE /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:12:36.283847 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-163f3907-7a84-4ffd-9fe1-5ed74361f1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:36.284493 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-163f3907-7a84-4ffd-9fe1-5ed74361f1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:36.290915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-163f3907-7a84-4ffd-9fe1-5ed74361f1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:36.291363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-163f3907-7a84-4ffd-9fe1-5ed74361f1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:36.292146 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-163f3907-7a84-4ffd-9fe1-5ed74361f1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:36.292585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-163f3907-7a84-4ffd-9fe1-5ed74361f1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:36.421258 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-163f3907-7a84-4ffd-9fe1-5ed74361f1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:36.428734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-163f3907-7a84-4ffd-9fe1-5ed74361f1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1575 microversion: 2.1 time: 0.148990 Jun 20 07:12:36.429289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 343/682] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:36 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:12:37.059273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b454af37-374a-42b4-b3ed-1db62eef924a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:37.060309 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b454af37-374a-42b4-b3ed-1db62eef924a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:37.066398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b454af37-374a-42b4-b3ed-1db62eef924a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:37.066845 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b454af37-374a-42b4-b3ed-1db62eef924a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:37.067609 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b454af37-374a-42b4-b3ed-1db62eef924a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:37.068039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b454af37-374a-42b4-b3ed-1db62eef924a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:37.099310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b454af37-374a-42b4-b3ed-1db62eef924a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045116 Jun 20 07:12:37.099873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 340/683] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:37 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:37.445898 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b8b05ef3-583b-46cc-8709-5fa2a4585fa2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:37.446441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b8b05ef3-583b-46cc-8709-5fa2a4585fa2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:37.453538 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8b05ef3-583b-46cc-8709-5fa2a4585fa2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:37.453986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8b05ef3-583b-46cc-8709-5fa2a4585fa2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:37.454747 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8b05ef3-583b-46cc-8709-5fa2a4585fa2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:37.455188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8b05ef3-583b-46cc-8709-5fa2a4585fa2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:37.591068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b8b05ef3-583b-46cc-8709-5fa2a4585fa2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:37.598553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b8b05ef3-583b-46cc-8709-5fa2a4585fa2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1575 microversion: 2.1 time: 0.156579 Jun 20 07:12:37.599122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 344/684] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:37 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:38.111201 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d89f42da-f9b1-444a-ad23-e112c4783408 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:38.112232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d89f42da-f9b1-444a-ad23-e112c4783408 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:38.118677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d89f42da-f9b1-444a-ad23-e112c4783408 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:38.119253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d89f42da-f9b1-444a-ad23-e112c4783408 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:38.120015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d89f42da-f9b1-444a-ad23-e112c4783408 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:38.120488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d89f42da-f9b1-444a-ad23-e112c4783408 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:38.148541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d89f42da-f9b1-444a-ad23-e112c4783408 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041465 Jun 20 07:12:38.149106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 341/685] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:38 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:38.616728 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ca2758f-b695-43e7-9bae-184d93bbee88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:38.617462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1ca2758f-b695-43e7-9bae-184d93bbee88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:38.624836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ca2758f-b695-43e7-9bae-184d93bbee88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:38.625290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ca2758f-b695-43e7-9bae-184d93bbee88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:38.626067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ca2758f-b695-43e7-9bae-184d93bbee88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:38.626507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ca2758f-b695-43e7-9bae-184d93bbee88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:38.715940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1ca2758f-b695-43e7-9bae-184d93bbee88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:38.723947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1ca2758f-b695-43e7-9bae-184d93bbee88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1508 microversion: 2.1 time: 0.111053 Jun 20 07:12:38.754143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 345/686] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:38 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1508 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:38.821632 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-8f380b38-d47f-4721-8175-159561f692e8 req-6caac517-f728-4c7d-b80c-64aa1eed94f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de77ef2f-9577-403b-99e7-2540b785a6d3", "name": "network-vif-deleted", "tag": "ad8416ab-dcec-4280-89aa-c020d26b2a20"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:12:38.837692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-8f380b38-d47f-4721-8175-159561f692e8 req-6caac517-f728-4c7d-b80c-64aa1eed94f6 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:38.841906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-8f380b38-d47f-4721-8175-159561f692e8 req-6caac517-f728-4c7d-b80c-64aa1eed94f6 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:38.858206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-8f380b38-d47f-4721-8175-159561f692e8 req-6caac517-f728-4c7d-b80c-64aa1eed94f6 service nova] Creating event network-vif-deleted:ad8416ab-dcec-4280-89aa-c020d26b2a20 for instance de77ef2f-9577-403b-99e7-2540b785a6d3 on hv-cinder-77819 Jun 20 07:12:38.863605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-8f380b38-d47f-4721-8175-159561f692e8 req-6caac517-f728-4c7d-b80c-64aa1eed94f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132926 Jun 20 07:12:38.864376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 342/687] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:12:39.160792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7ef60e27-9087-410e-bb4e-c1d3728aac5e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:39.161776 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7ef60e27-9087-410e-bb4e-c1d3728aac5e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:39.167727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ef60e27-9087-410e-bb4e-c1d3728aac5e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:39.168250 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ef60e27-9087-410e-bb4e-c1d3728aac5e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:39.169013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ef60e27-9087-410e-bb4e-c1d3728aac5e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:39.169455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ef60e27-9087-410e-bb4e-c1d3728aac5e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:39.198042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7ef60e27-9087-410e-bb4e-c1d3728aac5e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040682 Jun 20 07:12:39.198610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 346/688] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:39 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:39.742465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-55273d08-265a-49f5-8d77-f575a2ad5c92 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:39.743173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-55273d08-265a-49f5-8d77-f575a2ad5c92 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:39.750469 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55273d08-265a-49f5-8d77-f575a2ad5c92 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:39.750959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55273d08-265a-49f5-8d77-f575a2ad5c92 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:39.751760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55273d08-265a-49f5-8d77-f575a2ad5c92 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:39.752223 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55273d08-265a-49f5-8d77-f575a2ad5c92 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:39.817447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-55273d08-265a-49f5-8d77-f575a2ad5c92 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:39.826088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-55273d08-265a-49f5-8d77-f575a2ad5c92 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.088395 Jun 20 07:12:39.826661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 343/689] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:39 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:40.210079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-333964e5-0e33-4dac-a6e8-8019b46c33df tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:40.211010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-333964e5-0e33-4dac-a6e8-8019b46c33df tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:40.217994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-333964e5-0e33-4dac-a6e8-8019b46c33df tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:40.218447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-333964e5-0e33-4dac-a6e8-8019b46c33df tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:40.219205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-333964e5-0e33-4dac-a6e8-8019b46c33df tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:40.219644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-333964e5-0e33-4dac-a6e8-8019b46c33df tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:40.248350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-333964e5-0e33-4dac-a6e8-8019b46c33df tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042594 Jun 20 07:12:40.248906 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 347/690] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:40 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:40.843724 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-777651aa-5174-4c1f-83a9-351445b9946a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:40.844361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-777651aa-5174-4c1f-83a9-351445b9946a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:40.851071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-777651aa-5174-4c1f-83a9-351445b9946a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:40.851507 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-777651aa-5174-4c1f-83a9-351445b9946a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:40.852323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-777651aa-5174-4c1f-83a9-351445b9946a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:40.852819 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-777651aa-5174-4c1f-83a9-351445b9946a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:40.913224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-777651aa-5174-4c1f-83a9-351445b9946a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:40.920557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-777651aa-5174-4c1f-83a9-351445b9946a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081302 Jun 20 07:12:40.921116 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 344/691] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:40 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:41.259045 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-17d86551-7459-4137-881d-66b545e41afb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:41.260570 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-17d86551-7459-4137-881d-66b545e41afb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:41.267434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17d86551-7459-4137-881d-66b545e41afb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:41.267887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17d86551-7459-4137-881d-66b545e41afb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:41.268678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17d86551-7459-4137-881d-66b545e41afb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:41.269117 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17d86551-7459-4137-881d-66b545e41afb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:41.298049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-17d86551-7459-4137-881d-66b545e41afb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043037 Jun 20 07:12:41.298603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 348/692] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:41 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:41.938062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1981b0c4-5d8e-424d-bab6-0c598407f2af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:41.938635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1981b0c4-5d8e-424d-bab6-0c598407f2af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:41.944993 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1981b0c4-5d8e-424d-bab6-0c598407f2af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:41.945436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1981b0c4-5d8e-424d-bab6-0c598407f2af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:41.946178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1981b0c4-5d8e-424d-bab6-0c598407f2af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:41.946604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1981b0c4-5d8e-424d-bab6-0c598407f2af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:42.005684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1981b0c4-5d8e-424d-bab6-0c598407f2af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:42.013850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1981b0c4-5d8e-424d-bab6-0c598407f2af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079691 Jun 20 07:12:42.014403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 345/693] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:41 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:42.309774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7cdd9744-2dc0-456a-96d5-50a26a805943 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:42.310686 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7cdd9744-2dc0-456a-96d5-50a26a805943 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:42.317857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cdd9744-2dc0-456a-96d5-50a26a805943 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:42.318314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cdd9744-2dc0-456a-96d5-50a26a805943 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:42.319072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cdd9744-2dc0-456a-96d5-50a26a805943 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:42.319509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cdd9744-2dc0-456a-96d5-50a26a805943 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:42.348761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7cdd9744-2dc0-456a-96d5-50a26a805943 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042987 Jun 20 07:12:42.349312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 349/694] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:43.031297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3ca11ad4-1cb9-4ad3-a389-3b3c388984b1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:43.031914 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3ca11ad4-1cb9-4ad3-a389-3b3c388984b1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:43.038384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ca11ad4-1cb9-4ad3-a389-3b3c388984b1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:43.038831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ca11ad4-1cb9-4ad3-a389-3b3c388984b1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:43.039586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ca11ad4-1cb9-4ad3-a389-3b3c388984b1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:43.040017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ca11ad4-1cb9-4ad3-a389-3b3c388984b1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:43.099546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3ca11ad4-1cb9-4ad3-a389-3b3c388984b1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:43.106923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3ca11ad4-1cb9-4ad3-a389-3b3c388984b1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079461 Jun 20 07:12:43.107494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 346/695] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:43 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:43.360563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2fff723-076e-4cfc-87dd-f5e3518de4f8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:43.361435 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f2fff723-076e-4cfc-87dd-f5e3518de4f8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:43.367790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2fff723-076e-4cfc-87dd-f5e3518de4f8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:43.368263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2fff723-076e-4cfc-87dd-f5e3518de4f8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:43.369019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2fff723-076e-4cfc-87dd-f5e3518de4f8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:43.369964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2fff723-076e-4cfc-87dd-f5e3518de4f8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:43.398489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f2fff723-076e-4cfc-87dd-f5e3518de4f8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042058 Jun 20 07:12:43.399030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 350/696] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:43 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:44.122809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6f7f649e-c25b-4e79-a3ff-17d9b52dcce2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:44.123428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6f7f649e-c25b-4e79-a3ff-17d9b52dcce2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:44.129915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f7f649e-c25b-4e79-a3ff-17d9b52dcce2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:44.130364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f7f649e-c25b-4e79-a3ff-17d9b52dcce2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:44.131124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f7f649e-c25b-4e79-a3ff-17d9b52dcce2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:44.131567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f7f649e-c25b-4e79-a3ff-17d9b52dcce2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:44.196016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6f7f649e-c25b-4e79-a3ff-17d9b52dcce2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:44.203457 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6f7f649e-c25b-4e79-a3ff-17d9b52dcce2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.084650 Jun 20 07:12:44.204020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 347/697] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:44 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:44.410349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-502f709c-e980-47e4-bf07-7aedada56384 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:44.411307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-502f709c-e980-47e4-bf07-7aedada56384 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:44.418310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-502f709c-e980-47e4-bf07-7aedada56384 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:44.418761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-502f709c-e980-47e4-bf07-7aedada56384 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:44.419526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-502f709c-e980-47e4-bf07-7aedada56384 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:44.419965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-502f709c-e980-47e4-bf07-7aedada56384 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:44.448456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-502f709c-e980-47e4-bf07-7aedada56384 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042207 Jun 20 07:12:44.449013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 351/698] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:44 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:45.219934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f09a907c-c926-410e-939b-b8cf1ca68023 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:45.220571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f09a907c-c926-410e-939b-b8cf1ca68023 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:45.227367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f09a907c-c926-410e-939b-b8cf1ca68023 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:45.227807 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f09a907c-c926-410e-939b-b8cf1ca68023 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:45.228630 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f09a907c-c926-410e-939b-b8cf1ca68023 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:45.229062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f09a907c-c926-410e-939b-b8cf1ca68023 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:45.288701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f09a907c-c926-410e-939b-b8cf1ca68023 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:45.296171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f09a907c-c926-410e-939b-b8cf1ca68023 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080141 Jun 20 07:12:45.296726 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 348/699] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:45 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:45.459989 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff809c51-ba61-4630-b72d-5b0caf0a6569 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:45.460954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff809c51-ba61-4630-b72d-5b0caf0a6569 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:45.467949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff809c51-ba61-4630-b72d-5b0caf0a6569 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:45.468434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff809c51-ba61-4630-b72d-5b0caf0a6569 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:45.469183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff809c51-ba61-4630-b72d-5b0caf0a6569 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:45.469613 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff809c51-ba61-4630-b72d-5b0caf0a6569 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:45.497764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff809c51-ba61-4630-b72d-5b0caf0a6569 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041695 Jun 20 07:12:45.498240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 352/700] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:45 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:46.313281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-73199bde-d21f-40f9-8dec-052d97947175 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:46.313899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-73199bde-d21f-40f9-8dec-052d97947175 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:46.320498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73199bde-d21f-40f9-8dec-052d97947175 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:46.320959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73199bde-d21f-40f9-8dec-052d97947175 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:46.321720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73199bde-d21f-40f9-8dec-052d97947175 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:46.322772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73199bde-d21f-40f9-8dec-052d97947175 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:46.382375 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-73199bde-d21f-40f9-8dec-052d97947175 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:46.390576 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-73199bde-d21f-40f9-8dec-052d97947175 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081112 Jun 20 07:12:46.391142 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 349/701] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:46 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:46.508540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-af49174b-f248-4417-87af-2e2204575dc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:46.509464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-af49174b-f248-4417-87af-2e2204575dc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:46.517004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af49174b-f248-4417-87af-2e2204575dc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:46.517487 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af49174b-f248-4417-87af-2e2204575dc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:46.518248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af49174b-f248-4417-87af-2e2204575dc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:46.518686 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af49174b-f248-4417-87af-2e2204575dc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:46.546498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-af49174b-f248-4417-87af-2e2204575dc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041966 Jun 20 07:12:46.547041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 353/702] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:46 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:47.407431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2e43d74d-146c-4fe9-aa1b-9f50af6b0518 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:47.408038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2e43d74d-146c-4fe9-aa1b-9f50af6b0518 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:47.414728 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e43d74d-146c-4fe9-aa1b-9f50af6b0518 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:47.415175 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e43d74d-146c-4fe9-aa1b-9f50af6b0518 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:47.415925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e43d74d-146c-4fe9-aa1b-9f50af6b0518 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:47.416383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e43d74d-146c-4fe9-aa1b-9f50af6b0518 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:47.475806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2e43d74d-146c-4fe9-aa1b-9f50af6b0518 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:47.483295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2e43d74d-146c-4fe9-aa1b-9f50af6b0518 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079695 Jun 20 07:12:47.483855 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 350/703] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:47 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:47.557470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6214484c-b72c-417c-942e-90c11218c98c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:47.558389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6214484c-b72c-417c-942e-90c11218c98c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:47.564789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6214484c-b72c-417c-942e-90c11218c98c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:47.565239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6214484c-b72c-417c-942e-90c11218c98c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:47.565994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6214484c-b72c-417c-942e-90c11218c98c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:47.566427 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6214484c-b72c-417c-942e-90c11218c98c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:47.595363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6214484c-b72c-417c-942e-90c11218c98c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042051 Jun 20 07:12:47.595923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 354/704] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:47 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:48.499873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e211f63-6c03-43d1-898b-bec5d33b8b75 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:48.500509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e211f63-6c03-43d1-898b-bec5d33b8b75 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:48.506996 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e211f63-6c03-43d1-898b-bec5d33b8b75 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:48.507438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e211f63-6c03-43d1-898b-bec5d33b8b75 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:48.508224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e211f63-6c03-43d1-898b-bec5d33b8b75 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:48.508660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e211f63-6c03-43d1-898b-bec5d33b8b75 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:48.571604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6e211f63-6c03-43d1-898b-bec5d33b8b75 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:48.579107 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e211f63-6c03-43d1-898b-bec5d33b8b75 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.083108 Jun 20 07:12:48.579670 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 351/705] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:48 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:48.607387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-606a3f5f-7c02-4561-9fb0-1202a5706789 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:48.608370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-606a3f5f-7c02-4561-9fb0-1202a5706789 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:48.614770 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-606a3f5f-7c02-4561-9fb0-1202a5706789 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:48.615233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-606a3f5f-7c02-4561-9fb0-1202a5706789 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:48.615991 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-606a3f5f-7c02-4561-9fb0-1202a5706789 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:48.616459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-606a3f5f-7c02-4561-9fb0-1202a5706789 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:48.644273 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-606a3f5f-7c02-4561-9fb0-1202a5706789 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041443 Jun 20 07:12:48.644825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 355/706] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:48 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:49.596206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f22a5565-0c51-43cd-ae90-6a4016664913 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:49.596815 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f22a5565-0c51-43cd-ae90-6a4016664913 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:49.603881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f22a5565-0c51-43cd-ae90-6a4016664913 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:49.604366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f22a5565-0c51-43cd-ae90-6a4016664913 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:49.605123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f22a5565-0c51-43cd-ae90-6a4016664913 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:49.605558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f22a5565-0c51-43cd-ae90-6a4016664913 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:49.655971 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c80e1f3a-c07f-48ba-80cd-c17133ae3df2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:49.657109 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c80e1f3a-c07f-48ba-80cd-c17133ae3df2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:49.663093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c80e1f3a-c07f-48ba-80cd-c17133ae3df2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:49.663765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c80e1f3a-c07f-48ba-80cd-c17133ae3df2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:49.664449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c80e1f3a-c07f-48ba-80cd-c17133ae3df2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:49.664888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c80e1f3a-c07f-48ba-80cd-c17133ae3df2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:49.666314 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f22a5565-0c51-43cd-ae90-6a4016664913 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:49.673708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f22a5565-0c51-43cd-ae90-6a4016664913 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081391 Jun 20 07:12:49.674277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 352/707] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:49 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:49.694607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c80e1f3a-c07f-48ba-80cd-c17133ae3df2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042690 Jun 20 07:12:49.695162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 356/708] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:49 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:12:50.690541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3edf1865-67dd-4b8a-b594-1cf8a8774d2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:50.691599 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3edf1865-67dd-4b8a-b594-1cf8a8774d2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:50.698119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3edf1865-67dd-4b8a-b594-1cf8a8774d2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:50.698557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3edf1865-67dd-4b8a-b594-1cf8a8774d2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:50.699302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3edf1865-67dd-4b8a-b594-1cf8a8774d2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:50.699732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3edf1865-67dd-4b8a-b594-1cf8a8774d2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:50.704884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:12:50.706221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31fc84b6-10b5-4b76-80a3-0157df4c01e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:50.707168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-31fc84b6-10b5-4b76-80a3-0157df4c01e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:50.714993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31fc84b6-10b5-4b76-80a3-0157df4c01e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:50.715448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31fc84b6-10b5-4b76-80a3-0157df4c01e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:50.716253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31fc84b6-10b5-4b76-80a3-0157df4c01e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:50.716692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31fc84b6-10b5-4b76-80a3-0157df4c01e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:50.720416 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:12:50.746447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-31fc84b6-10b5-4b76-80a3-0157df4c01e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044091 Jun 20 07:12:50.747022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 357/709] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:50 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:12:50.763925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3edf1865-67dd-4b8a-b594-1cf8a8774d2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:50.771615 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3edf1865-67dd-4b8a-b594-1cf8a8774d2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.084910 Jun 20 07:12:50.772183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 353/710] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:50 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:51.758367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-434c8021-12de-40db-aa7e-aba4d57a77d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:51.759312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-434c8021-12de-40db-aa7e-aba4d57a77d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:51.765733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-434c8021-12de-40db-aa7e-aba4d57a77d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:51.766173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-434c8021-12de-40db-aa7e-aba4d57a77d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:51.767188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-434c8021-12de-40db-aa7e-aba4d57a77d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:51.767617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-434c8021-12de-40db-aa7e-aba4d57a77d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:51.788642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-527b3f8a-f2f8-4b90-81a5-74ace24794b5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:51.789256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-527b3f8a-f2f8-4b90-81a5-74ace24794b5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:51.796132 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-527b3f8a-f2f8-4b90-81a5-74ace24794b5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:51.796727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-434c8021-12de-40db-aa7e-aba4d57a77d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042176 Jun 20 07:12:51.796862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-527b3f8a-f2f8-4b90-81a5-74ace24794b5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:51.797116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 358/711] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:51 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:12:51.797341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-527b3f8a-f2f8-4b90-81a5-74ace24794b5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:51.797774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-527b3f8a-f2f8-4b90-81a5-74ace24794b5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:51.859648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-527b3f8a-f2f8-4b90-81a5-74ace24794b5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:51.866982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-527b3f8a-f2f8-4b90-81a5-74ace24794b5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082243 Jun 20 07:12:51.867541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 354/712] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:51 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:12:52.808197 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b05cacf3-0b99-41bf-a00c-17ce4031a2a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:52.809119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b05cacf3-0b99-41bf-a00c-17ce4031a2a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:52.815547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b05cacf3-0b99-41bf-a00c-17ce4031a2a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:52.815994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b05cacf3-0b99-41bf-a00c-17ce4031a2a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:52.816781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b05cacf3-0b99-41bf-a00c-17ce4031a2a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:52.817218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b05cacf3-0b99-41bf-a00c-17ce4031a2a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:52.845149 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b05cacf3-0b99-41bf-a00c-17ce4031a2a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041600 Jun 20 07:12:52.845690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 359/713] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:52 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:52.882589 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9dfd8f16-4567-4060-a3ed-167e87c32c58 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:52.883194 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9dfd8f16-4567-4060-a3ed-167e87c32c58 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:52.890044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9dfd8f16-4567-4060-a3ed-167e87c32c58 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:52.890486 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9dfd8f16-4567-4060-a3ed-167e87c32c58 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:52.891242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9dfd8f16-4567-4060-a3ed-167e87c32c58 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:52.891945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9dfd8f16-4567-4060-a3ed-167e87c32c58 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:52.955951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9dfd8f16-4567-4060-a3ed-167e87c32c58 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:52.963885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9dfd8f16-4567-4060-a3ed-167e87c32c58 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.084539 Jun 20 07:12:52.964405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 355/714] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:52 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:53.857159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-25801156-e851-49f4-8e98-026923bc8447 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:53.858099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-25801156-e851-49f4-8e98-026923bc8447 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:53.860372 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=48 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:12:53.865865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25801156-e851-49f4-8e98-026923bc8447 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:53.866307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25801156-e851-49f4-8e98-026923bc8447 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:53.867062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25801156-e851-49f4-8e98-026923bc8447 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:53.867493 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25801156-e851-49f4-8e98-026923bc8447 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:53.898590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-25801156-e851-49f4-8e98-026923bc8447 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045357 Jun 20 07:12:53.899153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 360/715] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:53 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:53.980157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-339665ec-deb3-4f01-a86e-f6b9936ef1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:53.980696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-339665ec-deb3-4f01-a86e-f6b9936ef1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:53.987163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-339665ec-deb3-4f01-a86e-f6b9936ef1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:53.987614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-339665ec-deb3-4f01-a86e-f6b9936ef1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:53.988408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-339665ec-deb3-4f01-a86e-f6b9936ef1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:53.988850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-339665ec-deb3-4f01-a86e-f6b9936ef1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:54.048839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-339665ec-deb3-4f01-a86e-f6b9936ef1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:54.056231 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-339665ec-deb3-4f01-a86e-f6b9936ef1d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080046 Jun 20 07:12:54.056798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 356/716] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:53 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:54.909912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-899a7d16-4dd2-468c-a5f0-cf412ebb7f5c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:54.910831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-899a7d16-4dd2-468c-a5f0-cf412ebb7f5c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:54.921844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-899a7d16-4dd2-468c-a5f0-cf412ebb7f5c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:54.922294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-899a7d16-4dd2-468c-a5f0-cf412ebb7f5c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:54.923081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-899a7d16-4dd2-468c-a5f0-cf412ebb7f5c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:54.923525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-899a7d16-4dd2-468c-a5f0-cf412ebb7f5c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:54.952756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-899a7d16-4dd2-468c-a5f0-cf412ebb7f5c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046803 Jun 20 07:12:54.953310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 361/717] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:54 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:55.073558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e2258a0d-495c-4178-ac68-67055cb7e619 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:55.074173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e2258a0d-495c-4178-ac68-67055cb7e619 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:55.076475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:12:55.081655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2258a0d-495c-4178-ac68-67055cb7e619 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:55.082102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2258a0d-495c-4178-ac68-67055cb7e619 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:55.082862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2258a0d-495c-4178-ac68-67055cb7e619 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:55.083294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2258a0d-495c-4178-ac68-67055cb7e619 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:55.143539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e2258a0d-495c-4178-ac68-67055cb7e619 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:55.151448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e2258a0d-495c-4178-ac68-67055cb7e619 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081520 Jun 20 07:12:55.152006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 357/718] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:55 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:55.965083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e4b23369-abe4-49f7-9499-beb25c085f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:55.965929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e4b23369-abe4-49f7-9499-beb25c085f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:55.972386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4b23369-abe4-49f7-9499-beb25c085f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:55.972839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4b23369-abe4-49f7-9499-beb25c085f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:55.973599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4b23369-abe4-49f7-9499-beb25c085f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:55.974039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e4b23369-abe4-49f7-9499-beb25c085f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:56.002384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e4b23369-abe4-49f7-9499-beb25c085f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041963 Jun 20 07:12:56.002935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 362/719] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:55 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:56.168780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e3684125-3c62-4b61-978a-b3c13e830054 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:56.169397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e3684125-3c62-4b61-978a-b3c13e830054 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:56.175818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3684125-3c62-4b61-978a-b3c13e830054 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:56.176317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3684125-3c62-4b61-978a-b3c13e830054 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:56.177076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3684125-3c62-4b61-978a-b3c13e830054 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:56.177511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3684125-3c62-4b61-978a-b3c13e830054 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:56.236454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e3684125-3c62-4b61-978a-b3c13e830054 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:56.243835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e3684125-3c62-4b61-978a-b3c13e830054 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079528 Jun 20 07:12:56.244464 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 358/720] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:56 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:57.014579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d4825e1e-ad18-41d1-a221-0fd5955ae8bd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:57.015529 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d4825e1e-ad18-41d1-a221-0fd5955ae8bd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:57.022269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4825e1e-ad18-41d1-a221-0fd5955ae8bd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:57.022721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4825e1e-ad18-41d1-a221-0fd5955ae8bd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:57.023484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4825e1e-ad18-41d1-a221-0fd5955ae8bd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:57.023923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4825e1e-ad18-41d1-a221-0fd5955ae8bd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:57.051590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d4825e1e-ad18-41d1-a221-0fd5955ae8bd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041625 Jun 20 07:12:57.052150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 363/721] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:57 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:57.260364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ccabb5a3-a203-448a-9ee9-41ac3c72ee77 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:57.260978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ccabb5a3-a203-448a-9ee9-41ac3c72ee77 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:57.267679 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccabb5a3-a203-448a-9ee9-41ac3c72ee77 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:57.268148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccabb5a3-a203-448a-9ee9-41ac3c72ee77 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:57.268908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccabb5a3-a203-448a-9ee9-41ac3c72ee77 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:57.269342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccabb5a3-a203-448a-9ee9-41ac3c72ee77 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:57.331857 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ccabb5a3-a203-448a-9ee9-41ac3c72ee77 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:57.339256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ccabb5a3-a203-448a-9ee9-41ac3c72ee77 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082820 Jun 20 07:12:57.339809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 359/722] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:57 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:58.062787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e42a24f2-c5a4-4737-aa65-8c4d6107b863 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:58.063704 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e42a24f2-c5a4-4737-aa65-8c4d6107b863 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:58.070065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e42a24f2-c5a4-4737-aa65-8c4d6107b863 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:58.070512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e42a24f2-c5a4-4737-aa65-8c4d6107b863 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:58.071259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e42a24f2-c5a4-4737-aa65-8c4d6107b863 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:58.071690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e42a24f2-c5a4-4737-aa65-8c4d6107b863 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:58.100328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e42a24f2-c5a4-4737-aa65-8c4d6107b863 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041497 Jun 20 07:12:58.100868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 364/723] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:58 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:58.355103 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c56399f0-3aeb-4d49-988e-949f4a94e177 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:58.355636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c56399f0-3aeb-4d49-988e-949f4a94e177 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:58.362242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c56399f0-3aeb-4d49-988e-949f4a94e177 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:58.362678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c56399f0-3aeb-4d49-988e-949f4a94e177 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:58.363435 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c56399f0-3aeb-4d49-988e-949f4a94e177 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:58.363873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c56399f0-3aeb-4d49-988e-949f4a94e177 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:58.423606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c56399f0-3aeb-4d49-988e-949f4a94e177 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:58.431015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c56399f0-3aeb-4d49-988e-949f4a94e177 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079850 Jun 20 07:12:58.431581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 360/724] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:58 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:12:59.111795 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6e035513-c97e-4de8-9727-5175d9b67081 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:59.112749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6e035513-c97e-4de8-9727-5175d9b67081 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:59.119294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e035513-c97e-4de8-9727-5175d9b67081 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:59.119744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e035513-c97e-4de8-9727-5175d9b67081 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:59.120566 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e035513-c97e-4de8-9727-5175d9b67081 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:59.121005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e035513-c97e-4de8-9727-5175d9b67081 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:59.149167 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6e035513-c97e-4de8-9727-5175d9b67081 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041409 Jun 20 07:12:59.149713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 365/725] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:12:59 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:12:59.448922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8e4e69da-ab90-43d7-8048-af70ce35b6bf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:12:59.449437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8e4e69da-ab90-43d7-8048-af70ce35b6bf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:12:59.455817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e4e69da-ab90-43d7-8048-af70ce35b6bf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:59.456307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e4e69da-ab90-43d7-8048-af70ce35b6bf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:59.457070 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e4e69da-ab90-43d7-8048-af70ce35b6bf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:12:59.457503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e4e69da-ab90-43d7-8048-af70ce35b6bf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:12:59.518682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8e4e69da-ab90-43d7-8048-af70ce35b6bf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:12:59.527019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8e4e69da-ab90-43d7-8048-af70ce35b6bf tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082642 Jun 20 07:12:59.527590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 361/726] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:12:59 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:00.161347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-67e28dc8-61db-4520-9817-eefd934e6855 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:00.162269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-67e28dc8-61db-4520-9817-eefd934e6855 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:00.169216 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67e28dc8-61db-4520-9817-eefd934e6855 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:00.169671 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67e28dc8-61db-4520-9817-eefd934e6855 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:00.170463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67e28dc8-61db-4520-9817-eefd934e6855 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:00.170901 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67e28dc8-61db-4520-9817-eefd934e6855 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:00.199467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-67e28dc8-61db-4520-9817-eefd934e6855 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042171 Jun 20 07:13:00.200015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 366/727] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:00 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:00.545680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-99d11f35-c49a-4c07-8b40-fc0e7eb2f03a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:00.546331 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-99d11f35-c49a-4c07-8b40-fc0e7eb2f03a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:00.552860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99d11f35-c49a-4c07-8b40-fc0e7eb2f03a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:00.553312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99d11f35-c49a-4c07-8b40-fc0e7eb2f03a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:00.554167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99d11f35-c49a-4c07-8b40-fc0e7eb2f03a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:00.554701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-99d11f35-c49a-4c07-8b40-fc0e7eb2f03a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:00.618503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-99d11f35-c49a-4c07-8b40-fc0e7eb2f03a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:00.626024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-99d11f35-c49a-4c07-8b40-fc0e7eb2f03a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.084821 Jun 20 07:13:00.626590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 362/728] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:00 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:01.210976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-83ca2540-c094-4d92-bcc0-0cdbc27d4746 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:01.211932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-83ca2540-c094-4d92-bcc0-0cdbc27d4746 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:01.218417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83ca2540-c094-4d92-bcc0-0cdbc27d4746 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:01.218868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83ca2540-c094-4d92-bcc0-0cdbc27d4746 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:01.219625 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83ca2540-c094-4d92-bcc0-0cdbc27d4746 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:01.220060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83ca2540-c094-4d92-bcc0-0cdbc27d4746 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:01.248221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-83ca2540-c094-4d92-bcc0-0cdbc27d4746 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041221 Jun 20 07:13:01.248768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 367/729] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:01 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:01.643184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b9808c17-9610-4e76-82f0-d885d39a9d94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:01.644018 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b9808c17-9610-4e76-82f0-d885d39a9d94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:01.650823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9808c17-9610-4e76-82f0-d885d39a9d94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:01.651355 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9808c17-9610-4e76-82f0-d885d39a9d94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:01.652267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9808c17-9610-4e76-82f0-d885d39a9d94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:01.652705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9808c17-9610-4e76-82f0-d885d39a9d94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:01.716540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b9808c17-9610-4e76-82f0-d885d39a9d94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:01.724139 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b9808c17-9610-4e76-82f0-d885d39a9d94 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.085208 Jun 20 07:13:01.724686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 363/730] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:01 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:02.259080 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-38ab2d3f-4c20-46b0-9a46-83c673239f49 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:02.260013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-38ab2d3f-4c20-46b0-9a46-83c673239f49 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:02.266830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38ab2d3f-4c20-46b0-9a46-83c673239f49 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:02.267204 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38ab2d3f-4c20-46b0-9a46-83c673239f49 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:02.267950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38ab2d3f-4c20-46b0-9a46-83c673239f49 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:02.268428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38ab2d3f-4c20-46b0-9a46-83c673239f49 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:02.302150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-38ab2d3f-4c20-46b0-9a46-83c673239f49 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046925 Jun 20 07:13:02.305994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 368/731] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:02 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:02.741196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-88230a8e-78b6-42e3-b5f0-f07dbb386db5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:02.742233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-88230a8e-78b6-42e3-b5f0-f07dbb386db5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:02.748810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88230a8e-78b6-42e3-b5f0-f07dbb386db5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:02.749257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88230a8e-78b6-42e3-b5f0-f07dbb386db5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:02.750012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88230a8e-78b6-42e3-b5f0-f07dbb386db5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:02.750449 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88230a8e-78b6-42e3-b5f0-f07dbb386db5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:02.835570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-88230a8e-78b6-42e3-b5f0-f07dbb386db5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:02.843011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-88230a8e-78b6-42e3-b5f0-f07dbb386db5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.105779 Jun 20 07:13:02.843587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 364/732] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:02 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:03.314121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a7a305b4-d9de-4eef-be78-3c1ea2eec92c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:03.315051 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a7a305b4-d9de-4eef-be78-3c1ea2eec92c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:03.321520 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7a305b4-d9de-4eef-be78-3c1ea2eec92c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:03.321999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7a305b4-d9de-4eef-be78-3c1ea2eec92c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:03.322776 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7a305b4-d9de-4eef-be78-3c1ea2eec92c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:03.323213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7a305b4-d9de-4eef-be78-3c1ea2eec92c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:03.351074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a7a305b4-d9de-4eef-be78-3c1ea2eec92c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041000 Jun 20 07:13:03.351622 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 369/733] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:03 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:03.858588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3beac49e-6fdc-4b84-9572-7914e35e73e7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:03.859197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3beac49e-6fdc-4b84-9572-7914e35e73e7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:03.865631 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3beac49e-6fdc-4b84-9572-7914e35e73e7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:03.866076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3beac49e-6fdc-4b84-9572-7914e35e73e7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:03.866827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3beac49e-6fdc-4b84-9572-7914e35e73e7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:03.867262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3beac49e-6fdc-4b84-9572-7914e35e73e7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:03.928049 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3beac49e-6fdc-4b84-9572-7914e35e73e7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:03.935438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3beac49e-6fdc-4b84-9572-7914e35e73e7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080686 Jun 20 07:13:03.936006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 365/734] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:03 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:04.363152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b1436032-83f5-438b-8d29-3f4444142a6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:04.364070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b1436032-83f5-438b-8d29-3f4444142a6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:04.371008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1436032-83f5-438b-8d29-3f4444142a6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:04.371458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1436032-83f5-438b-8d29-3f4444142a6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:04.372351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1436032-83f5-438b-8d29-3f4444142a6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:04.372817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1436032-83f5-438b-8d29-3f4444142a6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:04.401327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b1436032-83f5-438b-8d29-3f4444142a6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042007 Jun 20 07:13:04.401872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 370/735] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:04 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:04.951911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d9ed2037-720e-4990-bdd6-e6aaffc8f4e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:04.952552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d9ed2037-720e-4990-bdd6-e6aaffc8f4e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:04.958734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9ed2037-720e-4990-bdd6-e6aaffc8f4e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:04.959129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9ed2037-720e-4990-bdd6-e6aaffc8f4e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:04.959881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9ed2037-720e-4990-bdd6-e6aaffc8f4e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:04.960343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9ed2037-720e-4990-bdd6-e6aaffc8f4e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:05.022952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9ed2037-720e-4990-bdd6-e6aaffc8f4e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:05.030814 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d9ed2037-720e-4990-bdd6-e6aaffc8f4e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082767 Jun 20 07:13:05.031376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 366/736] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:04 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:05.413079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2e52456e-4115-4c19-a0d1-f94b0784a20d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:05.414004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2e52456e-4115-4c19-a0d1-f94b0784a20d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:05.420992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e52456e-4115-4c19-a0d1-f94b0784a20d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:05.421447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e52456e-4115-4c19-a0d1-f94b0784a20d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:05.422210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e52456e-4115-4c19-a0d1-f94b0784a20d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:05.422658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e52456e-4115-4c19-a0d1-f94b0784a20d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:05.451181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2e52456e-4115-4c19-a0d1-f94b0784a20d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042108 Jun 20 07:13:05.451727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 371/737] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:05 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:06.047809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-813bed69-3d33-427d-b146-8f29dc69fc8f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:06.048483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-813bed69-3d33-427d-b146-8f29dc69fc8f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:06.054950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-813bed69-3d33-427d-b146-8f29dc69fc8f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:06.055499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-813bed69-3d33-427d-b146-8f29dc69fc8f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:06.056296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-813bed69-3d33-427d-b146-8f29dc69fc8f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:06.056763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-813bed69-3d33-427d-b146-8f29dc69fc8f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:06.116518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-813bed69-3d33-427d-b146-8f29dc69fc8f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:06.123923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-813bed69-3d33-427d-b146-8f29dc69fc8f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079977 Jun 20 07:13:06.124524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 367/738] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:06 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:06.462986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-718fe22c-3aff-46c0-9adb-3a283629d635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:06.463941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-718fe22c-3aff-46c0-9adb-3a283629d635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:06.470382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-718fe22c-3aff-46c0-9adb-3a283629d635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:06.470834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-718fe22c-3aff-46c0-9adb-3a283629d635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:06.471602 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-718fe22c-3aff-46c0-9adb-3a283629d635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:06.472182 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-718fe22c-3aff-46c0-9adb-3a283629d635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:06.502149 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-718fe22c-3aff-46c0-9adb-3a283629d635 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043336 Jun 20 07:13:06.502936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 372/739] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:06 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:07.140768 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5d7bdcf9-197c-4476-beda-2ca2ce8403a4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:07.141382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5d7bdcf9-197c-4476-beda-2ca2ce8403a4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:07.148153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d7bdcf9-197c-4476-beda-2ca2ce8403a4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:07.148606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d7bdcf9-197c-4476-beda-2ca2ce8403a4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:07.149367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d7bdcf9-197c-4476-beda-2ca2ce8403a4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:07.149802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d7bdcf9-197c-4476-beda-2ca2ce8403a4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:07.212012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5d7bdcf9-197c-4476-beda-2ca2ce8403a4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:07.219963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5d7bdcf9-197c-4476-beda-2ca2ce8403a4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.083063 Jun 20 07:13:07.220564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 368/740] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:07 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:07.513979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3be6dbb1-2339-452d-a640-1a8d74d02a5b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:07.514930 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3be6dbb1-2339-452d-a640-1a8d74d02a5b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:07.521596 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3be6dbb1-2339-452d-a640-1a8d74d02a5b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:07.522043 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3be6dbb1-2339-452d-a640-1a8d74d02a5b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:07.522798 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3be6dbb1-2339-452d-a640-1a8d74d02a5b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:07.523234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3be6dbb1-2339-452d-a640-1a8d74d02a5b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:07.546724 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:13:07.551591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3be6dbb1-2339-452d-a640-1a8d74d02a5b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042231 Jun 20 07:13:07.552226 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 373/741] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:07 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:08.236311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-55e70607-bcda-487d-a104-246f34388845 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:08.236833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-55e70607-bcda-487d-a104-246f34388845 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:08.243260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55e70607-bcda-487d-a104-246f34388845 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:08.243709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55e70607-bcda-487d-a104-246f34388845 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:08.244492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55e70607-bcda-487d-a104-246f34388845 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:08.244924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-55e70607-bcda-487d-a104-246f34388845 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:08.304557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-55e70607-bcda-487d-a104-246f34388845 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:08.308652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:13:08.315229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-55e70607-bcda-487d-a104-246f34388845 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082827 Jun 20 07:13:08.315805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 369/742] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:08 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:08.563177 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b4f6f3bf-1e6b-4b71-8ac5-042eda75dfc8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:08.564096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b4f6f3bf-1e6b-4b71-8ac5-042eda75dfc8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:08.570698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4f6f3bf-1e6b-4b71-8ac5-042eda75dfc8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:08.571144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4f6f3bf-1e6b-4b71-8ac5-042eda75dfc8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:08.571897 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4f6f3bf-1e6b-4b71-8ac5-042eda75dfc8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:08.572865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4f6f3bf-1e6b-4b71-8ac5-042eda75dfc8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:08.601193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b4f6f3bf-1e6b-4b71-8ac5-042eda75dfc8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041982 Jun 20 07:13:08.601749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 374/743] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:08 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:09.332051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c6020529-1f77-408c-8e64-e0970e106460 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:09.332709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c6020529-1f77-408c-8e64-e0970e106460 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:09.339693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6020529-1f77-408c-8e64-e0970e106460 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:09.340161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6020529-1f77-408c-8e64-e0970e106460 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:09.340913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6020529-1f77-408c-8e64-e0970e106460 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:09.341340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6020529-1f77-408c-8e64-e0970e106460 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:09.404785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c6020529-1f77-408c-8e64-e0970e106460 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:09.412099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c6020529-1f77-408c-8e64-e0970e106460 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.084110 Jun 20 07:13:09.412681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 370/744] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:09 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:09.613419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8ad88a1b-e474-4bf9-96ed-14fd504a111a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:09.614254 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8ad88a1b-e474-4bf9-96ed-14fd504a111a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:09.621705 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ad88a1b-e474-4bf9-96ed-14fd504a111a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:09.622181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ad88a1b-e474-4bf9-96ed-14fd504a111a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:09.623477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ad88a1b-e474-4bf9-96ed-14fd504a111a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:09.624241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ad88a1b-e474-4bf9-96ed-14fd504a111a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:09.656470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8ad88a1b-e474-4bf9-96ed-14fd504a111a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047052 Jun 20 07:13:09.657025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 375/745] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:09 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:10.428588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-460fc83b-3612-46d4-85b2-861e4590a363 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:10.429195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-460fc83b-3612-46d4-85b2-861e4590a363 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:10.436184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-460fc83b-3612-46d4-85b2-861e4590a363 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:10.436633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-460fc83b-3612-46d4-85b2-861e4590a363 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:10.437389 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-460fc83b-3612-46d4-85b2-861e4590a363 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:10.437821 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-460fc83b-3612-46d4-85b2-861e4590a363 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:10.497141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-460fc83b-3612-46d4-85b2-861e4590a363 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:10.504496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-460fc83b-3612-46d4-85b2-861e4590a363 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079743 Jun 20 07:13:10.505066 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 371/746] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:10 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:10.668837 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-84da13ac-b8ef-41ca-9d3b-2bc0600271ee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:10.669758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-84da13ac-b8ef-41ca-9d3b-2bc0600271ee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:10.676056 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84da13ac-b8ef-41ca-9d3b-2bc0600271ee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:10.676525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84da13ac-b8ef-41ca-9d3b-2bc0600271ee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:10.677268 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84da13ac-b8ef-41ca-9d3b-2bc0600271ee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:10.677709 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84da13ac-b8ef-41ca-9d3b-2bc0600271ee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:10.706520 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-84da13ac-b8ef-41ca-9d3b-2bc0600271ee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042092 Jun 20 07:13:10.707000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 376/747] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:10 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:11.521843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea182630-4d94-4343-8e33-b88b595342e3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:11.522462 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ea182630-4d94-4343-8e33-b88b595342e3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:11.529575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea182630-4d94-4343-8e33-b88b595342e3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:11.530030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea182630-4d94-4343-8e33-b88b595342e3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:11.530797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea182630-4d94-4343-8e33-b88b595342e3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:11.531236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea182630-4d94-4343-8e33-b88b595342e3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:11.590636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea182630-4d94-4343-8e33-b88b595342e3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:11.598029 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea182630-4d94-4343-8e33-b88b595342e3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080013 Jun 20 07:13:11.598593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 372/748] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:11 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:11.717369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0c5cde8e-e60f-4cc2-ad5f-a2ec58dcef3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:11.718327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0c5cde8e-e60f-4cc2-ad5f-a2ec58dcef3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:11.724849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c5cde8e-e60f-4cc2-ad5f-a2ec58dcef3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:11.725303 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c5cde8e-e60f-4cc2-ad5f-a2ec58dcef3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:11.726064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c5cde8e-e60f-4cc2-ad5f-a2ec58dcef3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:11.726505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c5cde8e-e60f-4cc2-ad5f-a2ec58dcef3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:11.754733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0c5cde8e-e60f-4cc2-ad5f-a2ec58dcef3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041347 Jun 20 07:13:11.755283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 377/749] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:11 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:12.614710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e509ebf-15be-4683-9c69-4716caeeabd9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:12.615267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e509ebf-15be-4683-9c69-4716caeeabd9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:12.621737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e509ebf-15be-4683-9c69-4716caeeabd9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:12.622178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e509ebf-15be-4683-9c69-4716caeeabd9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:12.622925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e509ebf-15be-4683-9c69-4716caeeabd9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:12.623351 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e509ebf-15be-4683-9c69-4716caeeabd9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:12.682584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e509ebf-15be-4683-9c69-4716caeeabd9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:12.689992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e509ebf-15be-4683-9c69-4716caeeabd9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079165 Jun 20 07:13:12.690551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 373/750] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:12 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:12.766427 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-37bb48de-d2f6-4916-a2af-a458bfa76069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:12.767606 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-37bb48de-d2f6-4916-a2af-a458bfa76069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:12.774101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37bb48de-d2f6-4916-a2af-a458bfa76069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:12.774556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37bb48de-d2f6-4916-a2af-a458bfa76069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:12.775814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37bb48de-d2f6-4916-a2af-a458bfa76069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:12.776298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37bb48de-d2f6-4916-a2af-a458bfa76069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:12.804913 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-37bb48de-d2f6-4916-a2af-a458bfa76069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042500 Jun 20 07:13:12.805458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 378/751] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:12 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:13.706637 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0841231d-a6de-416b-882c-3eb199ecf4af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:13.707252 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0841231d-a6de-416b-882c-3eb199ecf4af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:13.713808 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0841231d-a6de-416b-882c-3eb199ecf4af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:13.714256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0841231d-a6de-416b-882c-3eb199ecf4af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:13.715019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0841231d-a6de-416b-882c-3eb199ecf4af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:13.715463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0841231d-a6de-416b-882c-3eb199ecf4af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:13.780258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0841231d-a6de-416b-882c-3eb199ecf4af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:13.787639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0841231d-a6de-416b-882c-3eb199ecf4af tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.084902 Jun 20 07:13:13.788245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 374/752] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:13 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:13.816494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0f292056-cbe7-4294-8846-0ff7512839de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:13.817428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0f292056-cbe7-4294-8846-0ff7512839de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:13.824503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f292056-cbe7-4294-8846-0ff7512839de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:13.824503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f292056-cbe7-4294-8846-0ff7512839de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:13.825201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f292056-cbe7-4294-8846-0ff7512839de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:13.825639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f292056-cbe7-4294-8846-0ff7512839de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:13.854387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0f292056-cbe7-4294-8846-0ff7512839de tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041834 Jun 20 07:13:13.854916 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 379/753] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:13 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:14.804683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6d347455-f3f1-4a3c-abe5-c5b849197761 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:14.805300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6d347455-f3f1-4a3c-abe5-c5b849197761 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:14.811826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d347455-f3f1-4a3c-abe5-c5b849197761 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:14.812312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d347455-f3f1-4a3c-abe5-c5b849197761 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:14.813076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d347455-f3f1-4a3c-abe5-c5b849197761 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:14.813516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d347455-f3f1-4a3c-abe5-c5b849197761 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:14.866133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7556e2bf-8fca-4d38-8d3c-b6430d632cb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:14.867057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7556e2bf-8fca-4d38-8d3c-b6430d632cb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:14.873307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6d347455-f3f1-4a3c-abe5-c5b849197761 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:14.873525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7556e2bf-8fca-4d38-8d3c-b6430d632cb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:14.873983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7556e2bf-8fca-4d38-8d3c-b6430d632cb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:14.874753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7556e2bf-8fca-4d38-8d3c-b6430d632cb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:14.875193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7556e2bf-8fca-4d38-8d3c-b6430d632cb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:14.880961 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6d347455-f3f1-4a3c-abe5-c5b849197761 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080113 Jun 20 07:13:14.881724 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 375/754] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:14 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:14.904296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7556e2bf-8fca-4d38-8d3c-b6430d632cb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042122 Jun 20 07:13:14.904839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 380/755] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:14 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:15.897872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1be6bc84-885a-438d-bb73-186fad5662c8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:15.898487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1be6bc84-885a-438d-bb73-186fad5662c8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:15.905504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1be6bc84-885a-438d-bb73-186fad5662c8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:15.905952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1be6bc84-885a-438d-bb73-186fad5662c8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:15.906715 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1be6bc84-885a-438d-bb73-186fad5662c8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:15.907155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1be6bc84-885a-438d-bb73-186fad5662c8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:15.915482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f75e5813-180e-4b50-902f-2017433267a6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:15.916428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f75e5813-180e-4b50-902f-2017433267a6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:15.922774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f75e5813-180e-4b50-902f-2017433267a6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:15.923224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f75e5813-180e-4b50-902f-2017433267a6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:15.923988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f75e5813-180e-4b50-902f-2017433267a6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:15.924463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f75e5813-180e-4b50-902f-2017433267a6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:15.953592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f75e5813-180e-4b50-902f-2017433267a6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042069 Jun 20 07:13:15.957690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 381/756] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:15 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:15.967755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1be6bc84-885a-438d-bb73-186fad5662c8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:15.975271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1be6bc84-885a-438d-bb73-186fad5662c8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081223 Jun 20 07:13:15.975856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 376/757] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:15 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:16.965025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-80b1f80a-773b-4b06-ab04-d49233e7caa6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:16.965869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-80b1f80a-773b-4b06-ab04-d49233e7caa6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:16.972379 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80b1f80a-773b-4b06-ab04-d49233e7caa6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:16.972838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80b1f80a-773b-4b06-ab04-d49233e7caa6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:16.973603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80b1f80a-773b-4b06-ab04-d49233e7caa6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:16.974041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80b1f80a-773b-4b06-ab04-d49233e7caa6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:16.991004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-148f91f2-4ba9-47ae-96bf-710f839501e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:16.991611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-148f91f2-4ba9-47ae-96bf-710f839501e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:16.999034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-148f91f2-4ba9-47ae-96bf-710f839501e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:16.999034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-148f91f2-4ba9-47ae-96bf-710f839501e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:16.999794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-148f91f2-4ba9-47ae-96bf-710f839501e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:17.000250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-148f91f2-4ba9-47ae-96bf-710f839501e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:17.003142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-80b1f80a-773b-4b06-ab04-d49233e7caa6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042138 Jun 20 07:13:17.003889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 382/758] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:16 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:17.060028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-148f91f2-4ba9-47ae-96bf-710f839501e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:17.067393 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-148f91f2-4ba9-47ae-96bf-710f839501e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080217 Jun 20 07:13:17.067963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 377/759] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:16 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:18.015437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c83beae0-f789-4aea-bf12-df7f7e7e0c77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:18.016384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c83beae0-f789-4aea-bf12-df7f7e7e0c77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:18.023025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c83beae0-f789-4aea-bf12-df7f7e7e0c77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:18.023476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c83beae0-f789-4aea-bf12-df7f7e7e0c77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:18.024266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c83beae0-f789-4aea-bf12-df7f7e7e0c77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:18.024706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c83beae0-f789-4aea-bf12-df7f7e7e0c77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:18.052453 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c83beae0-f789-4aea-bf12-df7f7e7e0c77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040992 Jun 20 07:13:18.053030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 383/760] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:18 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:18.084491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e38367e6-5124-486c-b4b2-d6f05f3af468 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:18.085077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e38367e6-5124-486c-b4b2-d6f05f3af468 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:18.091518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e38367e6-5124-486c-b4b2-d6f05f3af468 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:18.091965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e38367e6-5124-486c-b4b2-d6f05f3af468 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:18.092762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e38367e6-5124-486c-b4b2-d6f05f3af468 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:18.093199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e38367e6-5124-486c-b4b2-d6f05f3af468 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:18.155379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e38367e6-5124-486c-b4b2-d6f05f3af468 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:18.162777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e38367e6-5124-486c-b4b2-d6f05f3af468 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082324 Jun 20 07:13:18.163338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 378/761] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:18 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:19.064740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-79b0164f-bb48-4dab-b02b-fa8dffe7fcf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:19.065660 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-79b0164f-bb48-4dab-b02b-fa8dffe7fcf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:19.072222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79b0164f-bb48-4dab-b02b-fa8dffe7fcf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:19.072677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79b0164f-bb48-4dab-b02b-fa8dffe7fcf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:19.073441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79b0164f-bb48-4dab-b02b-fa8dffe7fcf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:19.073878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79b0164f-bb48-4dab-b02b-fa8dffe7fcf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:19.102433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-79b0164f-bb48-4dab-b02b-fa8dffe7fcf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041794 Jun 20 07:13:19.103491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 384/762] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:19 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:19.180210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-88c5a9b6-49af-4e61-bf11-da8ec2ffa11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:19.180825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-88c5a9b6-49af-4e61-bf11-da8ec2ffa11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:19.187898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88c5a9b6-49af-4e61-bf11-da8ec2ffa11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:19.188406 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88c5a9b6-49af-4e61-bf11-da8ec2ffa11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:19.189165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88c5a9b6-49af-4e61-bf11-da8ec2ffa11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:19.189599 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-88c5a9b6-49af-4e61-bf11-da8ec2ffa11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:19.248663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-88c5a9b6-49af-4e61-bf11-da8ec2ffa11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:19.256641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-88c5a9b6-49af-4e61-bf11-da8ec2ffa11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080276 Jun 20 07:13:19.257247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 379/763] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:19 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:20.114809 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-533504da-2cd2-43a3-968a-6ec0307c67d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:20.115723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-533504da-2cd2-43a3-968a-6ec0307c67d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:20.121735 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-533504da-2cd2-43a3-968a-6ec0307c67d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:20.122181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-533504da-2cd2-43a3-968a-6ec0307c67d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:20.122927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-533504da-2cd2-43a3-968a-6ec0307c67d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:20.123355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-533504da-2cd2-43a3-968a-6ec0307c67d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:20.151597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-533504da-2cd2-43a3-968a-6ec0307c67d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040999 Jun 20 07:13:20.152148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 385/764] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:20 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:20.273683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7824c347-4d5b-4416-b08b-5b0380b4f0a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:20.274326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7824c347-4d5b-4416-b08b-5b0380b4f0a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:20.281554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7824c347-4d5b-4416-b08b-5b0380b4f0a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:20.282009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7824c347-4d5b-4416-b08b-5b0380b4f0a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:20.282770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7824c347-4d5b-4416-b08b-5b0380b4f0a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:20.283206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7824c347-4d5b-4416-b08b-5b0380b4f0a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:20.343478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7824c347-4d5b-4416-b08b-5b0380b4f0a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:20.350876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7824c347-4d5b-4416-b08b-5b0380b4f0a7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081024 Jun 20 07:13:20.351447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 380/765] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:20 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:21.163211 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8164ca25-bb18-4e24-ba4b-04f78c8dff85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:21.164176 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8164ca25-bb18-4e24-ba4b-04f78c8dff85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:21.171295 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8164ca25-bb18-4e24-ba4b-04f78c8dff85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:21.171739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8164ca25-bb18-4e24-ba4b-04f78c8dff85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:21.172557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8164ca25-bb18-4e24-ba4b-04f78c8dff85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:21.172996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8164ca25-bb18-4e24-ba4b-04f78c8dff85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:21.201507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8164ca25-bb18-4e24-ba4b-04f78c8dff85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042291 Jun 20 07:13:21.202047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 386/766] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:21 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:21.367257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b78c08f9-8fa7-48f5-b569-60b07d643c32 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:21.367860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b78c08f9-8fa7-48f5-b569-60b07d643c32 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:21.375007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b78c08f9-8fa7-48f5-b569-60b07d643c32 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:21.375455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b78c08f9-8fa7-48f5-b569-60b07d643c32 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:21.376243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b78c08f9-8fa7-48f5-b569-60b07d643c32 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:21.376678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b78c08f9-8fa7-48f5-b569-60b07d643c32 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:21.438092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b78c08f9-8fa7-48f5-b569-60b07d643c32 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:21.453310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b78c08f9-8fa7-48f5-b569-60b07d643c32 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.089950 Jun 20 07:13:21.453875 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 381/767] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:21 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:22.213153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d827a5f3-89df-46e0-a256-32d1f3bc7680 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:22.214112 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d827a5f3-89df-46e0-a256-32d1f3bc7680 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:22.220641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d827a5f3-89df-46e0-a256-32d1f3bc7680 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:22.221094 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d827a5f3-89df-46e0-a256-32d1f3bc7680 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:22.221852 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d827a5f3-89df-46e0-a256-32d1f3bc7680 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:22.222292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d827a5f3-89df-46e0-a256-32d1f3bc7680 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:22.250655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d827a5f3-89df-46e0-a256-32d1f3bc7680 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041516 Jun 20 07:13:22.251200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 387/768] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:22.470376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-789a0155-18ca-4100-a4f4-f7645fa3878d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:22.470937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-789a0155-18ca-4100-a4f4-f7645fa3878d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:22.477373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-789a0155-18ca-4100-a4f4-f7645fa3878d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:22.477821 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-789a0155-18ca-4100-a4f4-f7645fa3878d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:22.478588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-789a0155-18ca-4100-a4f4-f7645fa3878d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:22.479025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-789a0155-18ca-4100-a4f4-f7645fa3878d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:22.541284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-789a0155-18ca-4100-a4f4-f7645fa3878d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:22.550586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-789a0155-18ca-4100-a4f4-f7645fa3878d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.083842 Jun 20 07:13:22.551533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 382/769] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:22 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:23.262664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1158b680-2ecd-4823-945b-d6bf307f83bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:23.263577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1158b680-2ecd-4823-945b-d6bf307f83bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:23.270278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1158b680-2ecd-4823-945b-d6bf307f83bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:23.270720 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1158b680-2ecd-4823-945b-d6bf307f83bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:23.271461 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1158b680-2ecd-4823-945b-d6bf307f83bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:23.271888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1158b680-2ecd-4823-945b-d6bf307f83bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:23.300497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1158b680-2ecd-4823-945b-d6bf307f83bb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042017 Jun 20 07:13:23.301033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 388/770] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:23 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:23.570141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4235e402-e688-448f-8b40-2e3dd06fe11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:23.570703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4235e402-e688-448f-8b40-2e3dd06fe11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:23.577142 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4235e402-e688-448f-8b40-2e3dd06fe11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:23.577586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4235e402-e688-448f-8b40-2e3dd06fe11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:23.578343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4235e402-e688-448f-8b40-2e3dd06fe11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:23.578775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4235e402-e688-448f-8b40-2e3dd06fe11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:23.638157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4235e402-e688-448f-8b40-2e3dd06fe11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:23.645759 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4235e402-e688-448f-8b40-2e3dd06fe11d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079538 Jun 20 07:13:23.646317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 383/771] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:23 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:24.312725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d7b35693-37ec-4933-b5c3-67199a7c724c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:24.313637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d7b35693-37ec-4933-b5c3-67199a7c724c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:24.315892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=58 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:13:24.321193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7b35693-37ec-4933-b5c3-67199a7c724c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:24.321633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7b35693-37ec-4933-b5c3-67199a7c724c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:24.322382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7b35693-37ec-4933-b5c3-67199a7c724c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:24.322814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7b35693-37ec-4933-b5c3-67199a7c724c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:24.350422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d7b35693-37ec-4933-b5c3-67199a7c724c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041631 Jun 20 07:13:24.350963 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 389/772] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:24 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:24.662584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3842a83b-7efd-4e56-84e1-930090332817 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:24.663118 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3842a83b-7efd-4e56-84e1-930090332817 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:24.670312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3842a83b-7efd-4e56-84e1-930090332817 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:24.670763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3842a83b-7efd-4e56-84e1-930090332817 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:24.671537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3842a83b-7efd-4e56-84e1-930090332817 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:24.671974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3842a83b-7efd-4e56-84e1-930090332817 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:24.733174 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3842a83b-7efd-4e56-84e1-930090332817 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:24.740501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3842a83b-7efd-4e56-84e1-930090332817 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081836 Jun 20 07:13:24.741065 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 384/773] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:24 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:25.362729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-76c19e26-517a-47cc-82f4-5197ca360fc6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:25.363647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-76c19e26-517a-47cc-82f4-5197ca360fc6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:25.370143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76c19e26-517a-47cc-82f4-5197ca360fc6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:25.370597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76c19e26-517a-47cc-82f4-5197ca360fc6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:25.371351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76c19e26-517a-47cc-82f4-5197ca360fc6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:25.371784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76c19e26-517a-47cc-82f4-5197ca360fc6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:25.388007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:13:25.401682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-76c19e26-517a-47cc-82f4-5197ca360fc6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042944 Jun 20 07:13:25.402229 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 390/774] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:25 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:25.757106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5b64b32b-2029-4d3e-b181-f4ade332317b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:25.757727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5b64b32b-2029-4d3e-b181-f4ade332317b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:25.760566 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:13:25.765889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b64b32b-2029-4d3e-b181-f4ade332317b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:25.766339 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b64b32b-2029-4d3e-b181-f4ade332317b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:25.767356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b64b32b-2029-4d3e-b181-f4ade332317b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:25.767793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b64b32b-2029-4d3e-b181-f4ade332317b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:25.827470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5b64b32b-2029-4d3e-b181-f4ade332317b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:25.835284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5b64b32b-2029-4d3e-b181-f4ade332317b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081969 Jun 20 07:13:25.835859 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 385/775] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:25 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:26.413442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1eeb3737-52aa-401d-baf1-6cef44e649a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:26.414349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1eeb3737-52aa-401d-baf1-6cef44e649a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:26.420762 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1eeb3737-52aa-401d-baf1-6cef44e649a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:26.421207 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1eeb3737-52aa-401d-baf1-6cef44e649a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:26.421951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1eeb3737-52aa-401d-baf1-6cef44e649a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:26.422381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1eeb3737-52aa-401d-baf1-6cef44e649a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:26.450336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1eeb3737-52aa-401d-baf1-6cef44e649a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040861 Jun 20 07:13:26.450872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 391/776] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:26 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:26.852201 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4497a241-4071-4fc0-9bb9-afa95337b931 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:26.852815 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4497a241-4071-4fc0-9bb9-afa95337b931 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:26.859267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4497a241-4071-4fc0-9bb9-afa95337b931 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:26.859720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4497a241-4071-4fc0-9bb9-afa95337b931 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:26.860511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4497a241-4071-4fc0-9bb9-afa95337b931 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:26.860946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4497a241-4071-4fc0-9bb9-afa95337b931 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:26.878551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:13:26.924252 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4497a241-4071-4fc0-9bb9-afa95337b931 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:26.932230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4497a241-4071-4fc0-9bb9-afa95337b931 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.083884 Jun 20 07:13:26.932792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 386/777] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:26 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:27.462571 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-38924b77-dec2-438d-94a7-d058caf37e5d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:27.463491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-38924b77-dec2-438d-94a7-d058caf37e5d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:27.469908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38924b77-dec2-438d-94a7-d058caf37e5d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:27.470356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38924b77-dec2-438d-94a7-d058caf37e5d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:27.471114 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38924b77-dec2-438d-94a7-d058caf37e5d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:27.471545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-38924b77-dec2-438d-94a7-d058caf37e5d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:27.500008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-38924b77-dec2-438d-94a7-d058caf37e5d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041930 Jun 20 07:13:27.500598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 392/778] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:27 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:27.949288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b8714e5f-17ef-4be6-925c-211be1435b50 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:27.949901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b8714e5f-17ef-4be6-925c-211be1435b50 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:27.956380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8714e5f-17ef-4be6-925c-211be1435b50 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:27.956825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8714e5f-17ef-4be6-925c-211be1435b50 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:27.957582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8714e5f-17ef-4be6-925c-211be1435b50 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:27.958059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8714e5f-17ef-4be6-925c-211be1435b50 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:28.019625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b8714e5f-17ef-4be6-925c-211be1435b50 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:28.027674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b8714e5f-17ef-4be6-925c-211be1435b50 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082778 Jun 20 07:13:28.028269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 387/779] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:27 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:28.511819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-449ea065-d12d-44f8-9644-2718ed78baa5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:28.512895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-449ea065-d12d-44f8-9644-2718ed78baa5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:28.522540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-449ea065-d12d-44f8-9644-2718ed78baa5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:28.523349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-449ea065-d12d-44f8-9644-2718ed78baa5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:28.524725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-449ea065-d12d-44f8-9644-2718ed78baa5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:28.525532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-449ea065-d12d-44f8-9644-2718ed78baa5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:28.554311 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-449ea065-d12d-44f8-9644-2718ed78baa5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047150 Jun 20 07:13:28.554870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 393/780] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:28 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:29.044257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c3c38067-cff4-47d5-9e58-bd20a52f9a90 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:29.044871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c3c38067-cff4-47d5-9e58-bd20a52f9a90 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:29.051365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3c38067-cff4-47d5-9e58-bd20a52f9a90 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:29.051809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3c38067-cff4-47d5-9e58-bd20a52f9a90 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:29.052588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3c38067-cff4-47d5-9e58-bd20a52f9a90 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:29.053021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c3c38067-cff4-47d5-9e58-bd20a52f9a90 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:29.112332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c3c38067-cff4-47d5-9e58-bd20a52f9a90 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:29.119729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c3c38067-cff4-47d5-9e58-bd20a52f9a90 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079782 Jun 20 07:13:29.120336 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 388/781] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:29 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:29.566280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3d3de6c9-e8ca-4bb6-ad3d-ada043fd094f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:29.567207 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3d3de6c9-e8ca-4bb6-ad3d-ada043fd094f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:29.574199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d3de6c9-e8ca-4bb6-ad3d-ada043fd094f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:29.574651 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d3de6c9-e8ca-4bb6-ad3d-ada043fd094f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:29.575410 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d3de6c9-e8ca-4bb6-ad3d-ada043fd094f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:29.575846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d3de6c9-e8ca-4bb6-ad3d-ada043fd094f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:29.604234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3d3de6c9-e8ca-4bb6-ad3d-ada043fd094f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041915 Jun 20 07:13:29.604782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 394/782] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:29 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:30.136311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-36040f1c-bd84-46d7-816a-efe40c81d462 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:30.136835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-36040f1c-bd84-46d7-816a-efe40c81d462 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:30.143408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36040f1c-bd84-46d7-816a-efe40c81d462 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:30.143843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36040f1c-bd84-46d7-816a-efe40c81d462 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:30.144619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36040f1c-bd84-46d7-816a-efe40c81d462 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:30.145048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36040f1c-bd84-46d7-816a-efe40c81d462 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:30.204517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36040f1c-bd84-46d7-816a-efe40c81d462 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:30.211847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-36040f1c-bd84-46d7-816a-efe40c81d462 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079495 Jun 20 07:13:30.212441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 389/783] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:30 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:30.615628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7e2348dc-c05b-43c0-b2e1-1f07524d4141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:30.616583 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7e2348dc-c05b-43c0-b2e1-1f07524d4141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:30.623142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e2348dc-c05b-43c0-b2e1-1f07524d4141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:30.623594 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e2348dc-c05b-43c0-b2e1-1f07524d4141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:30.624393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e2348dc-c05b-43c0-b2e1-1f07524d4141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:30.624835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e2348dc-c05b-43c0-b2e1-1f07524d4141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:30.653612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7e2348dc-c05b-43c0-b2e1-1f07524d4141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041977 Jun 20 07:13:30.654381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 395/784] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:30 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:31.228306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0cbcd3b5-37aa-44b5-bfa5-32586607493c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:31.228923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0cbcd3b5-37aa-44b5-bfa5-32586607493c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:31.235405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cbcd3b5-37aa-44b5-bfa5-32586607493c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:31.235851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cbcd3b5-37aa-44b5-bfa5-32586607493c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:31.236654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cbcd3b5-37aa-44b5-bfa5-32586607493c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:31.237086 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cbcd3b5-37aa-44b5-bfa5-32586607493c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:31.299539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0cbcd3b5-37aa-44b5-bfa5-32586607493c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:31.307438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0cbcd3b5-37aa-44b5-bfa5-32586607493c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.083006 Jun 20 07:13:31.307998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 390/785] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:31 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:31.665312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75c51c07-c154-4295-8081-33e330494670 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:31.666741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-75c51c07-c154-4295-8081-33e330494670 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:31.673075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75c51c07-c154-4295-8081-33e330494670 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:31.673525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75c51c07-c154-4295-8081-33e330494670 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:31.674285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75c51c07-c154-4295-8081-33e330494670 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:31.674725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75c51c07-c154-4295-8081-33e330494670 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:31.704474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-75c51c07-c154-4295-8081-33e330494670 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043104 Jun 20 07:13:31.705053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 396/786] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:31 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:32.323875 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fe91af7f-b3c7-477c-a744-79795ce95aee tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:32.324552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fe91af7f-b3c7-477c-a744-79795ce95aee tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:32.330975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe91af7f-b3c7-477c-a744-79795ce95aee tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:32.331420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe91af7f-b3c7-477c-a744-79795ce95aee tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:32.332207 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe91af7f-b3c7-477c-a744-79795ce95aee tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:32.332643 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe91af7f-b3c7-477c-a744-79795ce95aee tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:32.391805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fe91af7f-b3c7-477c-a744-79795ce95aee tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:32.399042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fe91af7f-b3c7-477c-a744-79795ce95aee tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.078996 Jun 20 07:13:32.399602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 391/787] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:32 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:32.716563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-88b5f01e-9113-4e95-b907-8bcafeb836e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:32.717518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-88b5f01e-9113-4e95-b907-8bcafeb836e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:32.724001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88b5f01e-9113-4e95-b907-8bcafeb836e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:32.724470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88b5f01e-9113-4e95-b907-8bcafeb836e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:32.725231 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88b5f01e-9113-4e95-b907-8bcafeb836e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:32.725674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88b5f01e-9113-4e95-b907-8bcafeb836e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:32.755290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-88b5f01e-9113-4e95-b907-8bcafeb836e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043235 Jun 20 07:13:32.755827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 397/788] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:32 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:33.416685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0dd072f6-08d1-4284-951c-1df6197428e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:33.417292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0dd072f6-08d1-4284-951c-1df6197428e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:33.423687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0dd072f6-08d1-4284-951c-1df6197428e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:33.424150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0dd072f6-08d1-4284-951c-1df6197428e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:33.424904 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0dd072f6-08d1-4284-951c-1df6197428e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:33.425333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0dd072f6-08d1-4284-951c-1df6197428e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:33.486398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0dd072f6-08d1-4284-951c-1df6197428e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:33.493828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0dd072f6-08d1-4284-951c-1df6197428e9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081594 Jun 20 07:13:33.494390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 392/789] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:33 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:33.767147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a21f391a-9fb7-47b8-9560-cf5746929944 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:33.768061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a21f391a-9fb7-47b8-9560-cf5746929944 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:33.774499 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a21f391a-9fb7-47b8-9560-cf5746929944 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:33.775449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a21f391a-9fb7-47b8-9560-cf5746929944 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:33.776244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a21f391a-9fb7-47b8-9560-cf5746929944 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:33.776682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a21f391a-9fb7-47b8-9560-cf5746929944 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:33.805025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a21f391a-9fb7-47b8-9560-cf5746929944 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042102 Jun 20 07:13:33.805564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 398/790] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:33 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:34.511210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ae24ec99-485f-4dfe-8ba7-c27ce35b520a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:34.511824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ae24ec99-485f-4dfe-8ba7-c27ce35b520a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:34.518161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae24ec99-485f-4dfe-8ba7-c27ce35b520a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:34.518611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae24ec99-485f-4dfe-8ba7-c27ce35b520a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:34.519376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae24ec99-485f-4dfe-8ba7-c27ce35b520a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:34.519812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae24ec99-485f-4dfe-8ba7-c27ce35b520a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:34.579098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae24ec99-485f-4dfe-8ba7-c27ce35b520a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:34.586477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ae24ec99-485f-4dfe-8ba7-c27ce35b520a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079926 Jun 20 07:13:34.587042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 393/791] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:34 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:34.816026 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7622c640-cd7c-4063-a780-626293a60982 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:34.816895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7622c640-cd7c-4063-a780-626293a60982 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:34.823272 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7622c640-cd7c-4063-a780-626293a60982 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:34.823714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7622c640-cd7c-4063-a780-626293a60982 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:34.824489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7622c640-cd7c-4063-a780-626293a60982 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:34.824921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7622c640-cd7c-4063-a780-626293a60982 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:34.852205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7622c640-cd7c-4063-a780-626293a60982 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040189 Jun 20 07:13:34.852741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 399/792] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:34 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:35.602774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5be87557-d7c5-4b87-ae1c-6522d4dd0cb0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:35.603542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5be87557-d7c5-4b87-ae1c-6522d4dd0cb0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:35.610184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5be87557-d7c5-4b87-ae1c-6522d4dd0cb0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:35.610708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5be87557-d7c5-4b87-ae1c-6522d4dd0cb0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:35.611546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5be87557-d7c5-4b87-ae1c-6522d4dd0cb0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:35.612055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5be87557-d7c5-4b87-ae1c-6522d4dd0cb0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:35.678949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5be87557-d7c5-4b87-ae1c-6522d4dd0cb0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:35.686911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5be87557-d7c5-4b87-ae1c-6522d4dd0cb0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.087973 Jun 20 07:13:35.687471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 394/793] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:35 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:35.864371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9ac47180-c9f6-4f59-b09a-3e65d444bde6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:35.865236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9ac47180-c9f6-4f59-b09a-3e65d444bde6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:35.872139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ac47180-c9f6-4f59-b09a-3e65d444bde6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:35.872594 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ac47180-c9f6-4f59-b09a-3e65d444bde6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:35.873354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ac47180-c9f6-4f59-b09a-3e65d444bde6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:35.873788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ac47180-c9f6-4f59-b09a-3e65d444bde6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:35.903490 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9ac47180-c9f6-4f59-b09a-3e65d444bde6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043187 Jun 20 07:13:35.904041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 400/794] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:35 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:36.703627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f0dfa155-0a6d-4c79-99ec-c11a529c816e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:36.704278 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0dfa155-0a6d-4c79-99ec-c11a529c816e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:36.710714 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0dfa155-0a6d-4c79-99ec-c11a529c816e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:36.711160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0dfa155-0a6d-4c79-99ec-c11a529c816e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:36.711918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0dfa155-0a6d-4c79-99ec-c11a529c816e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:36.712878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0dfa155-0a6d-4c79-99ec-c11a529c816e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:36.773583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f0dfa155-0a6d-4c79-99ec-c11a529c816e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:36.781530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f0dfa155-0a6d-4c79-99ec-c11a529c816e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081835 Jun 20 07:13:36.782101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 395/795] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:36 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:36.915005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-23db8bd7-68f8-4999-bf52-46e27b1c0fd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:36.915924 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-23db8bd7-68f8-4999-bf52-46e27b1c0fd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:36.922369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23db8bd7-68f8-4999-bf52-46e27b1c0fd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:36.922819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23db8bd7-68f8-4999-bf52-46e27b1c0fd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:36.923574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23db8bd7-68f8-4999-bf52-46e27b1c0fd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:36.924010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23db8bd7-68f8-4999-bf52-46e27b1c0fd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:36.952084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-23db8bd7-68f8-4999-bf52-46e27b1c0fd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041089 Jun 20 07:13:36.952646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 401/796] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:36 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:37.799130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d10f70c4-3280-43d6-8fba-52716ad9792d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:37.799740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d10f70c4-3280-43d6-8fba-52716ad9792d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:37.806513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d10f70c4-3280-43d6-8fba-52716ad9792d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:37.806957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d10f70c4-3280-43d6-8fba-52716ad9792d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:37.807718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d10f70c4-3280-43d6-8fba-52716ad9792d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:37.808173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d10f70c4-3280-43d6-8fba-52716ad9792d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:37.876993 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d10f70c4-3280-43d6-8fba-52716ad9792d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:37.885053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d10f70c4-3280-43d6-8fba-52716ad9792d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.089204 Jun 20 07:13:37.885625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 396/797] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:37 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:37.964059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ed201f8b-74e0-49ff-851e-cf4f1a94e2a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:37.965045 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ed201f8b-74e0-49ff-851e-cf4f1a94e2a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:37.971521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed201f8b-74e0-49ff-851e-cf4f1a94e2a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:37.971968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed201f8b-74e0-49ff-851e-cf4f1a94e2a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:37.972764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed201f8b-74e0-49ff-851e-cf4f1a94e2a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:37.973205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed201f8b-74e0-49ff-851e-cf4f1a94e2a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:38.003525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ed201f8b-74e0-49ff-851e-cf4f1a94e2a3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043417 Jun 20 07:13:38.004089 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 402/798] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:37 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:38.901989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5c7fef3f-248f-4683-8825-9933d17a6ba9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:38.902636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5c7fef3f-248f-4683-8825-9933d17a6ba9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:38.909135 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c7fef3f-248f-4683-8825-9933d17a6ba9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:38.909585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c7fef3f-248f-4683-8825-9933d17a6ba9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:38.910342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c7fef3f-248f-4683-8825-9933d17a6ba9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:38.910780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c7fef3f-248f-4683-8825-9933d17a6ba9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:38.970280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5c7fef3f-248f-4683-8825-9933d17a6ba9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:38.977635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5c7fef3f-248f-4683-8825-9933d17a6ba9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079512 Jun 20 07:13:38.978191 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 397/799] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:38 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:39.015342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4c606680-3d49-4b57-b8e6-f2396aee56db tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:39.016275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4c606680-3d49-4b57-b8e6-f2396aee56db tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:39.022814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c606680-3d49-4b57-b8e6-f2396aee56db tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:39.023252 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c606680-3d49-4b57-b8e6-f2396aee56db tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:39.024002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c606680-3d49-4b57-b8e6-f2396aee56db tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:39.024461 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c606680-3d49-4b57-b8e6-f2396aee56db tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:39.052308 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4c606680-3d49-4b57-b8e6-f2396aee56db tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040815 Jun 20 07:13:39.052835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 403/800] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:39 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:39.994294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2e2f2225-5097-4593-98af-d9809cd3870f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:39.994829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2e2f2225-5097-4593-98af-d9809cd3870f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:40.001249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e2f2225-5097-4593-98af-d9809cd3870f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:40.001691 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e2f2225-5097-4593-98af-d9809cd3870f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:40.002433 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e2f2225-5097-4593-98af-d9809cd3870f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:40.002859 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e2f2225-5097-4593-98af-d9809cd3870f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:40.062977 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6d8d9a61-6376-449e-b7b2-7ec3a93b616d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:40.064029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6d8d9a61-6376-449e-b7b2-7ec3a93b616d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:40.066961 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2e2f2225-5097-4593-98af-d9809cd3870f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:40.070748 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d8d9a61-6376-449e-b7b2-7ec3a93b616d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:40.071208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d8d9a61-6376-449e-b7b2-7ec3a93b616d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:40.072523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d8d9a61-6376-449e-b7b2-7ec3a93b616d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:40.072968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d8d9a61-6376-449e-b7b2-7ec3a93b616d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:40.074992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2e2f2225-5097-4593-98af-d9809cd3870f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.084675 Jun 20 07:13:40.075590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 398/801] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:39 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:40.101960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6d8d9a61-6376-449e-b7b2-7ec3a93b616d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043012 Jun 20 07:13:40.102509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 404/802] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:40 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:41.092073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-95e90af5-2823-4c0a-a9c9-eea0fa1b282d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:41.092712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-95e90af5-2823-4c0a-a9c9-eea0fa1b282d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:41.099162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95e90af5-2823-4c0a-a9c9-eea0fa1b282d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:41.099601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95e90af5-2823-4c0a-a9c9-eea0fa1b282d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:41.100378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95e90af5-2823-4c0a-a9c9-eea0fa1b282d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:41.100808 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95e90af5-2823-4c0a-a9c9-eea0fa1b282d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:41.113426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-60937032-9b3a-464a-80d3-358079b1cd3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:41.114349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-60937032-9b3a-464a-80d3-358079b1cd3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:41.120889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60937032-9b3a-464a-80d3-358079b1cd3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:41.121347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60937032-9b3a-464a-80d3-358079b1cd3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:41.122111 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60937032-9b3a-464a-80d3-358079b1cd3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:41.122552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60937032-9b3a-464a-80d3-358079b1cd3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:41.152394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-60937032-9b3a-464a-80d3-358079b1cd3c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042769 Jun 20 07:13:41.153183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 405/803] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:41 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:41.160986 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-95e90af5-2823-4c0a-a9c9-eea0fa1b282d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:41.169031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-95e90af5-2823-4c0a-a9c9-eea0fa1b282d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081496 Jun 20 07:13:41.169587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 399/804] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:41 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:42.163284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-041d6100-d968-4157-b00c-725d5df29353 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:42.164259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-041d6100-d968-4157-b00c-725d5df29353 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:42.171108 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-041d6100-d968-4157-b00c-725d5df29353 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:42.171563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-041d6100-d968-4157-b00c-725d5df29353 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:42.172359 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-041d6100-d968-4157-b00c-725d5df29353 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:42.172794 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-041d6100-d968-4157-b00c-725d5df29353 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:42.185391 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5cb93776-8e5c-4ec9-9821-4675790cfe0c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:42.186035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5cb93776-8e5c-4ec9-9821-4675790cfe0c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:42.192517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5cb93776-8e5c-4ec9-9821-4675790cfe0c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:42.192959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5cb93776-8e5c-4ec9-9821-4675790cfe0c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:42.193710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5cb93776-8e5c-4ec9-9821-4675790cfe0c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:42.194170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5cb93776-8e5c-4ec9-9821-4675790cfe0c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:42.201779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-041d6100-d968-4157-b00c-725d5df29353 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042484 Jun 20 07:13:42.202338 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 406/805] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:42.254032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5cb93776-8e5c-4ec9-9821-4675790cfe0c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:42.261305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5cb93776-8e5c-4ec9-9821-4675790cfe0c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080413 Jun 20 07:13:42.261867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 400/806] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:42 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:43.213690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d143fba2-ef8c-48b4-8a07-9f743af6ea46 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:43.214649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d143fba2-ef8c-48b4-8a07-9f743af6ea46 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:43.221384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d143fba2-ef8c-48b4-8a07-9f743af6ea46 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:43.221836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d143fba2-ef8c-48b4-8a07-9f743af6ea46 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:43.222630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d143fba2-ef8c-48b4-8a07-9f743af6ea46 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:43.223071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d143fba2-ef8c-48b4-8a07-9f743af6ea46 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:43.226639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:13:43.251844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d143fba2-ef8c-48b4-8a07-9f743af6ea46 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042129 Jun 20 07:13:43.252358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 407/807] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:43 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:43.277273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-915a0850-d66c-42c8-aa5b-8669c75ae233 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:43.277886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-915a0850-d66c-42c8-aa5b-8669c75ae233 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:43.284394 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-915a0850-d66c-42c8-aa5b-8669c75ae233 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:43.284840 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-915a0850-d66c-42c8-aa5b-8669c75ae233 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:43.285600 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-915a0850-d66c-42c8-aa5b-8669c75ae233 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:43.286041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-915a0850-d66c-42c8-aa5b-8669c75ae233 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:43.346669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-915a0850-d66c-42c8-aa5b-8669c75ae233 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:43.354846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-915a0850-d66c-42c8-aa5b-8669c75ae233 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081453 Jun 20 07:13:43.355414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 401/808] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:43 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:44.263004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-efb4c07f-9d29-400f-ad7b-95ecae421bac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:44.264010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-efb4c07f-9d29-400f-ad7b-95ecae421bac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:44.270911 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-efb4c07f-9d29-400f-ad7b-95ecae421bac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:44.271437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-efb4c07f-9d29-400f-ad7b-95ecae421bac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:44.272504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-efb4c07f-9d29-400f-ad7b-95ecae421bac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:44.272735 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-efb4c07f-9d29-400f-ad7b-95ecae421bac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:44.304034 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-efb4c07f-9d29-400f-ad7b-95ecae421bac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045053 Jun 20 07:13:44.304638 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 408/809] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:44 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:13:44.371155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5232808a-02da-4ed5-988c-0179b0af52a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:44.371769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5232808a-02da-4ed5-988c-0179b0af52a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:44.378187 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5232808a-02da-4ed5-988c-0179b0af52a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:44.378622 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5232808a-02da-4ed5-988c-0179b0af52a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:44.379378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5232808a-02da-4ed5-988c-0179b0af52a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:44.379818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5232808a-02da-4ed5-988c-0179b0af52a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:44.444711 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5232808a-02da-4ed5-988c-0179b0af52a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:44.452810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5232808a-02da-4ed5-988c-0179b0af52a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.085433 Jun 20 07:13:44.453388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 402/810] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:44 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:13:44.614314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c82fc237-b951-4462-b40c-bbfd797e3473 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:44.614807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c82fc237-b951-4462-b40c-bbfd797e3473 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:44.620598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c82fc237-b951-4462-b40c-bbfd797e3473 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:44.621042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c82fc237-b951-4462-b40c-bbfd797e3473 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:44.621797 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c82fc237-b951-4462-b40c-bbfd797e3473 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:44.622225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c82fc237-b951-4462-b40c-bbfd797e3473 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:45.070673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:13:45.070890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:13:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:13:45.315658 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bfbed0a8-6ed5-4ad5-8e10-dc9542852566 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:45.316679 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bfbed0a8-6ed5-4ad5-8e10-dc9542852566 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:45.322782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfbed0a8-6ed5-4ad5-8e10-dc9542852566 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:45.323182 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfbed0a8-6ed5-4ad5-8e10-dc9542852566 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:45.323943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfbed0a8-6ed5-4ad5-8e10-dc9542852566 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:45.324403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfbed0a8-6ed5-4ad5-8e10-dc9542852566 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:45.327915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:13:45.352212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bfbed0a8-6ed5-4ad5-8e10-dc9542852566 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040765 Jun 20 07:13:45.352760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 403/811] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:45 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:45.469801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8b72ca49-eb6e-4151-8e74-3eea3c0adc76 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:45.470473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8b72ca49-eb6e-4151-8e74-3eea3c0adc76 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:45.476844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b72ca49-eb6e-4151-8e74-3eea3c0adc76 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:45.477291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b72ca49-eb6e-4151-8e74-3eea3c0adc76 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:45.478050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b72ca49-eb6e-4151-8e74-3eea3c0adc76 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:45.478491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b72ca49-eb6e-4151-8e74-3eea3c0adc76 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:45.537946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8b72ca49-eb6e-4151-8e74-3eea3c0adc76 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:45.545933 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8b72ca49-eb6e-4151-8e74-3eea3c0adc76 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079831 Jun 20 07:13:45.546496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 404/812] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:45 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:45.574956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:13:45.575415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:13:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac (ip 10.222.0.23) !!! Jun 20 07:13:46.364343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c4460ddc-6307-4350-b74d-c56062e14f38 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:46.365258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c4460ddc-6307-4350-b74d-c56062e14f38 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:46.371664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4460ddc-6307-4350-b74d-c56062e14f38 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:46.372130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4460ddc-6307-4350-b74d-c56062e14f38 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:46.372874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4460ddc-6307-4350-b74d-c56062e14f38 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:46.373303 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4460ddc-6307-4350-b74d-c56062e14f38 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:46.401543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c4460ddc-6307-4350-b74d-c56062e14f38 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041162 Jun 20 07:13:46.402081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 405/813] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:46 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:46.563200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5318fb89-76d1-4643-b004-8ff969e556cc tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:46.563811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5318fb89-76d1-4643-b004-8ff969e556cc tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:46.570179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5318fb89-76d1-4643-b004-8ff969e556cc tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:46.570619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5318fb89-76d1-4643-b004-8ff969e556cc tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:46.571368 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5318fb89-76d1-4643-b004-8ff969e556cc tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:46.571795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5318fb89-76d1-4643-b004-8ff969e556cc tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:46.630929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5318fb89-76d1-4643-b004-8ff969e556cc tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:46.638282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5318fb89-76d1-4643-b004-8ff969e556cc tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079052 Jun 20 07:13:46.638841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 406/814] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:46 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:47.413177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-953cb7ac-576d-4972-99c8-1a6514aa987b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:47.414098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-953cb7ac-576d-4972-99c8-1a6514aa987b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:47.420123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-953cb7ac-576d-4972-99c8-1a6514aa987b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:47.420579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-953cb7ac-576d-4972-99c8-1a6514aa987b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:47.421342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-953cb7ac-576d-4972-99c8-1a6514aa987b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:47.421808 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-953cb7ac-576d-4972-99c8-1a6514aa987b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:47.449851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-953cb7ac-576d-4972-99c8-1a6514aa987b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040716 Jun 20 07:13:47.450395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 407/815] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:47 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:47.654681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-793b805a-9b21-41ab-aba5-ca8d50f75b88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:47.655335 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-793b805a-9b21-41ab-aba5-ca8d50f75b88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:47.661716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-793b805a-9b21-41ab-aba5-ca8d50f75b88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:47.662162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-793b805a-9b21-41ab-aba5-ca8d50f75b88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:47.662919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-793b805a-9b21-41ab-aba5-ca8d50f75b88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:47.663403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-793b805a-9b21-41ab-aba5-ca8d50f75b88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:47.724233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-793b805a-9b21-41ab-aba5-ca8d50f75b88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:47.731543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-793b805a-9b21-41ab-aba5-ca8d50f75b88 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080765 Jun 20 07:13:47.732123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 408/816] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:47 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:48.461421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-feea5413-b54a-40ef-ace1-041208e9df55 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:48.462338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-feea5413-b54a-40ef-ace1-041208e9df55 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:48.468887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-feea5413-b54a-40ef-ace1-041208e9df55 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:48.469335 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-feea5413-b54a-40ef-ace1-041208e9df55 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:48.470091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-feea5413-b54a-40ef-ace1-041208e9df55 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:48.470534 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-feea5413-b54a-40ef-ace1-041208e9df55 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:48.647898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-feea5413-b54a-40ef-ace1-041208e9df55 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.190373 Jun 20 07:13:48.648474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 409/817] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:48 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:48.747473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-db540d29-942c-44df-9ebc-f5756f9465c6 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:48.748040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-db540d29-942c-44df-9ebc-f5756f9465c6 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:48.754603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db540d29-942c-44df-9ebc-f5756f9465c6 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:48.755050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db540d29-942c-44df-9ebc-f5756f9465c6 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:48.755802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db540d29-942c-44df-9ebc-f5756f9465c6 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:48.756265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db540d29-942c-44df-9ebc-f5756f9465c6 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:48.817840 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-db540d29-942c-44df-9ebc-f5756f9465c6 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:48.825850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-db540d29-942c-44df-9ebc-f5756f9465c6 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082151 Jun 20 07:13:48.826400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 410/818] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:48 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:49.660141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-24395474-a745-42b1-8831-6392d7044071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:49.661045 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-24395474-a745-42b1-8831-6392d7044071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:49.666981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24395474-a745-42b1-8831-6392d7044071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:49.667422 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24395474-a745-42b1-8831-6392d7044071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:49.668192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24395474-a745-42b1-8831-6392d7044071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:49.668621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24395474-a745-42b1-8831-6392d7044071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:49.695664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-24395474-a745-42b1-8831-6392d7044071 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039486 Jun 20 07:13:49.696214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 411/819] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:49 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:49.842060 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-583450eb-f9de-49d8-b2a8-eeeb30764e39 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:49.842721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-583450eb-f9de-49d8-b2a8-eeeb30764e39 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:49.849014 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-583450eb-f9de-49d8-b2a8-eeeb30764e39 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:49.849453 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-583450eb-f9de-49d8-b2a8-eeeb30764e39 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:49.850198 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-583450eb-f9de-49d8-b2a8-eeeb30764e39 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:49.850628 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-583450eb-f9de-49d8-b2a8-eeeb30764e39 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:49.909721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-583450eb-f9de-49d8-b2a8-eeeb30764e39 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:49.917028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-583450eb-f9de-49d8-b2a8-eeeb30764e39 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079168 Jun 20 07:13:49.917509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 412/820] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:49 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:50.707561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-50e86133-53af-46ba-9fe8-d4ebae31d951 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:50.708612 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-50e86133-53af-46ba-9fe8-d4ebae31d951 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:50.714662 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50e86133-53af-46ba-9fe8-d4ebae31d951 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:50.715108 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50e86133-53af-46ba-9fe8-d4ebae31d951 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:50.715872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50e86133-53af-46ba-9fe8-d4ebae31d951 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:50.716334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50e86133-53af-46ba-9fe8-d4ebae31d951 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:50.743739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-50e86133-53af-46ba-9fe8-d4ebae31d951 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040196 Jun 20 07:13:50.744306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 413/821] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:50 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:50.933957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-52251a15-a69f-4dd1-9a29-8051960e9eea tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:50.934556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-52251a15-a69f-4dd1-9a29-8051960e9eea tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:50.940988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52251a15-a69f-4dd1-9a29-8051960e9eea tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:50.941435 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52251a15-a69f-4dd1-9a29-8051960e9eea tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:50.942199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52251a15-a69f-4dd1-9a29-8051960e9eea tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:50.942634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-52251a15-a69f-4dd1-9a29-8051960e9eea tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:51.002776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-52251a15-a69f-4dd1-9a29-8051960e9eea tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:51.010959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-52251a15-a69f-4dd1-9a29-8051960e9eea tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080654 Jun 20 07:13:51.011580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 414/822] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:50 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:51.755804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4cbffc37-14b9-4fd6-8a8a-2b202ab6bc7f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:51.756773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4cbffc37-14b9-4fd6-8a8a-2b202ab6bc7f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:51.763271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cbffc37-14b9-4fd6-8a8a-2b202ab6bc7f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:51.763687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cbffc37-14b9-4fd6-8a8a-2b202ab6bc7f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:51.764456 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cbffc37-14b9-4fd6-8a8a-2b202ab6bc7f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:51.764886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cbffc37-14b9-4fd6-8a8a-2b202ab6bc7f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:51.793089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4cbffc37-14b9-4fd6-8a8a-2b202ab6bc7f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041256 Jun 20 07:13:51.793617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 415/823] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:51 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:52.028509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ee399ded-9661-469a-ae6f-b9380174aedd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:52.029155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ee399ded-9661-469a-ae6f-b9380174aedd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:52.035464 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ee399ded-9661-469a-ae6f-b9380174aedd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:52.035911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ee399ded-9661-469a-ae6f-b9380174aedd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:52.036717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ee399ded-9661-469a-ae6f-b9380174aedd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:52.037176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ee399ded-9661-469a-ae6f-b9380174aedd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:52.099093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ee399ded-9661-469a-ae6f-b9380174aedd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:52.106636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ee399ded-9661-469a-ae6f-b9380174aedd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082750 Jun 20 07:13:52.107188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 416/824] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:52 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:52.520540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:13:52.521080 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:13:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac (ip 10.222.0.23) !!! Jun 20 07:13:52.803632 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bbbba6de-289f-49b2-a3f0-cede7b4e566d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:52.804507 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bbbba6de-289f-49b2-a3f0-cede7b4e566d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:52.811224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbbba6de-289f-49b2-a3f0-cede7b4e566d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:52.811669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbbba6de-289f-49b2-a3f0-cede7b4e566d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:52.812452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbbba6de-289f-49b2-a3f0-cede7b4e566d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:52.812889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbbba6de-289f-49b2-a3f0-cede7b4e566d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:52.840003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bbbba6de-289f-49b2-a3f0-cede7b4e566d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040328 Jun 20 07:13:52.840566 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 417/825] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:52 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:53.123308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8832cfa9-2f67-45c4-98e4-4755aecaea80 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:53.123952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8832cfa9-2f67-45c4-98e4-4755aecaea80 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:53.130229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8832cfa9-2f67-45c4-98e4-4755aecaea80 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:53.130674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8832cfa9-2f67-45c4-98e4-4755aecaea80 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:53.131433 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8832cfa9-2f67-45c4-98e4-4755aecaea80 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:53.131865 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8832cfa9-2f67-45c4-98e4-4755aecaea80 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:53.193946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8832cfa9-2f67-45c4-98e4-4755aecaea80 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:53.201334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8832cfa9-2f67-45c4-98e4-4755aecaea80 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082160 Jun 20 07:13:53.201886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 418/826] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:53 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:53.850931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eb605072-beaa-4e19-ac7c-7a3302bd7f92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:53.851850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eb605072-beaa-4e19-ac7c-7a3302bd7f92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:53.858555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb605072-beaa-4e19-ac7c-7a3302bd7f92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:53.859002 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb605072-beaa-4e19-ac7c-7a3302bd7f92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:53.859753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb605072-beaa-4e19-ac7c-7a3302bd7f92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:53.860224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb605072-beaa-4e19-ac7c-7a3302bd7f92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:53.883446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:13:53.887973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eb605072-beaa-4e19-ac7c-7a3302bd7f92 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041115 Jun 20 07:13:53.888555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 419/827] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:53 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:54.218747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5c213b63-1c35-4095-b42f-d1809e128a45 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:54.219386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5c213b63-1c35-4095-b42f-d1809e128a45 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:54.225814 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c213b63-1c35-4095-b42f-d1809e128a45 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:54.226254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c213b63-1c35-4095-b42f-d1809e128a45 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:54.226999 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c213b63-1c35-4095-b42f-d1809e128a45 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:54.227427 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c213b63-1c35-4095-b42f-d1809e128a45 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:54.286795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5c213b63-1c35-4095-b42f-d1809e128a45 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:54.294240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5c213b63-1c35-4095-b42f-d1809e128a45 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079597 Jun 20 07:13:54.294798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 420/828] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:54 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:54.618300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=41 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:13:54.641719 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=14 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:13:54.899952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e12e590a-276d-4fa1-bfbb-47face5977b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:54.901386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e12e590a-276d-4fa1-bfbb-47face5977b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:54.907384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e12e590a-276d-4fa1-bfbb-47face5977b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:54.907827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e12e590a-276d-4fa1-bfbb-47face5977b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:54.908602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e12e590a-276d-4fa1-bfbb-47face5977b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:54.909028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e12e590a-276d-4fa1-bfbb-47face5977b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:54.936820 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e12e590a-276d-4fa1-bfbb-47face5977b0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040973 Jun 20 07:13:54.937361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 421/829] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:54 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:55.311365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-49ac835d-9cca-401c-951c-a495f158fe71 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:55.312008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-49ac835d-9cca-401c-951c-a495f158fe71 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:55.318441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49ac835d-9cca-401c-951c-a495f158fe71 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:55.318891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49ac835d-9cca-401c-951c-a495f158fe71 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:55.319651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49ac835d-9cca-401c-951c-a495f158fe71 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:55.320091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49ac835d-9cca-401c-951c-a495f158fe71 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:55.379736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-49ac835d-9cca-401c-951c-a495f158fe71 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:55.387811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-49ac835d-9cca-401c-951c-a495f158fe71 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080881 Jun 20 07:13:55.388405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 422/830] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:55 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:55.948987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5329fd90-2168-41aa-a6cd-77d8f683e7bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:55.949564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5329fd90-2168-41aa-a6cd-77d8f683e7bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:55.951415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=76 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:13:55.956870 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5329fd90-2168-41aa-a6cd-77d8f683e7bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:55.957316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5329fd90-2168-41aa-a6cd-77d8f683e7bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:55.958131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5329fd90-2168-41aa-a6cd-77d8f683e7bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:55.958517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5329fd90-2168-41aa-a6cd-77d8f683e7bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:55.988299 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5329fd90-2168-41aa-a6cd-77d8f683e7bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043671 Jun 20 07:13:55.989173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 423/831] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:55 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:56.405008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-046325ea-b8b4-4962-8e83-6bf379ce16c3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:56.405760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-046325ea-b8b4-4962-8e83-6bf379ce16c3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:56.412180 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-046325ea-b8b4-4962-8e83-6bf379ce16c3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:56.412632 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-046325ea-b8b4-4962-8e83-6bf379ce16c3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:56.413394 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-046325ea-b8b4-4962-8e83-6bf379ce16c3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:56.413831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-046325ea-b8b4-4962-8e83-6bf379ce16c3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:56.474757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-046325ea-b8b4-4962-8e83-6bf379ce16c3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:56.482290 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-046325ea-b8b4-4962-8e83-6bf379ce16c3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081855 Jun 20 07:13:56.482847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 424/832] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:56 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:57.000560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-66dcd191-0c58-47f1-ba00-4869064d1189 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:57.001410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-66dcd191-0c58-47f1-ba00-4869064d1189 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:57.007352 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66dcd191-0c58-47f1-ba00-4869064d1189 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:57.007799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66dcd191-0c58-47f1-ba00-4869064d1189 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:57.008579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66dcd191-0c58-47f1-ba00-4869064d1189 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:57.009015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66dcd191-0c58-47f1-ba00-4869064d1189 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:57.037356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-66dcd191-0c58-47f1-ba00-4869064d1189 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040883 Jun 20 07:13:57.037890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 425/833] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:56 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:57.498641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c6918a3c-c8ca-427a-ae4b-82c8e4a028fe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:57.499288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c6918a3c-c8ca-427a-ae4b-82c8e4a028fe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:57.505694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6918a3c-c8ca-427a-ae4b-82c8e4a028fe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:57.506146 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6918a3c-c8ca-427a-ae4b-82c8e4a028fe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:57.506976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6918a3c-c8ca-427a-ae4b-82c8e4a028fe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:57.507527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6918a3c-c8ca-427a-ae4b-82c8e4a028fe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:57.571268 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c6918a3c-c8ca-427a-ae4b-82c8e4a028fe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:57.578741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c6918a3c-c8ca-427a-ae4b-82c8e4a028fe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.083984 Jun 20 07:13:57.579296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 426/834] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:57 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:58.049057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-49dfd7af-2f9e-4daa-8e99-2758a36f6134 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:58.049985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-49dfd7af-2f9e-4daa-8e99-2758a36f6134 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:58.055941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49dfd7af-2f9e-4daa-8e99-2758a36f6134 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:58.056422 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49dfd7af-2f9e-4daa-8e99-2758a36f6134 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:58.057185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49dfd7af-2f9e-4daa-8e99-2758a36f6134 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:58.057621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49dfd7af-2f9e-4daa-8e99-2758a36f6134 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:58.085735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-49dfd7af-2f9e-4daa-8e99-2758a36f6134 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040728 Jun 20 07:13:58.086280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 427/835] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:58 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:58.594713 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1a3562a0-1347-4f85-ba0d-2c306be4f9e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:58.595357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a3562a0-1347-4f85-ba0d-2c306be4f9e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:58.601814 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a3562a0-1347-4f85-ba0d-2c306be4f9e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:58.602262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a3562a0-1347-4f85-ba0d-2c306be4f9e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:58.603018 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a3562a0-1347-4f85-ba0d-2c306be4f9e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:58.603452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a3562a0-1347-4f85-ba0d-2c306be4f9e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:58.663533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1a3562a0-1347-4f85-ba0d-2c306be4f9e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:58.671319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1a3562a0-1347-4f85-ba0d-2c306be4f9e4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080483 Jun 20 07:13:58.671873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 428/836] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:58 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:13:59.098017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-559606ea-91e1-4b04-8eab-85e612b85844 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:59.098939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-559606ea-91e1-4b04-8eab-85e612b85844 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:59.105545 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-559606ea-91e1-4b04-8eab-85e612b85844 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:59.105998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-559606ea-91e1-4b04-8eab-85e612b85844 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:59.106763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-559606ea-91e1-4b04-8eab-85e612b85844 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:59.107204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-559606ea-91e1-4b04-8eab-85e612b85844 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:59.135090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-559606ea-91e1-4b04-8eab-85e612b85844 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041054 Jun 20 07:13:59.135623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 429/837] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:13:59 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:13:59.688252 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dc8e702f-1ecb-4a31-9c0f-c2d82eb28384 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:13:59.688917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dc8e702f-1ecb-4a31-9c0f-c2d82eb28384 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:13:59.695544 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc8e702f-1ecb-4a31-9c0f-c2d82eb28384 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:59.696000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc8e702f-1ecb-4a31-9c0f-c2d82eb28384 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:59.696800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc8e702f-1ecb-4a31-9c0f-c2d82eb28384 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:13:59.697240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc8e702f-1ecb-4a31-9c0f-c2d82eb28384 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:13:59.757267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dc8e702f-1ecb-4a31-9c0f-c2d82eb28384 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:13:59.765348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dc8e702f-1ecb-4a31-9c0f-c2d82eb28384 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080964 Jun 20 07:13:59.765912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 430/838] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:13:59 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:00.147419 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c5edcb72-854a-4c52-8ff4-587ff2112031 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:00.148367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c5edcb72-854a-4c52-8ff4-587ff2112031 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:00.154375 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5edcb72-854a-4c52-8ff4-587ff2112031 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:00.154823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5edcb72-854a-4c52-8ff4-587ff2112031 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:00.155584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5edcb72-854a-4c52-8ff4-587ff2112031 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:00.156022 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5edcb72-854a-4c52-8ff4-587ff2112031 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:00.184662 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c5edcb72-854a-4c52-8ff4-587ff2112031 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041262 Jun 20 07:14:00.185220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 431/839] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:00 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:14:00.782522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bf3cc452-2654-4cba-9eaf-bcee247c4825 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:00.783138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bf3cc452-2654-4cba-9eaf-bcee247c4825 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:00.789610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf3cc452-2654-4cba-9eaf-bcee247c4825 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:00.790063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf3cc452-2654-4cba-9eaf-bcee247c4825 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:00.790826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf3cc452-2654-4cba-9eaf-bcee247c4825 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:00.791267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf3cc452-2654-4cba-9eaf-bcee247c4825 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:00.851984 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bf3cc452-2654-4cba-9eaf-bcee247c4825 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:00.859548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bf3cc452-2654-4cba-9eaf-bcee247c4825 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080789 Jun 20 07:14:00.860373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 432/840] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:00 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:01.196386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ee752ffd-26bf-45fe-ba84-3531af52b44d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:01.197882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ee752ffd-26bf-45fe-ba84-3531af52b44d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:01.203910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ee752ffd-26bf-45fe-ba84-3531af52b44d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:01.204403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ee752ffd-26bf-45fe-ba84-3531af52b44d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:01.205161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ee752ffd-26bf-45fe-ba84-3531af52b44d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:01.205593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ee752ffd-26bf-45fe-ba84-3531af52b44d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:01.233261 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ee752ffd-26bf-45fe-ba84-3531af52b44d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040944 Jun 20 07:14:01.233801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 433/841] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:01 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:14:01.876305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eae58b2d-c18d-48be-90ba-a864ae80fb09 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:01.876919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eae58b2d-c18d-48be-90ba-a864ae80fb09 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:01.883383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eae58b2d-c18d-48be-90ba-a864ae80fb09 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:01.883836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eae58b2d-c18d-48be-90ba-a864ae80fb09 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:01.884624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eae58b2d-c18d-48be-90ba-a864ae80fb09 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:01.885083 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eae58b2d-c18d-48be-90ba-a864ae80fb09 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:01.947444 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eae58b2d-c18d-48be-90ba-a864ae80fb09 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:01.954981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eae58b2d-c18d-48be-90ba-a864ae80fb09 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082601 Jun 20 07:14:01.955542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 434/842] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:01 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:02.245030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bb72b1e6-6820-4b76-8b09-be2606ebc2b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:02.245873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bb72b1e6-6820-4b76-8b09-be2606ebc2b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:02.251852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb72b1e6-6820-4b76-8b09-be2606ebc2b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:02.252332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb72b1e6-6820-4b76-8b09-be2606ebc2b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:02.253089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb72b1e6-6820-4b76-8b09-be2606ebc2b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:02.253521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb72b1e6-6820-4b76-8b09-be2606ebc2b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:02.282544 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bb72b1e6-6820-4b76-8b09-be2606ebc2b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041632 Jun 20 07:14:02.283081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 435/843] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:02 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:14:02.972038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ad7e77a1-c822-44ab-9460-450b7d865852 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:02.972650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ad7e77a1-c822-44ab-9460-450b7d865852 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:02.979767 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad7e77a1-c822-44ab-9460-450b7d865852 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:02.980244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad7e77a1-c822-44ab-9460-450b7d865852 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:02.981014 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad7e77a1-c822-44ab-9460-450b7d865852 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:02.981562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad7e77a1-c822-44ab-9460-450b7d865852 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:02.999611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:14:03.044576 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad7e77a1-c822-44ab-9460-450b7d865852 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:03.052021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ad7e77a1-c822-44ab-9460-450b7d865852 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.083903 Jun 20 07:14:03.052633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 436/844] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:02 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:03.294691 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-625e0493-1454-417c-88cf-5d0f7c051e85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:03.295605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-625e0493-1454-417c-88cf-5d0f7c051e85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:03.301580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-625e0493-1454-417c-88cf-5d0f7c051e85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:03.302020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-625e0493-1454-417c-88cf-5d0f7c051e85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:03.302765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-625e0493-1454-417c-88cf-5d0f7c051e85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:03.303193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-625e0493-1454-417c-88cf-5d0f7c051e85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:03.331135 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-625e0493-1454-417c-88cf-5d0f7c051e85 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040942 Jun 20 07:14:03.331673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 437/845] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:03 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:14:04.069452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-291d510e-40f3-45cb-bc20-714c2f83d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:04.070113 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-291d510e-40f3-45cb-bc20-714c2f83d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:04.076563 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-291d510e-40f3-45cb-bc20-714c2f83d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:04.077017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-291d510e-40f3-45cb-bc20-714c2f83d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:04.077785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-291d510e-40f3-45cb-bc20-714c2f83d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:04.078223 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-291d510e-40f3-45cb-bc20-714c2f83d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:04.137858 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-291d510e-40f3-45cb-bc20-714c2f83d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:04.145570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-291d510e-40f3-45cb-bc20-714c2f83d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080121 Jun 20 07:14:04.146130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 438/846] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:04 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:04.344627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-62f4faea-eba8-4910-8193-053ce54a77e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:04.345642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-62f4faea-eba8-4910-8193-053ce54a77e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:04.351782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62f4faea-eba8-4910-8193-053ce54a77e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:04.352403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62f4faea-eba8-4910-8193-053ce54a77e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:04.353186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62f4faea-eba8-4910-8193-053ce54a77e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:04.354088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62f4faea-eba8-4910-8193-053ce54a77e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:04.383747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-62f4faea-eba8-4910-8193-053ce54a77e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044035 Jun 20 07:14:04.384344 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 439/847] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:04 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:14:05.162056 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c91a47fd-4398-46fa-8065-87d66ff6856d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:05.162702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c91a47fd-4398-46fa-8065-87d66ff6856d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:05.169617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c91a47fd-4398-46fa-8065-87d66ff6856d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:05.170064 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c91a47fd-4398-46fa-8065-87d66ff6856d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:05.170814 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c91a47fd-4398-46fa-8065-87d66ff6856d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:05.171244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c91a47fd-4398-46fa-8065-87d66ff6856d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:05.234277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c91a47fd-4398-46fa-8065-87d66ff6856d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:05.241672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c91a47fd-4398-46fa-8065-87d66ff6856d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.083476 Jun 20 07:14:05.242343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 440/848] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:05 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:05.395360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b08238f8-5006-439d-823d-a727704226e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:05.396315 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b08238f8-5006-439d-823d-a727704226e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:05.403200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b08238f8-5006-439d-823d-a727704226e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:05.403653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b08238f8-5006-439d-823d-a727704226e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:05.404439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b08238f8-5006-439d-823d-a727704226e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:05.404881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b08238f8-5006-439d-823d-a727704226e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:05.434166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b08238f8-5006-439d-823d-a727704226e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042913 Jun 20 07:14:05.434649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 441/849] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:05 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:14:06.258451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3fc6dc16-d2ff-43bb-a59c-3a2623c802f0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:06.259096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3fc6dc16-d2ff-43bb-a59c-3a2623c802f0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:06.265491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fc6dc16-d2ff-43bb-a59c-3a2623c802f0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:06.265943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fc6dc16-d2ff-43bb-a59c-3a2623c802f0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:06.266957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fc6dc16-d2ff-43bb-a59c-3a2623c802f0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:06.267395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3fc6dc16-d2ff-43bb-a59c-3a2623c802f0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:06.333362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3fc6dc16-d2ff-43bb-a59c-3a2623c802f0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:06.340874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3fc6dc16-d2ff-43bb-a59c-3a2623c802f0 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.086291 Jun 20 07:14:06.341440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 442/850] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:06 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:06.445399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-69e9185c-dadb-4a4c-a821-e8a8193da2a1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:06.446325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-69e9185c-dadb-4a4c-a821-e8a8193da2a1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:06.452250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69e9185c-dadb-4a4c-a821-e8a8193da2a1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:06.452694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69e9185c-dadb-4a4c-a821-e8a8193da2a1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:06.453439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69e9185c-dadb-4a4c-a821-e8a8193da2a1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:06.453867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69e9185c-dadb-4a4c-a821-e8a8193da2a1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:06.482762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-69e9185c-dadb-4a4c-a821-e8a8193da2a1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041141 Jun 20 07:14:06.483310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 443/851] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:06 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:14:07.357409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15f130cb-5145-4d56-9610-4bfcecd969a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:07.358079 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-15f130cb-5145-4d56-9610-4bfcecd969a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:07.364506 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15f130cb-5145-4d56-9610-4bfcecd969a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:07.364954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15f130cb-5145-4d56-9610-4bfcecd969a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:07.365714 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15f130cb-5145-4d56-9610-4bfcecd969a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:07.366144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15f130cb-5145-4d56-9610-4bfcecd969a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:07.426432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-15f130cb-5145-4d56-9610-4bfcecd969a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:07.434323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-15f130cb-5145-4d56-9610-4bfcecd969a5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080822 Jun 20 07:14:07.434882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 444/852] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:07 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:07.495558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c26f4a7f-2539-48a4-80e0-14cffd2ca110 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:07.496501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c26f4a7f-2539-48a4-80e0-14cffd2ca110 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:07.502882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c26f4a7f-2539-48a4-80e0-14cffd2ca110 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:07.503335 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c26f4a7f-2539-48a4-80e0-14cffd2ca110 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:07.504101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c26f4a7f-2539-48a4-80e0-14cffd2ca110 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:07.504565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c26f4a7f-2539-48a4-80e0-14cffd2ca110 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:07.536398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c26f4a7f-2539-48a4-80e0-14cffd2ca110 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046005 Jun 20 07:14:07.536977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 445/853] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:07 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:14:08.451159 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4f7de1aa-99d3-4618-864e-ca7dce533090 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:08.451810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4f7de1aa-99d3-4618-864e-ca7dce533090 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:08.458226 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f7de1aa-99d3-4618-864e-ca7dce533090 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:08.458668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f7de1aa-99d3-4618-864e-ca7dce533090 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:08.459414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f7de1aa-99d3-4618-864e-ca7dce533090 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:08.459843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f7de1aa-99d3-4618-864e-ca7dce533090 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:08.519771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4f7de1aa-99d3-4618-864e-ca7dce533090 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:08.528349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4f7de1aa-99d3-4618-864e-ca7dce533090 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081509 Jun 20 07:14:08.528909 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 446/854] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:08 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:08.547514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e8504290-9a87-44ee-984a-3b0377930e3b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:08.548471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e8504290-9a87-44ee-984a-3b0377930e3b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:08.554284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8504290-9a87-44ee-984a-3b0377930e3b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:08.554732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8504290-9a87-44ee-984a-3b0377930e3b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:08.555493 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8504290-9a87-44ee-984a-3b0377930e3b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:08.555929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8504290-9a87-44ee-984a-3b0377930e3b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:08.584555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e8504290-9a87-44ee-984a-3b0377930e3b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040651 Jun 20 07:14:08.585106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 447/855] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:08 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:14:09.545305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b37061c3-49b0-434b-881a-411a0ceeaac2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:09.545971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b37061c3-49b0-434b-881a-411a0ceeaac2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:09.552420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b37061c3-49b0-434b-881a-411a0ceeaac2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:09.552871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b37061c3-49b0-434b-881a-411a0ceeaac2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:09.553630 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b37061c3-49b0-434b-881a-411a0ceeaac2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:09.554066 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b37061c3-49b0-434b-881a-411a0ceeaac2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:09.617173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b37061c3-49b0-434b-881a-411a0ceeaac2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:09.624600 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b37061c3-49b0-434b-881a-411a0ceeaac2 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.083757 Jun 20 07:14:09.625171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 448/856] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:09 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:09.629635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cda7f10e-62ae-4fb1-b905-3e00571ed459 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:09.630533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cda7f10e-62ae-4fb1-b905-3e00571ed459 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:09.636237 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cda7f10e-62ae-4fb1-b905-3e00571ed459 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:09.636682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cda7f10e-62ae-4fb1-b905-3e00571ed459 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:09.637441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cda7f10e-62ae-4fb1-b905-3e00571ed459 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:09.637874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cda7f10e-62ae-4fb1-b905-3e00571ed459 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:09.668317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cda7f10e-62ae-4fb1-b905-3e00571ed459 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042111 Jun 20 07:14:09.668863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 449/857] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:09 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:10.641824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b2d4dace-3d5f-4ed5-a349-9a9ae56a55d7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:10.642459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b2d4dace-3d5f-4ed5-a349-9a9ae56a55d7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:10.648920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2d4dace-3d5f-4ed5-a349-9a9ae56a55d7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:10.649368 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2d4dace-3d5f-4ed5-a349-9a9ae56a55d7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:10.650138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2d4dace-3d5f-4ed5-a349-9a9ae56a55d7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:10.650575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2d4dace-3d5f-4ed5-a349-9a9ae56a55d7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:10.712662 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b2d4dace-3d5f-4ed5-a349-9a9ae56a55d7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:10.720297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b2d4dace-3d5f-4ed5-a349-9a9ae56a55d7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082497 Jun 20 07:14:10.720693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 450/858] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:10 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:10.725151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-43e32e2b-fa1d-4442-aa76-75637afb46f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:10.726048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-43e32e2b-fa1d-4442-aa76-75637afb46f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:10.732054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43e32e2b-fa1d-4442-aa76-75637afb46f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:10.732531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43e32e2b-fa1d-4442-aa76-75637afb46f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:10.733282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43e32e2b-fa1d-4442-aa76-75637afb46f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:10.733716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43e32e2b-fa1d-4442-aa76-75637afb46f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:10.761917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-43e32e2b-fa1d-4442-aa76-75637afb46f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040253 Jun 20 07:14:10.762452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 451/859] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:10 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:11.737059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0f49c82-7133-44a6-8a54-e6ff8c926406 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:11.737648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c0f49c82-7133-44a6-8a54-e6ff8c926406 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:11.744692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0f49c82-7133-44a6-8a54-e6ff8c926406 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:11.745141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0f49c82-7133-44a6-8a54-e6ff8c926406 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:11.745897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0f49c82-7133-44a6-8a54-e6ff8c926406 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:11.746332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0f49c82-7133-44a6-8a54-e6ff8c926406 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:11.805610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c0f49c82-7133-44a6-8a54-e6ff8c926406 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:11.813615 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c0f49c82-7133-44a6-8a54-e6ff8c926406 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080455 Jun 20 07:14:11.814177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 452/860] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:11 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:11.818647 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d3d2bd7b-8f98-4bff-b3c8-be9678813415 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:11.819579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d3d2bd7b-8f98-4bff-b3c8-be9678813415 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:11.825922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3d2bd7b-8f98-4bff-b3c8-be9678813415 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:11.826373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3d2bd7b-8f98-4bff-b3c8-be9678813415 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:11.827140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3d2bd7b-8f98-4bff-b3c8-be9678813415 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:11.827578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d3d2bd7b-8f98-4bff-b3c8-be9678813415 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:11.831229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:14:11.856281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d3d2bd7b-8f98-4bff-b3c8-be9678813415 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041073 Jun 20 07:14:11.856834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 453/861] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:11 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:12.830737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-30e38100-fc24-45aa-a94e-cc0b73611cfe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:12.831348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-30e38100-fc24-45aa-a94e-cc0b73611cfe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:12.837857 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30e38100-fc24-45aa-a94e-cc0b73611cfe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:12.838306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30e38100-fc24-45aa-a94e-cc0b73611cfe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:12.839069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30e38100-fc24-45aa-a94e-cc0b73611cfe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:12.839503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30e38100-fc24-45aa-a94e-cc0b73611cfe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:12.899612 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-30e38100-fc24-45aa-a94e-cc0b73611cfe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:12.907023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-30e38100-fc24-45aa-a94e-cc0b73611cfe tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080125 Jun 20 07:14:12.907584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 454/862] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:12 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:12.912090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4a1d6451-f963-4cd4-9b37-c400c8c17011 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:12.913010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4a1d6451-f963-4cd4-9b37-c400c8c17011 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:12.919253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a1d6451-f963-4cd4-9b37-c400c8c17011 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:12.919701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a1d6451-f963-4cd4-9b37-c400c8c17011 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:12.920519 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a1d6451-f963-4cd4-9b37-c400c8c17011 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:12.920986 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a1d6451-f963-4cd4-9b37-c400c8c17011 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:12.949393 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4a1d6451-f963-4cd4-9b37-c400c8c17011 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040845 Jun 20 07:14:12.949929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 455/863] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:12 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:13.924055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d0514b63-739f-4c1c-90db-1c5548d98a08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:13.924701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d0514b63-739f-4c1c-90db-1c5548d98a08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:13.931338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0514b63-739f-4c1c-90db-1c5548d98a08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:13.931787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0514b63-739f-4c1c-90db-1c5548d98a08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:13.932585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0514b63-739f-4c1c-90db-1c5548d98a08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:13.933021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0514b63-739f-4c1c-90db-1c5548d98a08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:13.994841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d0514b63-739f-4c1c-90db-1c5548d98a08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:14.002388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d0514b63-739f-4c1c-90db-1c5548d98a08 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082172 Jun 20 07:14:14.002960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 456/864] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:13 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:14.007436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-edea408c-d7cb-4852-b7c6-25450ce6b4d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:14.008380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-edea408c-d7cb-4852-b7c6-25450ce6b4d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:14.013917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edea408c-d7cb-4852-b7c6-25450ce6b4d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:14.014370 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edea408c-d7cb-4852-b7c6-25450ce6b4d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:14.015133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edea408c-d7cb-4852-b7c6-25450ce6b4d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:14.015572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edea408c-d7cb-4852-b7c6-25450ce6b4d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:14.046028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-edea408c-d7cb-4852-b7c6-25450ce6b4d3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042095 Jun 20 07:14:14.046565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 457/865] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:14 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:15.116001 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-25338a72-5c56-485a-972c-197ed0846a47 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:15.116712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-25338a72-5c56-485a-972c-197ed0846a47 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:15.123206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25338a72-5c56-485a-972c-197ed0846a47 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:15.123653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25338a72-5c56-485a-972c-197ed0846a47 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:15.124439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25338a72-5c56-485a-972c-197ed0846a47 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:15.124872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-25338a72-5c56-485a-972c-197ed0846a47 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:15.184027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-25338a72-5c56-485a-972c-197ed0846a47 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:15.191605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-25338a72-5c56-485a-972c-197ed0846a47 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.176049 Jun 20 07:14:15.192217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 458/866] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:15 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:15.196771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7eeebbf9-9eef-418c-a3f8-87bf1f163707 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:15.197711 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7eeebbf9-9eef-418c-a3f8-87bf1f163707 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:15.203180 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7eeebbf9-9eef-418c-a3f8-87bf1f163707 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:15.203629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7eeebbf9-9eef-418c-a3f8-87bf1f163707 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:15.204436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7eeebbf9-9eef-418c-a3f8-87bf1f163707 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:15.204880 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7eeebbf9-9eef-418c-a3f8-87bf1f163707 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:15.233160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7eeebbf9-9eef-418c-a3f8-87bf1f163707 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039922 Jun 20 07:14:15.233738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 459/867] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:15 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:16.208035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-beeda8b8-5378-4072-b328-a733bd2a2abb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:16.208712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-beeda8b8-5378-4072-b328-a733bd2a2abb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:16.215128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-beeda8b8-5378-4072-b328-a733bd2a2abb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:16.215571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-beeda8b8-5378-4072-b328-a733bd2a2abb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:16.216356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-beeda8b8-5378-4072-b328-a733bd2a2abb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:16.216791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-beeda8b8-5378-4072-b328-a733bd2a2abb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:16.276367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-beeda8b8-5378-4072-b328-a733bd2a2abb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:16.283875 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-beeda8b8-5378-4072-b328-a733bd2a2abb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079752 Jun 20 07:14:16.284467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 460/868] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:16 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:16.288953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9a62e4db-b463-43bf-bb74-4e9b02dd2797 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:16.289852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9a62e4db-b463-43bf-bb74-4e9b02dd2797 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:16.295378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a62e4db-b463-43bf-bb74-4e9b02dd2797 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:16.295830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a62e4db-b463-43bf-bb74-4e9b02dd2797 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:16.296619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a62e4db-b463-43bf-bb74-4e9b02dd2797 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:16.297058 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a62e4db-b463-43bf-bb74-4e9b02dd2797 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:16.325601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9a62e4db-b463-43bf-bb74-4e9b02dd2797 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040158 Jun 20 07:14:16.326139 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 461/869] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:16 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:17.300570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f6b557b3-99ff-4bc5-a949-4c5f5f1aa58d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:17.301224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f6b557b3-99ff-4bc5-a949-4c5f5f1aa58d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:17.307708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6b557b3-99ff-4bc5-a949-4c5f5f1aa58d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:17.308195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6b557b3-99ff-4bc5-a949-4c5f5f1aa58d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:17.308972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6b557b3-99ff-4bc5-a949-4c5f5f1aa58d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:17.309407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6b557b3-99ff-4bc5-a949-4c5f5f1aa58d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:17.369172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f6b557b3-99ff-4bc5-a949-4c5f5f1aa58d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:17.376472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f6b557b3-99ff-4bc5-a949-4c5f5f1aa58d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079732 Jun 20 07:14:17.377032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 462/870] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:17 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:17.381467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-026006d5-0ac4-478a-a0ad-780ad1eb0147 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:17.382365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-026006d5-0ac4-478a-a0ad-780ad1eb0147 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:17.388374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-026006d5-0ac4-478a-a0ad-780ad1eb0147 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:17.388823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-026006d5-0ac4-478a-a0ad-780ad1eb0147 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:17.389582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-026006d5-0ac4-478a-a0ad-780ad1eb0147 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:17.390016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-026006d5-0ac4-478a-a0ad-780ad1eb0147 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:17.418174 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-026006d5-0ac4-478a-a0ad-780ad1eb0147 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040175 Jun 20 07:14:17.418705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 463/871] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:17 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:18.393704 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fed8055e-9e5e-4518-80d6-02590104c31f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:18.394335 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fed8055e-9e5e-4518-80d6-02590104c31f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:18.401454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fed8055e-9e5e-4518-80d6-02590104c31f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:18.401908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fed8055e-9e5e-4518-80d6-02590104c31f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:18.402678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fed8055e-9e5e-4518-80d6-02590104c31f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:18.403119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fed8055e-9e5e-4518-80d6-02590104c31f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:18.465530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fed8055e-9e5e-4518-80d6-02590104c31f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:18.472900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fed8055e-9e5e-4518-80d6-02590104c31f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.083338 Jun 20 07:14:18.473453 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 464/872] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:18 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:18.477860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-60438f3e-d7a1-476f-bf19-65f53c221bfa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:18.479392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-60438f3e-d7a1-476f-bf19-65f53c221bfa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:18.484900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60438f3e-d7a1-476f-bf19-65f53c221bfa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:18.485376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60438f3e-d7a1-476f-bf19-65f53c221bfa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:18.486127 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60438f3e-d7a1-476f-bf19-65f53c221bfa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:18.486556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60438f3e-d7a1-476f-bf19-65f53c221bfa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:18.515490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-60438f3e-d7a1-476f-bf19-65f53c221bfa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041050 Jun 20 07:14:18.516039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 465/873] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:18 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:19.489987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea616141-e1c1-4cd1-b9a4-03a3c36bc509 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:19.490645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ea616141-e1c1-4cd1-b9a4-03a3c36bc509 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:19.497544 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea616141-e1c1-4cd1-b9a4-03a3c36bc509 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:19.497994 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea616141-e1c1-4cd1-b9a4-03a3c36bc509 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:19.498754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea616141-e1c1-4cd1-b9a4-03a3c36bc509 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:19.499192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea616141-e1c1-4cd1-b9a4-03a3c36bc509 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:19.559220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea616141-e1c1-4cd1-b9a4-03a3c36bc509 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:19.567177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea616141-e1c1-4cd1-b9a4-03a3c36bc509 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081056 Jun 20 07:14:19.567735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 466/874] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:19 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:19.572255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-018a8eac-81d1-4ee9-9058-2d29e13a3331 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:19.573158 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-018a8eac-81d1-4ee9-9058-2d29e13a3331 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:19.578844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-018a8eac-81d1-4ee9-9058-2d29e13a3331 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:19.579290 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-018a8eac-81d1-4ee9-9058-2d29e13a3331 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:19.580052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-018a8eac-81d1-4ee9-9058-2d29e13a3331 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:19.580545 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-018a8eac-81d1-4ee9-9058-2d29e13a3331 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:19.608809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-018a8eac-81d1-4ee9-9058-2d29e13a3331 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040064 Jun 20 07:14:19.609355 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 467/875] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:19 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:20.583561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bd386308-a1e5-4351-8c6b-00ff49e9eb37 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:20.584199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bd386308-a1e5-4351-8c6b-00ff49e9eb37 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:20.590639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd386308-a1e5-4351-8c6b-00ff49e9eb37 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:20.591087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd386308-a1e5-4351-8c6b-00ff49e9eb37 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:20.591843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd386308-a1e5-4351-8c6b-00ff49e9eb37 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:20.592313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd386308-a1e5-4351-8c6b-00ff49e9eb37 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:20.652514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bd386308-a1e5-4351-8c6b-00ff49e9eb37 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:20.659952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bd386308-a1e5-4351-8c6b-00ff49e9eb37 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080243 Jun 20 07:14:20.660541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 468/876] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:20 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:20.665030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-18861f83-546e-47b0-af74-ad119dca0fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:20.666518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-18861f83-546e-47b0-af74-ad119dca0fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:20.672351 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18861f83-546e-47b0-af74-ad119dca0fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:20.672804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18861f83-546e-47b0-af74-ad119dca0fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:20.673595 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18861f83-546e-47b0-af74-ad119dca0fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:20.674029 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18861f83-546e-47b0-af74-ad119dca0fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:20.698001 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:14:20.702856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-18861f83-546e-47b0-af74-ad119dca0fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041339 Jun 20 07:14:20.703421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 469/877] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:20 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:21.677115 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b3d6d9f7-9e11-4942-bcc6-1d61ec342d8c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:21.677784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b3d6d9f7-9e11-4942-bcc6-1d61ec342d8c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:21.684371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3d6d9f7-9e11-4942-bcc6-1d61ec342d8c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:21.684820 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3d6d9f7-9e11-4942-bcc6-1d61ec342d8c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:21.685586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3d6d9f7-9e11-4942-bcc6-1d61ec342d8c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:21.686027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3d6d9f7-9e11-4942-bcc6-1d61ec342d8c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:21.745855 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b3d6d9f7-9e11-4942-bcc6-1d61ec342d8c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:21.753598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b3d6d9f7-9e11-4942-bcc6-1d61ec342d8c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080372 Jun 20 07:14:21.754162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 470/878] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:21 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:21.758679 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f036d74c-26e3-4f7b-9469-70d1c38d86f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:21.760100 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f036d74c-26e3-4f7b-9469-70d1c38d86f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:21.766042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f036d74c-26e3-4f7b-9469-70d1c38d86f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:21.766760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f036d74c-26e3-4f7b-9469-70d1c38d86f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:21.767519 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f036d74c-26e3-4f7b-9469-70d1c38d86f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:21.767951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f036d74c-26e3-4f7b-9469-70d1c38d86f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:21.796313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f036d74c-26e3-4f7b-9469-70d1c38d86f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041148 Jun 20 07:14:21.796850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 471/879] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:21 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:22.770666 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f89908c3-d02d-4e5d-a4fb-87edb3871d74 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:22.771271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f89908c3-d02d-4e5d-a4fb-87edb3871d74 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:22.778308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f89908c3-d02d-4e5d-a4fb-87edb3871d74 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:22.778747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f89908c3-d02d-4e5d-a4fb-87edb3871d74 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:22.779498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f89908c3-d02d-4e5d-a4fb-87edb3871d74 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:22.779925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f89908c3-d02d-4e5d-a4fb-87edb3871d74 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:22.842091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f89908c3-d02d-4e5d-a4fb-87edb3871d74 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:22.849542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f89908c3-d02d-4e5d-a4fb-87edb3871d74 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082980 Jun 20 07:14:22.850110 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 472/880] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:22 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:22.854570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7f4733de-e23b-4316-8bd5-899b286095f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:22.855507 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7f4733de-e23b-4316-8bd5-899b286095f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:22.857102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:14:22.862139 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f4733de-e23b-4316-8bd5-899b286095f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:22.862585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f4733de-e23b-4316-8bd5-899b286095f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:22.863349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f4733de-e23b-4316-8bd5-899b286095f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:22.863775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f4733de-e23b-4316-8bd5-899b286095f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:22.893073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7f4733de-e23b-4316-8bd5-899b286095f1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041972 Jun 20 07:14:22.893614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 473/881] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:23.866440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-08adcc36-db17-4019-ad4d-09c019ed91b3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:23.867058 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-08adcc36-db17-4019-ad4d-09c019ed91b3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:23.874179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08adcc36-db17-4019-ad4d-09c019ed91b3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:23.874627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08adcc36-db17-4019-ad4d-09c019ed91b3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:23.875383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08adcc36-db17-4019-ad4d-09c019ed91b3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:23.875827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-08adcc36-db17-4019-ad4d-09c019ed91b3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:23.937065 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-08adcc36-db17-4019-ad4d-09c019ed91b3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:23.944546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-08adcc36-db17-4019-ad4d-09c019ed91b3 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081977 Jun 20 07:14:23.945115 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 474/882] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:23 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:23.950362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-61e96922-02c5-43d9-ab7b-ee1f1b3b0aa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:23.951267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-61e96922-02c5-43d9-ab7b-ee1f1b3b0aa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:23.957036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61e96922-02c5-43d9-ab7b-ee1f1b3b0aa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:23.957485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61e96922-02c5-43d9-ab7b-ee1f1b3b0aa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:23.958297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61e96922-02c5-43d9-ab7b-ee1f1b3b0aa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:23.958684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61e96922-02c5-43d9-ab7b-ee1f1b3b0aa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:23.986669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-61e96922-02c5-43d9-ab7b-ee1f1b3b0aa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040594 Jun 20 07:14:23.987208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 475/883] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:23 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:24.961767 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e8fd027-6f96-459d-9b51-93983d77d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:24.962942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e8fd027-6f96-459d-9b51-93983d77d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:24.969481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e8fd027-6f96-459d-9b51-93983d77d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:24.969919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e8fd027-6f96-459d-9b51-93983d77d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:24.970666 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e8fd027-6f96-459d-9b51-93983d77d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:24.971092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e8fd027-6f96-459d-9b51-93983d77d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:25.030730 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e8fd027-6f96-459d-9b51-93983d77d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:25.038073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e8fd027-6f96-459d-9b51-93983d77d7d5 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080213 Jun 20 07:14:25.038611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 476/884] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:24 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:25.043151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-211523d9-5c2e-44a1-8074-888a4313ba3e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:25.044044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-211523d9-5c2e-44a1-8074-888a4313ba3e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:25.049506 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-211523d9-5c2e-44a1-8074-888a4313ba3e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:25.049946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-211523d9-5c2e-44a1-8074-888a4313ba3e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:25.050696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-211523d9-5c2e-44a1-8074-888a4313ba3e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:25.051123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-211523d9-5c2e-44a1-8074-888a4313ba3e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:25.078871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-211523d9-5c2e-44a1-8074-888a4313ba3e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039310 Jun 20 07:14:25.079397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 477/885] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:25 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:26.054501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-581ea909-f6f1-4002-94d8-7e221b8fe834 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:26.055153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-581ea909-f6f1-4002-94d8-7e221b8fe834 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:26.062317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-581ea909-f6f1-4002-94d8-7e221b8fe834 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:26.062762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-581ea909-f6f1-4002-94d8-7e221b8fe834 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:26.063554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-581ea909-f6f1-4002-94d8-7e221b8fe834 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:26.063990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-581ea909-f6f1-4002-94d8-7e221b8fe834 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:26.123607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-581ea909-f6f1-4002-94d8-7e221b8fe834 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:26.131022 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-581ea909-f6f1-4002-94d8-7e221b8fe834 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080421 Jun 20 07:14:26.131582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 478/886] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:26 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:26.136659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-84c7fd08-b636-4a56-80b8-09e491b61141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:26.137561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-84c7fd08-b636-4a56-80b8-09e491b61141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:26.143324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84c7fd08-b636-4a56-80b8-09e491b61141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:26.143764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84c7fd08-b636-4a56-80b8-09e491b61141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:26.144545 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84c7fd08-b636-4a56-80b8-09e491b61141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:26.144976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84c7fd08-b636-4a56-80b8-09e491b61141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:26.172085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-84c7fd08-b636-4a56-80b8-09e491b61141 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039553 Jun 20 07:14:26.172639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 479/887] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:26 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:27.147506 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-39347625-c7d7-40ab-8ae9-130828258c1a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:27.148271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-39347625-c7d7-40ab-8ae9-130828258c1a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:27.155284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39347625-c7d7-40ab-8ae9-130828258c1a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:27.155795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39347625-c7d7-40ab-8ae9-130828258c1a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:27.156573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39347625-c7d7-40ab-8ae9-130828258c1a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:27.157005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39347625-c7d7-40ab-8ae9-130828258c1a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:27.218409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-39347625-c7d7-40ab-8ae9-130828258c1a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:27.225929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-39347625-c7d7-40ab-8ae9-130828258c1a tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082300 Jun 20 07:14:27.226485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 480/888] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:27 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:27.231102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2d216cde-49c4-46a6-98f8-09879c65f190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:27.232012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2d216cde-49c4-46a6-98f8-09879c65f190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:27.237884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d216cde-49c4-46a6-98f8-09879c65f190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:27.238326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d216cde-49c4-46a6-98f8-09879c65f190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:27.239086 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d216cde-49c4-46a6-98f8-09879c65f190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:27.239527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d216cde-49c4-46a6-98f8-09879c65f190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:27.269363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2d216cde-49c4-46a6-98f8-09879c65f190 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041843 Jun 20 07:14:27.269924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 481/889] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:27 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:28.250526 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-69efd830-27e2-463d-8f5a-093800a0ba7b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:28.251212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-69efd830-27e2-463d-8f5a-093800a0ba7b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:28.257657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69efd830-27e2-463d-8f5a-093800a0ba7b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:28.258098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69efd830-27e2-463d-8f5a-093800a0ba7b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:28.259501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69efd830-27e2-463d-8f5a-093800a0ba7b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:28.259937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69efd830-27e2-463d-8f5a-093800a0ba7b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:28.542728 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-69efd830-27e2-463d-8f5a-093800a0ba7b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:28.550566 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-69efd830-27e2-463d-8f5a-093800a0ba7b tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.303860 Jun 20 07:14:28.551136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 482/890] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:28 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:14:28.555685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b19cf000-2e9c-459d-ac0a-bd3c89e44a07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:28.557296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b19cf000-2e9c-459d-ac0a-bd3c89e44a07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:28.563102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b19cf000-2e9c-459d-ac0a-bd3c89e44a07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:28.563553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b19cf000-2e9c-459d-ac0a-bd3c89e44a07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:28.564345 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b19cf000-2e9c-459d-ac0a-bd3c89e44a07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:28.564781 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b19cf000-2e9c-459d-ac0a-bd3c89e44a07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:28.596014 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b19cf000-2e9c-459d-ac0a-bd3c89e44a07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043873 Jun 20 07:14:28.596821 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 483/891] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:28 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:29.568280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f191fcc5-ba05-4842-b795-f523ab3c917c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:29.568944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f191fcc5-ba05-4842-b795-f523ab3c917c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:29.575777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f191fcc5-ba05-4842-b795-f523ab3c917c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:29.576246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f191fcc5-ba05-4842-b795-f523ab3c917c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:29.577000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f191fcc5-ba05-4842-b795-f523ab3c917c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:29.577433 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f191fcc5-ba05-4842-b795-f523ab3c917c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:29.644357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f191fcc5-ba05-4842-b795-f523ab3c917c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:29.651817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f191fcc5-ba05-4842-b795-f523ab3c917c tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.087533 Jun 20 07:14:29.652403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 484/892] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:29 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:29.656838 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4401249c-721f-4adc-a0e6-c9ddb04611da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:29.657731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4401249c-721f-4adc-a0e6-c9ddb04611da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:29.663247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4401249c-721f-4adc-a0e6-c9ddb04611da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:29.663684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4401249c-721f-4adc-a0e6-c9ddb04611da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:29.664459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4401249c-721f-4adc-a0e6-c9ddb04611da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:29.664887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4401249c-721f-4adc-a0e6-c9ddb04611da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:29.692723 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4401249c-721f-4adc-a0e6-c9ddb04611da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039342 Jun 20 07:14:29.693263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 485/893] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:29 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:30.668143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d926dce7-c75c-4126-90a3-118d9fdcc616 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:30.668808 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d926dce7-c75c-4126-90a3-118d9fdcc616 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:30.675121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d926dce7-c75c-4126-90a3-118d9fdcc616 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:30.675567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d926dce7-c75c-4126-90a3-118d9fdcc616 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:30.676362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d926dce7-c75c-4126-90a3-118d9fdcc616 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:30.676798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d926dce7-c75c-4126-90a3-118d9fdcc616 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:30.694484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:14:30.738599 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d926dce7-c75c-4126-90a3-118d9fdcc616 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:30.746094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d926dce7-c75c-4126-90a3-118d9fdcc616 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082477 Jun 20 07:14:30.746660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 486/894] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:30 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:30.751263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-54907011-f29f-453f-bd20-559299295417 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:30.752220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-54907011-f29f-453f-bd20-559299295417 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:30.757906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-54907011-f29f-453f-bd20-559299295417 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:30.758356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-54907011-f29f-453f-bd20-559299295417 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:30.759644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-54907011-f29f-453f-bd20-559299295417 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:30.760075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-54907011-f29f-453f-bd20-559299295417 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:30.788170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-54907011-f29f-453f-bd20-559299295417 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040492 Jun 20 07:14:30.788708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 487/895] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:30 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:31.762756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-281caeb9-9648-46e7-b9bb-79c57dd471a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:31.763475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-281caeb9-9648-46e7-b9bb-79c57dd471a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:31.770256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-281caeb9-9648-46e7-b9bb-79c57dd471a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:31.770703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-281caeb9-9648-46e7-b9bb-79c57dd471a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:31.771461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-281caeb9-9648-46e7-b9bb-79c57dd471a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:31.771893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-281caeb9-9648-46e7-b9bb-79c57dd471a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:31.831702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-281caeb9-9648-46e7-b9bb-79c57dd471a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:31.839131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-281caeb9-9648-46e7-b9bb-79c57dd471a8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080345 Jun 20 07:14:31.839710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 488/896] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:31 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:31.844311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3857a933-51ad-4dd8-afd5-57a84f60fd73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:31.845217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3857a933-51ad-4dd8-afd5-57a84f60fd73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:31.850948 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3857a933-51ad-4dd8-afd5-57a84f60fd73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:31.851393 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3857a933-51ad-4dd8-afd5-57a84f60fd73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:31.852170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3857a933-51ad-4dd8-afd5-57a84f60fd73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:31.853145 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3857a933-51ad-4dd8-afd5-57a84f60fd73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:31.881564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3857a933-51ad-4dd8-afd5-57a84f60fd73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040851 Jun 20 07:14:31.882102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 489/897] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:31 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:32.855785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3d26eeb1-0045-4837-a3e4-4867d3237058 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:32.856426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3d26eeb1-0045-4837-a3e4-4867d3237058 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:32.862871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d26eeb1-0045-4837-a3e4-4867d3237058 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:32.863314 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d26eeb1-0045-4837-a3e4-4867d3237058 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:32.864063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d26eeb1-0045-4837-a3e4-4867d3237058 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:32.864516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d26eeb1-0045-4837-a3e4-4867d3237058 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:32.927819 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3d26eeb1-0045-4837-a3e4-4867d3237058 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:32.935654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3d26eeb1-0045-4837-a3e4-4867d3237058 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.083768 Jun 20 07:14:32.936228 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 490/898] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:32 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:32.940658 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-619005a2-c61d-4a5c-bc34-0f50e35c52ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:32.941544 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-619005a2-c61d-4a5c-bc34-0f50e35c52ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:32.947736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-619005a2-c61d-4a5c-bc34-0f50e35c52ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:32.948208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-619005a2-c61d-4a5c-bc34-0f50e35c52ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:32.948951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-619005a2-c61d-4a5c-bc34-0f50e35c52ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:32.949379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-619005a2-c61d-4a5c-bc34-0f50e35c52ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:32.976533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-619005a2-c61d-4a5c-bc34-0f50e35c52ea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039253 Jun 20 07:14:32.977001 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 491/899] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:32 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:33.952965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-da6d6d4b-5f29-4e21-8786-26c3dbdc53b7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:33.953578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-da6d6d4b-5f29-4e21-8786-26c3dbdc53b7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:33.960178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da6d6d4b-5f29-4e21-8786-26c3dbdc53b7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:33.960578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da6d6d4b-5f29-4e21-8786-26c3dbdc53b7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:33.961337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da6d6d4b-5f29-4e21-8786-26c3dbdc53b7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:33.962372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da6d6d4b-5f29-4e21-8786-26c3dbdc53b7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:34.021137 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-da6d6d4b-5f29-4e21-8786-26c3dbdc53b7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:34.029388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-da6d6d4b-5f29-4e21-8786-26c3dbdc53b7 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080265 Jun 20 07:14:34.029963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 492/900] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:33 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:34.034442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8121edf6-38f8-4d5c-8434-b8e72a1cf2fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:34.035348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8121edf6-38f8-4d5c-8434-b8e72a1cf2fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:34.040938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8121edf6-38f8-4d5c-8434-b8e72a1cf2fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:34.041397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8121edf6-38f8-4d5c-8434-b8e72a1cf2fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:34.042164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8121edf6-38f8-4d5c-8434-b8e72a1cf2fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:34.042600 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8121edf6-38f8-4d5c-8434-b8e72a1cf2fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:34.070403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8121edf6-38f8-4d5c-8434-b8e72a1cf2fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039469 Jun 20 07:14:34.070948 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 493/901] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:34 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:35.045933 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-acc5d7db-c95b-48f3-bc69-acc7457092b8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:35.046571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-acc5d7db-c95b-48f3-bc69-acc7457092b8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:35.053007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-acc5d7db-c95b-48f3-bc69-acc7457092b8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:35.053449 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-acc5d7db-c95b-48f3-bc69-acc7457092b8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:35.054196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-acc5d7db-c95b-48f3-bc69-acc7457092b8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:35.054625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-acc5d7db-c95b-48f3-bc69-acc7457092b8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:35.115277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-acc5d7db-c95b-48f3-bc69-acc7457092b8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:35.122658 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-acc5d7db-c95b-48f3-bc69-acc7457092b8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080613 Jun 20 07:14:35.123208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 494/902] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:35 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:35.127631 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b1f0fb62-eca8-45f4-bb5a-6862590b734c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:35.128548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b1f0fb62-eca8-45f4-bb5a-6862590b734c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:35.133996 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1f0fb62-eca8-45f4-bb5a-6862590b734c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:35.134433 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1f0fb62-eca8-45f4-bb5a-6862590b734c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:35.135180 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1f0fb62-eca8-45f4-bb5a-6862590b734c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:35.135636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1f0fb62-eca8-45f4-bb5a-6862590b734c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:35.164305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b1f0fb62-eca8-45f4-bb5a-6862590b734c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040089 Jun 20 07:14:35.165472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 495/903] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:35 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:36.139309 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d4bfa295-f4b1-4fb8-82f4-e9bf34f78fdb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:36.139968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d4bfa295-f4b1-4fb8-82f4-e9bf34f78fdb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:36.146762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d4bfa295-f4b1-4fb8-82f4-e9bf34f78fdb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:36.147210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d4bfa295-f4b1-4fb8-82f4-e9bf34f78fdb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:36.147974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d4bfa295-f4b1-4fb8-82f4-e9bf34f78fdb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:36.148437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d4bfa295-f4b1-4fb8-82f4-e9bf34f78fdb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:36.207603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d4bfa295-f4b1-4fb8-82f4-e9bf34f78fdb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:36.215671 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d4bfa295-f4b1-4fb8-82f4-e9bf34f78fdb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080281 Jun 20 07:14:36.216266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 496/904] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:36 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:36.220734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-be71b97b-3160-4b28-8b67-6a3e1dcaa7ef tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:36.221634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-be71b97b-3160-4b28-8b67-6a3e1dcaa7ef tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:36.227580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be71b97b-3160-4b28-8b67-6a3e1dcaa7ef tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:36.228029 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be71b97b-3160-4b28-8b67-6a3e1dcaa7ef tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:36.228828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be71b97b-3160-4b28-8b67-6a3e1dcaa7ef tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:36.229268 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be71b97b-3160-4b28-8b67-6a3e1dcaa7ef tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:36.257863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-be71b97b-3160-4b28-8b67-6a3e1dcaa7ef tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040616 Jun 20 07:14:36.258444 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 497/905] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:36 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:37.231988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-40a37a3a-69e0-453d-b003-318ec8c8dda4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:37.232692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-40a37a3a-69e0-453d-b003-318ec8c8dda4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:37.239040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40a37a3a-69e0-453d-b003-318ec8c8dda4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:37.239479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40a37a3a-69e0-453d-b003-318ec8c8dda4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:37.240258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40a37a3a-69e0-453d-b003-318ec8c8dda4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:37.240690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40a37a3a-69e0-453d-b003-318ec8c8dda4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:37.304858 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-40a37a3a-69e0-453d-b003-318ec8c8dda4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:37.312210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-40a37a3a-69e0-453d-b003-318ec8c8dda4 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.084616 Jun 20 07:14:37.312812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 498/906] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:37 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:37.317328 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-84102d8d-f1a8-470c-9630-cfe873d7a9d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:37.318220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-84102d8d-f1a8-470c-9630-cfe873d7a9d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:37.323752 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84102d8d-f1a8-470c-9630-cfe873d7a9d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:37.324218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84102d8d-f1a8-470c-9630-cfe873d7a9d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:37.324966 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84102d8d-f1a8-470c-9630-cfe873d7a9d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:37.325395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84102d8d-f1a8-470c-9630-cfe873d7a9d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:37.354142 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-84102d8d-f1a8-470c-9630-cfe873d7a9d9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040367 Jun 20 07:14:37.354667 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 499/907] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:37 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:38.328827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-68667acc-8574-45d8-8ff5-76e6c24ff12f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:38.329504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-68667acc-8574-45d8-8ff5-76e6c24ff12f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:38.335913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68667acc-8574-45d8-8ff5-76e6c24ff12f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:38.336395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68667acc-8574-45d8-8ff5-76e6c24ff12f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:38.337808 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68667acc-8574-45d8-8ff5-76e6c24ff12f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:38.338244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68667acc-8574-45d8-8ff5-76e6c24ff12f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:38.397394 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68667acc-8574-45d8-8ff5-76e6c24ff12f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:38.405241 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-68667acc-8574-45d8-8ff5-76e6c24ff12f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080278 Jun 20 07:14:38.405804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 500/908] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:38 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:38.410300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6456b868-0f47-463e-b7a5-dee49d704fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:38.411204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6456b868-0f47-463e-b7a5-dee49d704fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:38.416755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6456b868-0f47-463e-b7a5-dee49d704fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:38.417206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6456b868-0f47-463e-b7a5-dee49d704fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:38.417968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6456b868-0f47-463e-b7a5-dee49d704fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:38.418407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6456b868-0f47-463e-b7a5-dee49d704fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:38.445941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6456b868-0f47-463e-b7a5-dee49d704fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039124 Jun 20 07:14:38.446484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 501/909] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:38 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:38.912818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-c82fc237-b951-4462-b40c-bbfd797e3473 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'services' on Instance uuid b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:14:39.422503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b8a63ea1-d960-44bf-80af-8a24d6bcddfb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:39.423121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b8a63ea1-d960-44bf-80af-8a24d6bcddfb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:39.429609 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8a63ea1-d960-44bf-80af-8a24d6bcddfb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:39.430063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8a63ea1-d960-44bf-80af-8a24d6bcddfb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:39.430819 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8a63ea1-d960-44bf-80af-8a24d6bcddfb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:39.431257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b8a63ea1-d960-44bf-80af-8a24d6bcddfb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:39.490572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b8a63ea1-d960-44bf-80af-8a24d6bcddfb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:39.498027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b8a63ea1-d960-44bf-80af-8a24d6bcddfb tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.079437 Jun 20 07:14:39.498584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 502/910] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:39 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:39.503044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e6d44404-0f90-4c43-9f5d-d03f81496f25 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:39.503942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e6d44404-0f90-4c43-9f5d-d03f81496f25 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:39.509466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6d44404-0f90-4c43-9f5d-d03f81496f25 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:39.509915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6d44404-0f90-4c43-9f5d-d03f81496f25 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:39.510701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6d44404-0f90-4c43-9f5d-d03f81496f25 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:39.511138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6d44404-0f90-4c43-9f5d-d03f81496f25 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:39.514657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:14:39.539668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e6d44404-0f90-4c43-9f5d-d03f81496f25 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040114 Jun 20 07:14:39.540396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 503/911] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:39 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:40.514517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a08f4b8e-536b-4816-b2d8-1ffcd249fd43 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:40.515140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a08f4b8e-536b-4816-b2d8-1ffcd249fd43 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:40.521899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a08f4b8e-536b-4816-b2d8-1ffcd249fd43 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:40.522342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a08f4b8e-536b-4816-b2d8-1ffcd249fd43 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:40.523097 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a08f4b8e-536b-4816-b2d8-1ffcd249fd43 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:40.523530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a08f4b8e-536b-4816-b2d8-1ffcd249fd43 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:40.583266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a08f4b8e-536b-4816-b2d8-1ffcd249fd43 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:40.590954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a08f4b8e-536b-4816-b2d8-1ffcd249fd43 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080273 Jun 20 07:14:40.591524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 504/912] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:40 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:40.596026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-166a4338-4328-468e-9d18-c7e9bdf2a93f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:40.596972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-166a4338-4328-468e-9d18-c7e9bdf2a93f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:40.602672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-166a4338-4328-468e-9d18-c7e9bdf2a93f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:40.603150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-166a4338-4328-468e-9d18-c7e9bdf2a93f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:40.604480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-166a4338-4328-468e-9d18-c7e9bdf2a93f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:40.604912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-166a4338-4328-468e-9d18-c7e9bdf2a93f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:40.633236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-166a4338-4328-468e-9d18-c7e9bdf2a93f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040737 Jun 20 07:14:40.633777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 505/913] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:40 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:41.606770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c5389e3f-21ae-4b37-b098-6decb48e6cfd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:41.607436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c5389e3f-21ae-4b37-b098-6decb48e6cfd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:41.614664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5389e3f-21ae-4b37-b098-6decb48e6cfd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:41.615114 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5389e3f-21ae-4b37-b098-6decb48e6cfd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:41.615900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5389e3f-21ae-4b37-b098-6decb48e6cfd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:41.616362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5389e3f-21ae-4b37-b098-6decb48e6cfd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:41.683751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c5389e3f-21ae-4b37-b098-6decb48e6cfd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:41.691219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c5389e3f-21ae-4b37-b098-6decb48e6cfd tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.088290 Jun 20 07:14:41.691788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 506/914] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:41 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:41.696388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a75e15bf-b1a0-4e83-866b-11112cea7eaf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:41.697297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a75e15bf-b1a0-4e83-866b-11112cea7eaf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:41.703763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a75e15bf-b1a0-4e83-866b-11112cea7eaf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:41.704233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a75e15bf-b1a0-4e83-866b-11112cea7eaf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:41.705002 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a75e15bf-b1a0-4e83-866b-11112cea7eaf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:41.705436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a75e15bf-b1a0-4e83-866b-11112cea7eaf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:41.733396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a75e15bf-b1a0-4e83-866b-11112cea7eaf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040606 Jun 20 07:14:41.733943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 507/915] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:41 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:42.708575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cc75f355-107f-4e2a-bda4-df0b16266693 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:42.709197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cc75f355-107f-4e2a-bda4-df0b16266693 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:42.716279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc75f355-107f-4e2a-bda4-df0b16266693 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:42.716732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc75f355-107f-4e2a-bda4-df0b16266693 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:42.717499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc75f355-107f-4e2a-bda4-df0b16266693 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:42.717939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc75f355-107f-4e2a-bda4-df0b16266693 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:42.778323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cc75f355-107f-4e2a-bda4-df0b16266693 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:42.785722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cc75f355-107f-4e2a-bda4-df0b16266693 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081125 Jun 20 07:14:42.786284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 508/916] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:42 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:42.790774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac3eaefe-5032-455d-8596-fd9fc950ff04 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:42.791681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ac3eaefe-5032-455d-8596-fd9fc950ff04 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:42.797200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac3eaefe-5032-455d-8596-fd9fc950ff04 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:42.797644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac3eaefe-5032-455d-8596-fd9fc950ff04 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:42.798411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac3eaefe-5032-455d-8596-fd9fc950ff04 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:42.798847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac3eaefe-5032-455d-8596-fd9fc950ff04 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:42.827054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ac3eaefe-5032-455d-8596-fd9fc950ff04 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039604 Jun 20 07:14:42.827594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 509/917] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:43.802295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6746698e-e489-4f12-9fbf-7721be0958a1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:43.802898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6746698e-e489-4f12-9fbf-7721be0958a1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:43.809361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6746698e-e489-4f12-9fbf-7721be0958a1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:43.809804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6746698e-e489-4f12-9fbf-7721be0958a1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:43.810586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6746698e-e489-4f12-9fbf-7721be0958a1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:43.811013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6746698e-e489-4f12-9fbf-7721be0958a1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:43.871274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6746698e-e489-4f12-9fbf-7721be0958a1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:14:43.878805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6746698e-e489-4f12-9fbf-7721be0958a1 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080411 Jun 20 07:14:43.879439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 510/918] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:14:43 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:14:43.884301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-78d9609b-82a6-4b22-804c-3fcb7022d3fe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:43.885888 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-78d9609b-82a6-4b22-804c-3fcb7022d3fe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:43.891701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78d9609b-82a6-4b22-804c-3fcb7022d3fe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:43.892252 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78d9609b-82a6-4b22-804c-3fcb7022d3fe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:43.893003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78d9609b-82a6-4b22-804c-3fcb7022d3fe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:43.893432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78d9609b-82a6-4b22-804c-3fcb7022d3fe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:43.921425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-78d9609b-82a6-4b22-804c-3fcb7022d3fe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040988 Jun 20 07:14:43.921967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 511/919] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:14:43 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:14:44.674961 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-04384c92-35a6-48c2-8377-4ed2d7abd3ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:14:44.675487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-04384c92-35a6-48c2-8377-4ed2d7abd3ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:14:44.681627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04384c92-35a6-48c2-8377-4ed2d7abd3ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:44.682591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04384c92-35a6-48c2-8377-4ed2d7abd3ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:44.683384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04384c92-35a6-48c2-8377-4ed2d7abd3ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:14:44.683821 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-04384c92-35a6-48c2-8377-4ed2d7abd3ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:14:48.917242 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:14:54.679233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=79 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:14:54.702279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:15:32.748265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:15:32.748798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:15:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac (ip 10.222.0.23) !!! Jun 20 07:15:44.678001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c82fc237-b951-4462-b40c-bbfd797e3473 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac" status: 202 len: 0 microversion: 2.1 time: 120.067358 Jun 20 07:15:44.678726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 409/920] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:13:44 2022] DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac => generated 0 bytes in 120069 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:15:44.684741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-08842cd6-a422-4a18-97bf-b87399a1cd9e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:15:44.685483 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-08842cd6-a422-4a18-97bf-b87399a1cd9e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:15:44.694015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08842cd6-a422-4a18-97bf-b87399a1cd9e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:15:44.694474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08842cd6-a422-4a18-97bf-b87399a1cd9e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:15:44.695258 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08842cd6-a422-4a18-97bf-b87399a1cd9e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:15:44.695697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08842cd6-a422-4a18-97bf-b87399a1cd9e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:15:44.764012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-08842cd6-a422-4a18-97bf-b87399a1cd9e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:15:44.771780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-08842cd6-a422-4a18-97bf-b87399a1cd9e tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.092058 Jun 20 07:15:44.772394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 410/921] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:15:44 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:15:44.777028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5f53de07-3ef1-441a-b65e-85e2c4d804a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:15:44.777945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5f53de07-3ef1-441a-b65e-85e2c4d804a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:15:44.784358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f53de07-3ef1-441a-b65e-85e2c4d804a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:15:44.784812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f53de07-3ef1-441a-b65e-85e2c4d804a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:15:44.785584 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f53de07-3ef1-441a-b65e-85e2c4d804a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:15:44.786030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f53de07-3ef1-441a-b65e-85e2c4d804a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:15:44.814923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5f53de07-3ef1-441a-b65e-85e2c4d804a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041524 Jun 20 07:15:44.815501 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 411/922] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:15:44 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:15:44.820028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bbd1f8cc-2951-40e5-a9f7-15143e57d642 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:15:44.820547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bbd1f8cc-2951-40e5-a9f7-15143e57d642 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:15:44.826749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbd1f8cc-2951-40e5-a9f7-15143e57d642 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:15:44.827210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbd1f8cc-2951-40e5-a9f7-15143e57d642 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:15:44.828613 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbd1f8cc-2951-40e5-a9f7-15143e57d642 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:15:44.829060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbd1f8cc-2951-40e5-a9f7-15143e57d642 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:15:44.834385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-04384c92-35a6-48c2-8377-4ed2d7abd3ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'services' on Instance uuid b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:15:54.137668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:15:54.138279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:15:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac (ip 10.222.0.23) !!! Jun 20 07:15:54.826590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:15:54.839027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:15:54.846700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:16:39.065773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-04384c92-35a6-48c2-8377-4ed2d7abd3ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-330086c9-3149-468d-90de-65d5dde435b1) Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-04384c92-35a6-48c2-8377-4ed2d7abd3ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Request method failure captured: Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac HTTP/1.1 Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisBydWR9hXTdRdgEMgIPM-1lAL620VtySsJQPtX3E4eETT6X1pqkxCAdBrQ05QM3sLf2M6w4suLslwDczM450U7T03NmXju7Tum6YsJN5wR3uh9QywM_y5Z98mk3Ttcwbp4tjIhwIlNWuRc740_x69DYuTSos87GlveyHMBK04lJyYJs Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:16:39.069057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:16:39.071273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:16:39.071273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:16:39.071273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:16:39.071273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:16:39.071273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:16:39.071273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:16:39.071273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:16:39.071273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: af0dee4e1dfb4f879dfe41622a9e23b1 Jun 20 07:16:39.071273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:16:39.071273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-330086c9-3149-468d-90de-65d5dde435b1) Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'server_id': 'b2be05cc-d645-4d3b-9fcb-dbacd92e2f75', 'id': '14acc9ca-9ac6-446e-b502-951bbf9876ac'} Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:16:39.072426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-330086c9-3149-468d-90de-65d5dde435b1) Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:16:39.075033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-330086c9-3149-468d-90de-65d5dde435b1) Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:16:39.080614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-330086c9-3149-468d-90de-65d5dde435b1) Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:16:39.082209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-330086c9-3149-468d-90de-65d5dde435b1) Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-330086c9-3149-468d-90de-65d5dde435b1) Jun 20 07:16:39.083553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:16:39.084822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-04384c92-35a6-48c2-8377-4ed2d7abd3ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-330086c9-3149-468d-90de-65d5dde435b1) {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:16:39.084822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-04384c92-35a6-48c2-8377-4ed2d7abd3ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac" status: 400 len: 269 microversion: 2.1 time: 114.400291 Jun 20 07:16:39.084822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 512/923] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:14:44 2022] DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac => generated 269 bytes in 114402 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 07:16:39.084822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0cb466d1-de14-43c7-96b9-f90c947a7220 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:39.085181 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0cb466d1-de14-43c7-96b9-f90c947a7220 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:39.086455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cb466d1-de14-43c7-96b9-f90c947a7220 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:39.086927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cb466d1-de14-43c7-96b9-f90c947a7220 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:39.087702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cb466d1-de14-43c7-96b9-f90c947a7220 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:39.088163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cb466d1-de14-43c7-96b9-f90c947a7220 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:39.121244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-bbd1f8cc-2951-40e5-a9f7-15143e57d642 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'services' on Instance uuid b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:16:39.151247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0cb466d1-de14-43c7-96b9-f90c947a7220 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:16:39.158767 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0cb466d1-de14-43c7-96b9-f90c947a7220 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.084842 Jun 20 07:16:39.159390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 513/924] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:16:39 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:16:39.164165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9b865535-7ba5-477f-a60d-2902a242401b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:39.165133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9b865535-7ba5-477f-a60d-2902a242401b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:39.170958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b865535-7ba5-477f-a60d-2902a242401b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:39.171413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b865535-7ba5-477f-a60d-2902a242401b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:39.172209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b865535-7ba5-477f-a60d-2902a242401b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:39.172651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b865535-7ba5-477f-a60d-2902a242401b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:39.201256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9b865535-7ba5-477f-a60d-2902a242401b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040692 Jun 20 07:16:39.203809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 514/925] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:16:39 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:16:40.175239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c7b607f9-3fe9-4b5c-98de-76a9063f9135 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:40.175928 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c7b607f9-3fe9-4b5c-98de-76a9063f9135 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:40.182423 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7b607f9-3fe9-4b5c-98de-76a9063f9135 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:40.182871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7b607f9-3fe9-4b5c-98de-76a9063f9135 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:40.183635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7b607f9-3fe9-4b5c-98de-76a9063f9135 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:40.184072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7b607f9-3fe9-4b5c-98de-76a9063f9135 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:40.246068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c7b607f9-3fe9-4b5c-98de-76a9063f9135 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:16:40.253826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c7b607f9-3fe9-4b5c-98de-76a9063f9135 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.082500 Jun 20 07:16:40.254395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 515/926] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:16:40 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:16:40.259071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d984f1ed-9086-48e4-9e45-24132ca9697a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:40.260013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d984f1ed-9086-48e4-9e45-24132ca9697a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:40.266187 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d984f1ed-9086-48e4-9e45-24132ca9697a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:40.266639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d984f1ed-9086-48e4-9e45-24132ca9697a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:40.267407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d984f1ed-9086-48e4-9e45-24132ca9697a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:40.267838 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d984f1ed-9086-48e4-9e45-24132ca9697a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:40.299169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d984f1ed-9086-48e4-9e45-24132ca9697a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043739 Jun 20 07:16:40.299741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 516/927] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:16:40 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:16:41.272560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0599f58b-45e6-464a-9ab4-541ce8af7f2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:41.273203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0599f58b-45e6-464a-9ab4-541ce8af7f2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:41.279555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0599f58b-45e6-464a-9ab4-541ce8af7f2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:41.280002 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0599f58b-45e6-464a-9ab4-541ce8af7f2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:41.280792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0599f58b-45e6-464a-9ab4-541ce8af7f2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:41.281255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0599f58b-45e6-464a-9ab4-541ce8af7f2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:41.344692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0599f58b-45e6-464a-9ab4-541ce8af7f2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:16:41.352845 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0599f58b-45e6-464a-9ab4-541ce8af7f2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.084185 Jun 20 07:16:41.353403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 517/928] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:16:41 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:16:41.357853 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9bdefec8-3ed8-4b15-86ad-4deb30f63469 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:41.358748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9bdefec8-3ed8-4b15-86ad-4deb30f63469 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:41.364327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bdefec8-3ed8-4b15-86ad-4deb30f63469 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:41.364772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bdefec8-3ed8-4b15-86ad-4deb30f63469 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:41.365527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bdefec8-3ed8-4b15-86ad-4deb30f63469 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:41.365961 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bdefec8-3ed8-4b15-86ad-4deb30f63469 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:41.394570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9bdefec8-3ed8-4b15-86ad-4deb30f63469 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040201 Jun 20 07:16:41.395107 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 518/929] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:16:41 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:16:42.369417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-09fb76d9-9dc2-4a8d-a0d5-b1bd40ef1428 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:42.370049 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-09fb76d9-9dc2-4a8d-a0d5-b1bd40ef1428 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:42.376512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09fb76d9-9dc2-4a8d-a0d5-b1bd40ef1428 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:42.376954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09fb76d9-9dc2-4a8d-a0d5-b1bd40ef1428 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:42.377702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09fb76d9-9dc2-4a8d-a0d5-b1bd40ef1428 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:42.378129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09fb76d9-9dc2-4a8d-a0d5-b1bd40ef1428 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:42.438399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-09fb76d9-9dc2-4a8d-a0d5-b1bd40ef1428 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:16:42.445856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-09fb76d9-9dc2-4a8d-a0d5-b1bd40ef1428 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.080272 Jun 20 07:16:42.446415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 519/930] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:16:42 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:16:42.450905 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-17b932c7-eaef-4b00-a420-3d139abdf7a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:42.451800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-17b932c7-eaef-4b00-a420-3d139abdf7a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:42.457328 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17b932c7-eaef-4b00-a420-3d139abdf7a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:42.457766 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17b932c7-eaef-4b00-a420-3d139abdf7a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:42.458515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17b932c7-eaef-4b00-a420-3d139abdf7a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:42.458942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17b932c7-eaef-4b00-a420-3d139abdf7a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:42.487434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-17b932c7-eaef-4b00-a420-3d139abdf7a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040014 Jun 20 07:16:42.487965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 520/931] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:16:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:16:43.462505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e8967e93-477e-406f-a5c4-f821649ee860 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:43.463136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e8967e93-477e-406f-a5c4-f821649ee860 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:43.470789 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8967e93-477e-406f-a5c4-f821649ee860 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:43.471233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8967e93-477e-406f-a5c4-f821649ee860 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:43.472216 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8967e93-477e-406f-a5c4-f821649ee860 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:43.472649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8967e93-477e-406f-a5c4-f821649ee860 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:43.535863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e8967e93-477e-406f-a5c4-f821649ee860 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:16:43.543895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e8967e93-477e-406f-a5c4-f821649ee860 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.085326 Jun 20 07:16:43.544488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 521/932] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:16:43 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:16:43.549023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c4438c8c-da0d-4b3b-9296-44c04319cdd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:43.549926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c4438c8c-da0d-4b3b-9296-44c04319cdd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:43.556076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4438c8c-da0d-4b3b-9296-44c04319cdd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:43.556555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4438c8c-da0d-4b3b-9296-44c04319cdd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:43.557317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4438c8c-da0d-4b3b-9296-44c04319cdd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:43.557758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4438c8c-da0d-4b3b-9296-44c04319cdd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:43.586042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c4438c8c-da0d-4b3b-9296-44c04319cdd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040567 Jun 20 07:16:43.586592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 522/933] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:16:43 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:16:44.560476 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7b8d4305-b877-44ec-87e7-69655b64e9f8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:44.561140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7b8d4305-b877-44ec-87e7-69655b64e9f8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:44.567511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b8d4305-b877-44ec-87e7-69655b64e9f8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:44.567960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b8d4305-b877-44ec-87e7-69655b64e9f8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:44.568755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b8d4305-b877-44ec-87e7-69655b64e9f8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:44.569189 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b8d4305-b877-44ec-87e7-69655b64e9f8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:44.629846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b8d4305-b877-44ec-87e7-69655b64e9f8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:16:44.637928 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7b8d4305-b877-44ec-87e7-69655b64e9f8 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081290 Jun 20 07:16:44.638494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 523/934] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:16:44 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:16:44.643249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-679dffa2-8eef-40cb-9f0e-0e8ae67a20f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:44.644178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-679dffa2-8eef-40cb-9f0e-0e8ae67a20f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:44.649740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-679dffa2-8eef-40cb-9f0e-0e8ae67a20f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:44.650194 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-679dffa2-8eef-40cb-9f0e-0e8ae67a20f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:44.650957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-679dffa2-8eef-40cb-9f0e-0e8ae67a20f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:44.651402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-679dffa2-8eef-40cb-9f0e-0e8ae67a20f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:44.681121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-679dffa2-8eef-40cb-9f0e-0e8ae67a20f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041663 Jun 20 07:16:44.681666 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 524/935] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:16:44 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:16:44.796388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c8124477-50fb-4486-b20a-7d192ed08b31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:16:44.796886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c8124477-50fb-4486-b20a-7d192ed08b31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:16:44.803009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8124477-50fb-4486-b20a-7d192ed08b31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:44.803483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8124477-50fb-4486-b20a-7d192ed08b31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:44.804782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8124477-50fb-4486-b20a-7d192ed08b31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:16:44.805214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8124477-50fb-4486-b20a-7d192ed08b31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:16:49.126409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:16:54.800868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=26 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:16:54.823136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=76 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:17:05.078753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:17:05.079458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac (ip 10.222.0.23) !!! Jun 20 07:17:05.583080 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:17:05.583657 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac (ip 10.222.0.23) !!! Jun 20 07:17:12.528849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:17:12.529516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:17:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac (ip 10.222.0.23) !!! Jun 20 07:17:45.146991 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-bbd1f8cc-2951-40e5-a9f7-15143e57d642 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb3a52c9-7fd4-47a0-a494-153e2cc1acbd) Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bbd1f8cc-2951-40e5-a9f7-15143e57d642 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Request method failure captured: Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac HTTP/1.1 Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisBydWR9hXTdRdgEMgIPM-1lAL620VtySsJQPtX3E4eETT6X1pqkxCAdBrQ05QM3sLf2M6w4suLslwDczM450U7T03NmXju7Tum6YsJN5wR3uh9QywM_y5Z98mk3Ttcwbp4tjIhwIlNWuRc740_x69DYuTSos87GlveyHMBK04lJyYJs Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:17:45.149316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:17:45.151284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:17:45.151284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:17:45.151284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:17:45.151284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:17:45.151284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:17:45.151284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:17:45.151284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:17:45.151284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: af0dee4e1dfb4f879dfe41622a9e23b1 Jun 20 07:17:45.151284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:17:45.151284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb3a52c9-7fd4-47a0-a494-153e2cc1acbd) Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'server_id': 'b2be05cc-d645-4d3b-9fcb-dbacd92e2f75', 'id': '14acc9ca-9ac6-446e-b502-951bbf9876ac'} Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:17:45.151927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb3a52c9-7fd4-47a0-a494-153e2cc1acbd) Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:17:45.153374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb3a52c9-7fd4-47a0-a494-153e2cc1acbd) Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:17:45.154721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb3a52c9-7fd4-47a0-a494-153e2cc1acbd) Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:17:45.156006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb3a52c9-7fd4-47a0-a494-153e2cc1acbd) Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb3a52c9-7fd4-47a0-a494-153e2cc1acbd) Jun 20 07:17:45.157369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:17:45.158990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bbd1f8cc-2951-40e5-a9f7-15143e57d642 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb3a52c9-7fd4-47a0-a494-153e2cc1acbd) {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:17:45.158990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bbd1f8cc-2951-40e5-a9f7-15143e57d642 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac" status: 400 len: 269 microversion: 2.1 time: 120.334831 Jun 20 07:17:45.158990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 412/936] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:15:44 2022] DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac => generated 269 bytes in 120336 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:17:45.158990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f6e7ca1-2191-4082-9316-ec3c1e4c5d24 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:17:45.159350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8f6e7ca1-2191-4082-9316-ec3c1e4c5d24 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:17:45.164836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f6e7ca1-2191-4082-9316-ec3c1e4c5d24 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:17:45.165998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f6e7ca1-2191-4082-9316-ec3c1e4c5d24 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:17:45.166721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f6e7ca1-2191-4082-9316-ec3c1e4c5d24 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:17:45.167151 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f6e7ca1-2191-4082-9316-ec3c1e4c5d24 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:17:45.228596 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8f6e7ca1-2191-4082-9316-ec3c1e4c5d24 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:17:45.236025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8f6e7ca1-2191-4082-9316-ec3c1e4c5d24 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.083294 Jun 20 07:17:45.236626 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 413/937] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:17:45 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:17:45.320630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7ca6a36-cdb6-4dd8-983c-79ab989890e2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:17:45.322160 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7ca6a36-cdb6-4dd8-983c-79ab989890e2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:17:45.328425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ca6a36-cdb6-4dd8-983c-79ab989890e2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:17:45.328879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ca6a36-cdb6-4dd8-983c-79ab989890e2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:17:45.329653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ca6a36-cdb6-4dd8-983c-79ab989890e2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:17:45.330090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ca6a36-cdb6-4dd8-983c-79ab989890e2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:17:45.359888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7ca6a36-cdb6-4dd8-983c-79ab989890e2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122233 Jun 20 07:17:45.360490 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 414/938] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 07:17:45 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:17:45.365259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c0fe47a0-1ea0-4715-ba79-9e18b0d3bf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:17:45.365755 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c0fe47a0-1ea0-4715-ba79-9e18b0d3bf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:17:45.372296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c0fe47a0-1ea0-4715-ba79-9e18b0d3bf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:17:45.372753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c0fe47a0-1ea0-4715-ba79-9e18b0d3bf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:17:45.373521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c0fe47a0-1ea0-4715-ba79-9e18b0d3bf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:17:45.373960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c0fe47a0-1ea0-4715-ba79-9e18b0d3bf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:17:45.462809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-c8124477-50fb-4486-b20a-7d192ed08b31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'services' on Instance uuid b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:17:55.369158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:17:55.394212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=16 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:17:55.466982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:18:39.291720 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-c0fe47a0-1ea0-4715-ba79-9e18b0d3bf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'services' on Instance uuid b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:18:39.318732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-c8124477-50fb-4486-b20a-7d192ed08b31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59cc6539-5b1f-4932-b54b-db4fd3ea7471) Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c8124477-50fb-4486-b20a-7d192ed08b31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Request method failure captured: Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac HTTP/1.1 Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisBydWR9hXTdRdgEMgIPM-1lAL620VtySsJQPtX3E4eETT6X1pqkxCAdBrQ05QM3sLf2M6w4suLslwDczM450U7T03NmXju7Tum6YsJN5wR3uh9QywM_y5Z98mk3Ttcwbp4tjIhwIlNWuRc740_x69DYuTSos87GlveyHMBK04lJyYJs Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:18:39.321431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:18:39.323073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:18:39.323073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:18:39.323073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:18:39.323073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:18:39.323073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:18:39.323073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:18:39.323073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:18:39.323073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: af0dee4e1dfb4f879dfe41622a9e23b1 Jun 20 07:18:39.323073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:18:39.323073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59cc6539-5b1f-4932-b54b-db4fd3ea7471) Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'server_id': 'b2be05cc-d645-4d3b-9fcb-dbacd92e2f75', 'id': '14acc9ca-9ac6-446e-b502-951bbf9876ac'} Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:18:39.324202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59cc6539-5b1f-4932-b54b-db4fd3ea7471) Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:18:39.327380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59cc6539-5b1f-4932-b54b-db4fd3ea7471) Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:18:39.328839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59cc6539-5b1f-4932-b54b-db4fd3ea7471) Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:18:39.330069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59cc6539-5b1f-4932-b54b-db4fd3ea7471) Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59cc6539-5b1f-4932-b54b-db4fd3ea7471) Jun 20 07:18:39.331425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:18:39.332743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c8124477-50fb-4486-b20a-7d192ed08b31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59cc6539-5b1f-4932-b54b-db4fd3ea7471) {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:18:39.332743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c8124477-50fb-4486-b20a-7d192ed08b31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac" status: 400 len: 269 microversion: 2.1 time: 114.530476 Jun 20 07:18:39.332743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 525/939] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:16:44 2022] DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac => generated 269 bytes in 114532 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 07:18:39.332743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e74bfaac-9eae-476a-815c-8e2093be2c14 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:18:39.333100 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e74bfaac-9eae-476a-815c-8e2093be2c14 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:18:39.337719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e74bfaac-9eae-476a-815c-8e2093be2c14 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:18:39.338169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e74bfaac-9eae-476a-815c-8e2093be2c14 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:18:39.338932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e74bfaac-9eae-476a-815c-8e2093be2c14 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:18:39.339370 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e74bfaac-9eae-476a-815c-8e2093be2c14 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:18:39.363266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e74bfaac-9eae-476a-815c-8e2093be2c14 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:18:39.437052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e74bfaac-9eae-476a-815c-8e2093be2c14 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 204 len: 0 microversion: 2.1 time: 0.112229 Jun 20 07:18:39.437743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 526/940] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:18:39 2022] DELETE /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:18:39.443528 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a5906863-127b-4b09-b3a9-124a288afc83 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:18:39.444229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a5906863-127b-4b09-b3a9-124a288afc83 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:18:39.451492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5906863-127b-4b09-b3a9-124a288afc83 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:18:39.451932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5906863-127b-4b09-b3a9-124a288afc83 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:18:39.452718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5906863-127b-4b09-b3a9-124a288afc83 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:18:39.453147 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5906863-127b-4b09-b3a9-124a288afc83 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:18:49.296030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:18:49.449527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:18:49.471487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:18:52.756208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:18:52.757259 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:18:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204 (ip 10.222.0.23) !!! Jun 20 07:19:45.611549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-c0fe47a0-1ea0-4715-ba79-9e18b0d3bf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91472c29-389e-4ca3-a488-8d75467dfd94) Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c0fe47a0-1ea0-4715-ba79-9e18b0d3bf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Request method failure captured: Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac HTTP/1.1 Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisBydWR9hXTdRdgEMgIPM-1lAL620VtySsJQPtX3E4eETT6X1pqkxCAdBrQ05QM3sLf2M6w4suLslwDczM450U7T03NmXju7Tum6YsJN5wR3uh9QywM_y5Z98mk3Ttcwbp4tjIhwIlNWuRc740_x69DYuTSos87GlveyHMBK04lJyYJs Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:19:45.613713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:19:45.615330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:19:45.615330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:19:45.615330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:19:45.615330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:19:45.615330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:19:45.615330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:19:45.615330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:19:45.615330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: af0dee4e1dfb4f879dfe41622a9e23b1 Jun 20 07:19:45.615330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:19:45.615330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91472c29-389e-4ca3-a488-8d75467dfd94) Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'server_id': 'b2be05cc-d645-4d3b-9fcb-dbacd92e2f75', 'id': '14acc9ca-9ac6-446e-b502-951bbf9876ac'} Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:19:45.616689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91472c29-389e-4ca3-a488-8d75467dfd94) Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:19:45.617750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91472c29-389e-4ca3-a488-8d75467dfd94) Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:19:45.619320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91472c29-389e-4ca3-a488-8d75467dfd94) Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:19:45.620393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91472c29-389e-4ca3-a488-8d75467dfd94) Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91472c29-389e-4ca3-a488-8d75467dfd94) Jun 20 07:19:45.621562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.622668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c0fe47a0-1ea0-4715-ba79-9e18b0d3bf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91472c29-389e-4ca3-a488-8d75467dfd94) {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:19:45.622668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c0fe47a0-1ea0-4715-ba79-9e18b0d3bf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac" status: 400 len: 269 microversion: 2.1 time: 120.253707 Jun 20 07:19:45.622668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 415/941] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:17:45 2022] DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac => generated 269 bytes in 120255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:19:45.730885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b3e1163-eda1-4895-844a-301cd4f7b331 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:19:45.731665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b3e1163-eda1-4895-844a-301cd4f7b331 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:19:45.737675 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b3e1163-eda1-4895-844a-301cd4f7b331 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:19:45.738124 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b3e1163-eda1-4895-844a-301cd4f7b331 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:19:45.738883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b3e1163-eda1-4895-844a-301cd4f7b331 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:19:45.739369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b3e1163-eda1-4895-844a-301cd4f7b331 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:19:45.741541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-a5906863-127b-4b09-b3a9-124a288afc83 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lazy-loading 'services' on Instance uuid ec0ea04e-5c9f-4536-b200-1eaf64edef9c {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:19:45.802063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b3e1163-eda1-4895-844a-301cd4f7b331 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:19:45.810435 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b3e1163-eda1-4895-844a-301cd4f7b331 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.192756 Jun 20 07:19:45.811024 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 416/942] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:19:45 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:19:45.815530 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c8e38dc3-00d6-4c06-b92b-03c44bb2595a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:19:45.816549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c8e38dc3-00d6-4c06-b92b-03c44bb2595a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:19:45.822688 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8e38dc3-00d6-4c06-b92b-03c44bb2595a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:19:45.823075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8e38dc3-00d6-4c06-b92b-03c44bb2595a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:19:45.823817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8e38dc3-00d6-4c06-b92b-03c44bb2595a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:19:45.824358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c8e38dc3-00d6-4c06-b92b-03c44bb2595a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:19:45.899124 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c8e38dc3-00d6-4c06-b92b-03c44bb2595a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "POST /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/action" status: 200 len: 37672 microversion: 2.20 time: 0.086897 Jun 20 07:19:45.899757 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 417/943] 10.222.0.23 () {62 vars in 1318 bytes} [Mon Jun 20 07:19:45 2022] POST /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42/action => generated 37672 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:19:45.904809 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9df74a30-f881-4d71-8c95-fe9f8bfe9106 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:19:45.905786 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9df74a30-f881-4d71-8c95-fe9f8bfe9106 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:19:45.912553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9df74a30-f881-4d71-8c95-fe9f8bfe9106 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:19:45.912996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9df74a30-f881-4d71-8c95-fe9f8bfe9106 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:19:45.913762 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9df74a30-f881-4d71-8c95-fe9f8bfe9106 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:19:45.914191 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9df74a30-f881-4d71-8c95-fe9f8bfe9106 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:19:45.943018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9df74a30-f881-4d71-8c95-fe9f8bfe9106 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042122 Jun 20 07:19:45.943543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 418/944] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:19:45 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:19:45.948248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe511280-a983-4bf6-a68b-5d70b6ad5dd2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:19:45.948836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe511280-a983-4bf6-a68b-5d70b6ad5dd2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:19:45.954476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe511280-a983-4bf6-a68b-5d70b6ad5dd2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:19:45.954916 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe511280-a983-4bf6-a68b-5d70b6ad5dd2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:19:45.955652 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe511280-a983-4bf6-a68b-5d70b6ad5dd2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:19:45.956080 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe511280-a983-4bf6-a68b-5d70b6ad5dd2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:19:45.968468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-fe511280-a983-4bf6-a68b-5d70b6ad5dd2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe511280-a983-4bf6-a68b-5d70b6ad5dd2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 HTTP/1.1 Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:19:45.970063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:19:45.971405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:19:45.971405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:19:45.971405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:19:45.971405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:19:45.971405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:19:45.971405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:19:45.971405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:19:45.971405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:19:45.971405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:19:45.971405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:19:45.971405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:19:45.971405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '11509895-4f58-4838-bae7-bf59aa04d5a8'} Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:19:45.972433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:19:45.973875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:19:45.975761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe511280-a983-4bf6-a68b-5d70b6ad5dd2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:19:45.975761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe511280-a983-4bf6-a68b-5d70b6ad5dd2 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 404 len: 111 microversion: 2.1 time: 0.026359 Jun 20 07:19:45.975761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 419/945] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:19:45 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:19:46.024251 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-86cbdcf2-1c4a-4a79-85c4-874b7e7d478f req-a3a4c4a8-f762-4f20-8a8f-0ff204851c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11509895-4f58-4838-bae7-bf59aa04d5a8", "name": "network-vif-deleted", "tag": "ea93bf77-b0f2-4c02-a76e-ff9278bd79a1"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:19:46.032324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-86cbdcf2-1c4a-4a79-85c4-874b7e7d478f req-a3a4c4a8-f762-4f20-8a8f-0ff204851c8e service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:19:46.032772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-86cbdcf2-1c4a-4a79-85c4-874b7e7d478f req-a3a4c4a8-f762-4f20-8a8f-0ff204851c8e service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:19:46.044032 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-86cbdcf2-1c4a-4a79-85c4-874b7e7d478f req-a3a4c4a8-f762-4f20-8a8f-0ff204851c8e service nova] Creating event network-vif-deleted:ea93bf77-b0f2-4c02-a76e-ff9278bd79a1 for instance 11509895-4f58-4838-bae7-bf59aa04d5a8 on hv-cinder-77819 Jun 20 07:19:46.048717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-86cbdcf2-1c4a-4a79-85c4-874b7e7d478f req-a3a4c4a8-f762-4f20-8a8f-0ff204851c8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075785 Jun 20 07:19:46.049267 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 420/946] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:19:46.055169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6f47e070-033e-4639-a33e-cc646bde02e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:19:46.055744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6f47e070-033e-4639-a33e-cc646bde02e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:19:46.061526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f47e070-033e-4639-a33e-cc646bde02e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:19:46.061975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f47e070-033e-4639-a33e-cc646bde02e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:19:46.062729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f47e070-033e-4639-a33e-cc646bde02e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:19:46.063168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f47e070-033e-4639-a33e-cc646bde02e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:19:55.745828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:19:56.059152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=12 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:19:56.081266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=24 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:20:25.086791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:20:25.087397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:20:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204 (ip 10.222.0.23) !!! Jun 20 07:20:25.591895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:20:25.592563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:20:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac (ip 10.222.0.23) !!! Jun 20 07:20:32.536770 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:20:32.537936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:20:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac (ip 10.222.0.23) !!! Jun 20 07:20:39.439242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a5906863-127b-4b09-b3a9-124a288afc83 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204" status: 202 len: 0 microversion: 2.1 time: 119.999999 Jun 20 07:20:39.440177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 527/947] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:18:39 2022] DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204 => generated 0 bytes in 120002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:20:39.446628 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-455ba8d5-3857-48cd-8507-5368afa3a88e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:20:39.447427 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-455ba8d5-3857-48cd-8507-5368afa3a88e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:20:39.454903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-455ba8d5-3857-48cd-8507-5368afa3a88e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:20:39.455472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-455ba8d5-3857-48cd-8507-5368afa3a88e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:20:39.457412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-455ba8d5-3857-48cd-8507-5368afa3a88e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:20:39.457920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-455ba8d5-3857-48cd-8507-5368afa3a88e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:20:39.480709 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-6f47e070-033e-4639-a33e-cc646bde02e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'services' on Instance uuid b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:20:49.455013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:20:49.478423 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:20:49.485619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:21:45.855836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-455ba8d5-3857-48cd-8507-5368afa3a88e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lazy-loading 'services' on Instance uuid ec0ea04e-5c9f-4536-b200-1eaf64edef9c {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:21:45.883046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-6f47e070-033e-4639-a33e-cc646bde02e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3780278-e385-4952-a75e-e3ba42b65920) Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6f47e070-033e-4639-a33e-cc646bde02e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Request method failure captured: Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac HTTP/1.1 Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisBydWR9hXTdRdgEMgIPM-1lAL620VtySsJQPtX3E4eETT6X1pqkxCAdBrQ05QM3sLf2M6w4suLslwDczM450U7T03NmXju7Tum6YsJN5wR3uh9QywM_y5Z98mk3Ttcwbp4tjIhwIlNWuRc740_x69DYuTSos87GlveyHMBK04lJyYJs Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:21:45.885383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:21:45.887408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:21:45.887408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:21:45.887408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:21:45.887408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:21:45.887408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:21:45.887408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:21:45.887408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:21:45.887408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: af0dee4e1dfb4f879dfe41622a9e23b1 Jun 20 07:21:45.887408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:21:45.887408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3780278-e385-4952-a75e-e3ba42b65920) Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'server_id': 'b2be05cc-d645-4d3b-9fcb-dbacd92e2f75', 'id': '14acc9ca-9ac6-446e-b502-951bbf9876ac'} Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:21:45.888438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3780278-e385-4952-a75e-e3ba42b65920) Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:21:45.889789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3780278-e385-4952-a75e-e3ba42b65920) Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:45.891881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3780278-e385-4952-a75e-e3ba42b65920) Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:21:45.893152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3780278-e385-4952-a75e-e3ba42b65920) Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3780278-e385-4952-a75e-e3ba42b65920) Jun 20 07:21:45.894305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:45.896159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6f47e070-033e-4639-a33e-cc646bde02e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3780278-e385-4952-a75e-e3ba42b65920) {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:21:45.896159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6f47e070-033e-4639-a33e-cc646bde02e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac" status: 400 len: 269 microversion: 2.1 time: 119.836467 Jun 20 07:21:45.896159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 421/948] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:19:46 2022] DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac => generated 269 bytes in 119838 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:21:45.896159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e066cc71-788a-4848-bd4a-c205e8d84481 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:21:45.896682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e066cc71-788a-4848-bd4a-c205e8d84481 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:21:45.901937 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e066cc71-788a-4848-bd4a-c205e8d84481 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:45.902382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e066cc71-788a-4848-bd4a-c205e8d84481 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:45.903145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e066cc71-788a-4848-bd4a-c205e8d84481 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:45.903578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e066cc71-788a-4848-bd4a-c205e8d84481 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:45.964588 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e066cc71-788a-4848-bd4a-c205e8d84481 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:21:45.972666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e066cc71-788a-4848-bd4a-c205e8d84481 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.081588 Jun 20 07:21:45.973236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 422/949] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:21:45 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:21:45.978010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ee0bbf0d-585a-49ac-989b-211cdac61188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:21:45.979129 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ee0bbf0d-585a-49ac-989b-211cdac61188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:21:45.984882 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee0bbf0d-585a-49ac-989b-211cdac61188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:45.985338 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee0bbf0d-585a-49ac-989b-211cdac61188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:45.986106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee0bbf0d-585a-49ac-989b-211cdac61188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:45.986546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee0bbf0d-585a-49ac-989b-211cdac61188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.000791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-455ba8d5-3857-48cd-8507-5368afa3a88e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-94e3ace2-5d43-4f20-a580-cbcbb0ee8d53) Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-455ba8d5-3857-48cd-8507-5368afa3a88e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Request method failure captured: Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204 HTTP/1.1 Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisBz47HIB8ZxJkWPj5ZLY_NsTpIgvWQZXKqonc3bKLxnwQuMaHGWlMg0NHsewOFBH8fRwvjVE8-76dCRN4LngC5Q4MhlNitbfKfwKLNwxzz0fwViP3sEWKk-bWLprMOdRhwpyXBAv96wQ88SFVbmY9WGj37T0HFlg-ZqLJp7aoUlv75c Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 1583bd5823544e54b32e1eaf308cd261 Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:21:46.003123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:21:46.004517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:21:46.004517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:21:46.004517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 1583bd5823544e54b32e1eaf308cd261 Jun 20 07:21:46.004517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:21:46.004517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotTestJSON-672847046-project Jun 20 07:21:46.004517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:21:46.004517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:21:46.004517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 0dbf681122194384812c2eb96d1adfbc Jun 20 07:21:46.004517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotTestJSON-672847046-project Jun 20 07:21:46.004517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-94e3ace2-5d43-4f20-a580-cbcbb0ee8d53) Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'server_id': 'ec0ea04e-5c9f-4536-b200-1eaf64edef9c', 'id': '1506b860-9804-4937-91ad-42a1a0896204'} Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:21:46.005746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-94e3ace2-5d43-4f20-a580-cbcbb0ee8d53) Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:21:46.006769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-94e3ace2-5d43-4f20-a580-cbcbb0ee8d53) Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.009246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-94e3ace2-5d43-4f20-a580-cbcbb0ee8d53) Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:21:46.011271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-94e3ace2-5d43-4f20-a580-cbcbb0ee8d53) Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-94e3ace2-5d43-4f20-a580-cbcbb0ee8d53) Jun 20 07:21:46.013320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.015272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-455ba8d5-3857-48cd-8507-5368afa3a88e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-94e3ace2-5d43-4f20-a580-cbcbb0ee8d53) {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:21:46.015272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-455ba8d5-3857-48cd-8507-5368afa3a88e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204" status: 400 len: 269 microversion: 2.1 time: 66.563469 Jun 20 07:21:46.015272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 528/950] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:20:39 2022] DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204 => generated 269 bytes in 66565 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:21:46.015272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42cdf0c5-b2cb-4e27-9b76-d1a842f4b4e3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:21:46.015849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-42cdf0c5-b2cb-4e27-9b76-d1a842f4b4e3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:21:46.017281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ee0bbf0d-585a-49ac-989b-211cdac61188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042889 Jun 20 07:21:46.017839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 423/951] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:21:45 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:21:46.018069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42cdf0c5-b2cb-4e27-9b76-d1a842f4b4e3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.018526 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42cdf0c5-b2cb-4e27-9b76-d1a842f4b4e3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.019289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42cdf0c5-b2cb-4e27-9b76-d1a842f4b4e3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.019727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42cdf0c5-b2cb-4e27-9b76-d1a842f4b4e3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.022702 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6cade25-be8c-4404-b3d8-165a976ae971 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:21:46.023194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e6cade25-be8c-4404-b3d8-165a976ae971 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:21:46.028764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6cade25-be8c-4404-b3d8-165a976ae971 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.029221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6cade25-be8c-4404-b3d8-165a976ae971 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.029987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6cade25-be8c-4404-b3d8-165a976ae971 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.030437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6cade25-be8c-4404-b3d8-165a976ae971 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.032869 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-42cdf0c5-b2cb-4e27-9b76-d1a842f4b4e3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42cdf0c5-b2cb-4e27-9b76-d1a842f4b4e3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 HTTP/1.1 Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:21:46.034390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:21:46.037295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:21:46.037295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:21:46.037295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:21:46.037295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:21:46.037295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:21:46.037295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:21:46.037295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:21:46.037295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:21:46.037295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:21:46.037295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:21:46.037295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:21:46.037295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '11509895-4f58-4838-bae7-bf59aa04d5a8'} Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:21:46.038890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:21:46.041425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.043980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42cdf0c5-b2cb-4e27-9b76-d1a842f4b4e3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:21:46.043980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-42cdf0c5-b2cb-4e27-9b76-d1a842f4b4e3 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 404 len: 111 microversion: 2.1 time: 0.028961 Jun 20 07:21:46.043980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 529/952] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:21:46 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:21:46.043980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3b134c77-280a-4697-89e8-8e3a7f583c17 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:21:46.043980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3b134c77-280a-4697-89e8-8e3a7f583c17 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:21:46.047988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3b134c77-280a-4697-89e8-8e3a7f583c17 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.048475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3b134c77-280a-4697-89e8-8e3a7f583c17 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.049239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3b134c77-280a-4697-89e8-8e3a7f583c17 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.049674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3b134c77-280a-4697-89e8-8e3a7f583c17 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.110494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-e6cade25-be8c-4404-b3d8-165a976ae971 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'services' on Instance uuid b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:21:46.150515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-3b134c77-280a-4697-89e8-8e3a7f583c17 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lazy-loading 'services' on Instance uuid ec0ea04e-5c9f-4536-b200-1eaf64edef9c {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:21:46.177518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-e6cade25-be8c-4404-b3d8-165a976ae971 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-82a785cf-cbc4-4046-9567-d6cb486a0529) Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6cade25-be8c-4404-b3d8-165a976ae971 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Request method failure captured: Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac HTTP/1.1 Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisBydWR9hXTdRdgEMgIPM-1lAL620VtySsJQPtX3E4eETT6X1pqkxCAdBrQ05QM3sLf2M6w4suLslwDczM450U7T03NmXju7Tum6YsJN5wR3uh9QywM_y5Z98mk3Ttcwbp4tjIhwIlNWuRc740_x69DYuTSos87GlveyHMBK04lJyYJs Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:21:46.179718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:21:46.181183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:21:46.181183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:21:46.181183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:21:46.181183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:21:46.181183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:21:46.181183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:21:46.181183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:21:46.181183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: af0dee4e1dfb4f879dfe41622a9e23b1 Jun 20 07:21:46.181183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:21:46.181183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-82a785cf-cbc4-4046-9567-d6cb486a0529) Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'server_id': 'b2be05cc-d645-4d3b-9fcb-dbacd92e2f75', 'id': '14acc9ca-9ac6-446e-b502-951bbf9876ac'} Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:21:46.182023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-82a785cf-cbc4-4046-9567-d6cb486a0529) Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:21:46.183071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-82a785cf-cbc4-4046-9567-d6cb486a0529) Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.184253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-82a785cf-cbc4-4046-9567-d6cb486a0529) Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:21:46.185280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-82a785cf-cbc4-4046-9567-d6cb486a0529) Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-82a785cf-cbc4-4046-9567-d6cb486a0529) Jun 20 07:21:46.186378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.187398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6cade25-be8c-4404-b3d8-165a976ae971 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-82a785cf-cbc4-4046-9567-d6cb486a0529) {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:21:46.187398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e6cade25-be8c-4404-b3d8-165a976ae971 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac" status: 400 len: 269 microversion: 2.1 time: 0.162307 Jun 20 07:21:46.187398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 424/953] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:21:46 2022] DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac => generated 269 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:21:46.187775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff7f0e58-83fd-414e-9669-b62ad07ba651 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:21:46.189006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff7f0e58-83fd-414e-9669-b62ad07ba651 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:21:46.194976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff7f0e58-83fd-414e-9669-b62ad07ba651 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.195429 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff7f0e58-83fd-414e-9669-b62ad07ba651 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.196221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff7f0e58-83fd-414e-9669-b62ad07ba651 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.196664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff7f0e58-83fd-414e-9669-b62ad07ba651 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.222750 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-3b134c77-280a-4697-89e8-8e3a7f583c17 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc411df4-3cfe-47a8-a3d9-0b26aac91e14) Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3b134c77-280a-4697-89e8-8e3a7f583c17 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Request method failure captured: Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204 HTTP/1.1 Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisBz47HIB8ZxJkWPj5ZLY_NsTpIgvWQZXKqonc3bKLxnwQuMaHGWlMg0NHsewOFBH8fRwvjVE8-76dCRN4LngC5Q4MhlNitbfKfwKLNwxzz0fwViP3sEWKk-bWLprMOdRhwpyXBAv96wQ88SFVbmY9WGj37T0HFlg-ZqLJp7aoUlv75c Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 1583bd5823544e54b32e1eaf308cd261 Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:21:46.228481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:21:46.229921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:21:46.229921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:21:46.229921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 1583bd5823544e54b32e1eaf308cd261 Jun 20 07:21:46.229921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:21:46.229921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotTestJSON-672847046-project Jun 20 07:21:46.229921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:21:46.229921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:21:46.229921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 0dbf681122194384812c2eb96d1adfbc Jun 20 07:21:46.229921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotTestJSON-672847046-project Jun 20 07:21:46.229921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc411df4-3cfe-47a8-a3d9-0b26aac91e14) Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'server_id': 'ec0ea04e-5c9f-4536-b200-1eaf64edef9c', 'id': '1506b860-9804-4937-91ad-42a1a0896204'} Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:21:46.230532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc411df4-3cfe-47a8-a3d9-0b26aac91e14) Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:21:46.231823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc411df4-3cfe-47a8-a3d9-0b26aac91e14) Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.233015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc411df4-3cfe-47a8-a3d9-0b26aac91e14) Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:21:46.234061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc411df4-3cfe-47a8-a3d9-0b26aac91e14) Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc411df4-3cfe-47a8-a3d9-0b26aac91e14) Jun 20 07:21:46.235184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.236586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3b134c77-280a-4697-89e8-8e3a7f583c17 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc411df4-3cfe-47a8-a3d9-0b26aac91e14) {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:21:46.236687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3b134c77-280a-4697-89e8-8e3a7f583c17 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204" status: 400 len: 269 microversion: 2.1 time: 0.193607 Jun 20 07:21:46.237804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 530/954] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:21:46 2022] DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204 => generated 269 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:21:46.243568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f4cb7cf0-a194-43db-b274-6fb440878ec6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:21:46.246867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f4cb7cf0-a194-43db-b274-6fb440878ec6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:21:46.254146 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4cb7cf0-a194-43db-b274-6fb440878ec6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.254602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4cb7cf0-a194-43db-b274-6fb440878ec6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.255976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4cb7cf0-a194-43db-b274-6fb440878ec6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.256449 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4cb7cf0-a194-43db-b274-6fb440878ec6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.280307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ff7f0e58-83fd-414e-9669-b62ad07ba651 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:21:46.289812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff7f0e58-83fd-414e-9669-b62ad07ba651 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1224 microversion: 2.1 time: 0.106938 Jun 20 07:21:46.290627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 425/955] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:21:46 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:21:46.291072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f4cb7cf0-a194-43db-b274-6fb440878ec6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051925 Jun 20 07:21:46.295941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fde7940e-5181-4fb8-9659-e638ef804093 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:21:46.296796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fde7940e-5181-4fb8-9659-e638ef804093 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:21:46.300220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 531/956] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:21:46 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:21:46.304021 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fde7940e-5181-4fb8-9659-e638ef804093 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.304505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fde7940e-5181-4fb8-9659-e638ef804093 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.305279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fde7940e-5181-4fb8-9659-e638ef804093 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.305780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fde7940e-5181-4fb8-9659-e638ef804093 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.307856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-db3566dd-d16a-47eb-8b41-41d547798ec5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:21:46.308498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-db3566dd-d16a-47eb-8b41-41d547798ec5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:21:46.315200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db3566dd-d16a-47eb-8b41-41d547798ec5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.315710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db3566dd-d16a-47eb-8b41-41d547798ec5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.316540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db3566dd-d16a-47eb-8b41-41d547798ec5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.316974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db3566dd-d16a-47eb-8b41-41d547798ec5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.320624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-fde7940e-5181-4fb8-9659-e638ef804093 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fde7940e-5181-4fb8-9659-e638ef804093 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 HTTP/1.1 Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:21:46.322156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:21:46.323617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:21:46.323617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:21:46.323617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:21:46.323617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:21:46.323617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:21:46.323617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:21:46.323617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:21:46.323617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:21:46.323617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:21:46.323617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:21:46.323617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:21:46.323617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '11509895-4f58-4838-bae7-bf59aa04d5a8'} Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:21:46.324768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:21:46.326366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:21:46.328234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fde7940e-5181-4fb8-9659-e638ef804093 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:21:46.328234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fde7940e-5181-4fb8-9659-e638ef804093 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 404 len: 111 microversion: 2.1 time: 0.031543 Jun 20 07:21:46.328234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 426/957] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:21:46 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:21:46.328625 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2ba70031-cffe-499e-8719-e68bb7a6d616 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:21:46.329112 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2ba70031-cffe-499e-8719-e68bb7a6d616 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:21:46.335318 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ba70031-cffe-499e-8719-e68bb7a6d616 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.335987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ba70031-cffe-499e-8719-e68bb7a6d616 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.336792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ba70031-cffe-499e-8719-e68bb7a6d616 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:21:46.337243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2ba70031-cffe-499e-8719-e68bb7a6d616 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:21:46.397372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-db3566dd-d16a-47eb-8b41-41d547798ec5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'services' on Instance uuid b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:21:46.438777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-2ba70031-cffe-499e-8719-e68bb7a6d616 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lazy-loading 'services' on Instance uuid ec0ea04e-5c9f-4536-b200-1eaf64edef9c {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:21:56.312627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=8 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:21:56.332253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=12 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:21:56.401181 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=28 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:21:56.443311 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=36 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:22:12.764591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:22:12.765071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:22:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac (ip 10.222.0.23) !!! Jun 20 07:22:36.413025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:22:36.413556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:22:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204 (ip 10.222.0.23) !!! Jun 20 07:22:39.586963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-db3566dd-d16a-47eb-8b41-41d547798ec5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a211675-ea7f-4ee7-a720-7b84f50fc464) Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-db3566dd-d16a-47eb-8b41-41d547798ec5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Request method failure captured: Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac HTTP/1.1 Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisBydWR9hXTdRdgEMgIPM-1lAL620VtySsJQPtX3E4eETT6X1pqkxCAdBrQ05QM3sLf2M6w4suLslwDczM450U7T03NmXju7Tum6YsJN5wR3uh9QywM_y5Z98mk3Ttcwbp4tjIhwIlNWuRc740_x69DYuTSos87GlveyHMBK04lJyYJs Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:22:39.589356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:22:39.592003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:22:39.592003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:22:39.592003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:22:39.592003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:22:39.592003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:22:39.592003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:22:39.592003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:22:39.592003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: af0dee4e1dfb4f879dfe41622a9e23b1 Jun 20 07:22:39.592003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:22:39.592003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a211675-ea7f-4ee7-a720-7b84f50fc464) Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'server_id': 'b2be05cc-d645-4d3b-9fcb-dbacd92e2f75', 'id': '14acc9ca-9ac6-446e-b502-951bbf9876ac'} Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:22:39.593970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a211675-ea7f-4ee7-a720-7b84f50fc464) Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:22:39.596721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a211675-ea7f-4ee7-a720-7b84f50fc464) Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.599302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a211675-ea7f-4ee7-a720-7b84f50fc464) Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:39.601745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a211675-ea7f-4ee7-a720-7b84f50fc464) Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a211675-ea7f-4ee7-a720-7b84f50fc464) Jun 20 07:22:39.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.605440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-db3566dd-d16a-47eb-8b41-41d547798ec5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a211675-ea7f-4ee7-a720-7b84f50fc464) {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:22:39.605440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-db3566dd-d16a-47eb-8b41-41d547798ec5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac" status: 400 len: 269 microversion: 2.1 time: 53.289503 Jun 20 07:22:39.605440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 532/958] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:21:46 2022] DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac => generated 269 bytes in 53291 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:22:39.605440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f30e348f-c4ad-4416-9b7c-c4f00d614d26 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:39.606200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f30e348f-c4ad-4416-9b7c-c4f00d614d26 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:39.609330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f30e348f-c4ad-4416-9b7c-c4f00d614d26 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.609810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f30e348f-c4ad-4416-9b7c-c4f00d614d26 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.610564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f30e348f-c4ad-4416-9b7c-c4f00d614d26 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.611010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f30e348f-c4ad-4416-9b7c-c4f00d614d26 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.633035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-2ba70031-cffe-499e-8719-e68bb7a6d616 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26f8327f-259e-45a2-8b30-8783e7733d33) Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2ba70031-cffe-499e-8719-e68bb7a6d616 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Request method failure captured: Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204 HTTP/1.1 Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisBz47HIB8ZxJkWPj5ZLY_NsTpIgvWQZXKqonc3bKLxnwQuMaHGWlMg0NHsewOFBH8fRwvjVE8-76dCRN4LngC5Q4MhlNitbfKfwKLNwxzz0fwViP3sEWKk-bWLprMOdRhwpyXBAv96wQ88SFVbmY9WGj37T0HFlg-ZqLJp7aoUlv75c Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 1583bd5823544e54b32e1eaf308cd261 Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:22:39.635076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:22:39.636774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:22:39.636774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:22:39.636774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 1583bd5823544e54b32e1eaf308cd261 Jun 20 07:22:39.636774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:22:39.636774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesSnapshotTestJSON-672847046-project Jun 20 07:22:39.636774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:22:39.636774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:22:39.636774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: 0dbf681122194384812c2eb96d1adfbc Jun 20 07:22:39.636774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesSnapshotTestJSON-672847046-project Jun 20 07:22:39.636774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26f8327f-259e-45a2-8b30-8783e7733d33) Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'server_id': 'ec0ea04e-5c9f-4536-b200-1eaf64edef9c', 'id': '1506b860-9804-4937-91ad-42a1a0896204'} Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:22:39.637468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26f8327f-259e-45a2-8b30-8783e7733d33) Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:22:39.638534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26f8327f-259e-45a2-8b30-8783e7733d33) Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.639701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26f8327f-259e-45a2-8b30-8783e7733d33) Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:39.642396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26f8327f-259e-45a2-8b30-8783e7733d33) Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26f8327f-259e-45a2-8b30-8783e7733d33) Jun 20 07:22:39.645451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.648862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2ba70031-cffe-499e-8719-e68bb7a6d616 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26f8327f-259e-45a2-8b30-8783e7733d33) {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:22:39.648862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2ba70031-cffe-499e-8719-e68bb7a6d616 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204" status: 400 len: 269 microversion: 2.1 time: 53.311793 Jun 20 07:22:39.648862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 427/959] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:21:46 2022] DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204 => generated 269 bytes in 53313 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:22:39.648862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8ce54219-45ab-4dfc-b534-5b97dff13442 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:39.649483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f30e348f-c4ad-4416-9b7c-c4f00d614d26 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.649483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f30e348f-c4ad-4416-9b7c-c4f00d614d26 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.649756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8ce54219-45ab-4dfc-b534-5b97dff13442 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:39.649906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-f30e348f-c4ad-4416-9b7c-c4f00d614d26 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lazy-loading 'fault' on Instance uuid de77ef2f-9577-403b-99e7-2540b785a6d3 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:22:39.656459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ce54219-45ab-4dfc-b534-5b97dff13442 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.656758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ce54219-45ab-4dfc-b534-5b97dff13442 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.657738 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ce54219-45ab-4dfc-b534-5b97dff13442 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.658245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ce54219-45ab-4dfc-b534-5b97dff13442 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.689194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8ce54219-45ab-4dfc-b534-5b97dff13442 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050516 Jun 20 07:22:39.690324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 428/960] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:39 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:39.695540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f30e348f-c4ad-4416-9b7c-c4f00d614d26 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:22:39.695722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d3e8708-e592-420d-bc01-54080ce61224 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:39.699073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1d3e8708-e592-420d-bc01-54080ce61224 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:39.703849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f30e348f-c4ad-4416-9b7c-c4f00d614d26 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1229 microversion: 2.1 time: 0.111216 Jun 20 07:22:39.704645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 533/961] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:39 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1229 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:22:39.705242 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d3e8708-e592-420d-bc01-54080ce61224 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.705696 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d3e8708-e592-420d-bc01-54080ce61224 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.706477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d3e8708-e592-420d-bc01-54080ce61224 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.706926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d3e8708-e592-420d-bc01-54080ce61224 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.710064 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4cae2da7-0271-41fd-b6f3-0b28a0c1fc3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:39.710551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4cae2da7-0271-41fd-b6f3-0b28a0c1fc3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:39.716348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cae2da7-0271-41fd-b6f3-0b28a0c1fc3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.716796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cae2da7-0271-41fd-b6f3-0b28a0c1fc3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.717551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cae2da7-0271-41fd-b6f3-0b28a0c1fc3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.717977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4cae2da7-0271-41fd-b6f3-0b28a0c1fc3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.721265 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-1d3e8708-e592-420d-bc01-54080ce61224 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d3e8708-e592-420d-bc01-54080ce61224 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 HTTP/1.1 Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:22:39.722780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:22:39.724434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:22:39.724434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:22:39.724434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:22:39.724434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:22:39.724434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:22:39.724434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:22:39.724434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:22:39.724434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:22:39.724434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:22:39.724434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:22:39.724434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:22:39.724434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '11509895-4f58-4838-bae7-bf59aa04d5a8'} Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:22:39.725329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:22:39.727241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.728836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d3e8708-e592-420d-bc01-54080ce61224 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:22:39.728836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1d3e8708-e592-420d-bc01-54080ce61224 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 404 len: 111 microversion: 2.1 time: 0.033004 Jun 20 07:22:39.728836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 429/962] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:39 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:22:39.729587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9cfe31ec-fe95-4685-a2e7-bfac1c82a0a1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:39.730086 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9cfe31ec-fe95-4685-a2e7-bfac1c82a0a1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:39.735808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cfe31ec-fe95-4685-a2e7-bfac1c82a0a1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.736305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cfe31ec-fe95-4685-a2e7-bfac1c82a0a1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.737780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cfe31ec-fe95-4685-a2e7-bfac1c82a0a1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.737780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cfe31ec-fe95-4685-a2e7-bfac1c82a0a1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.797716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-4cae2da7-0271-41fd-b6f3-0b28a0c1fc3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'services' on Instance uuid b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:22:39.839338 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-9cfe31ec-fe95-4685-a2e7-bfac1c82a0a1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lazy-loading 'services' on Instance uuid ec0ea04e-5c9f-4536-b200-1eaf64edef9c {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:22:39.866863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-4cae2da7-0271-41fd-b6f3-0b28a0c1fc3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ddf5f-9ea6-4168-8c00-0ddba9613c90) Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4cae2da7-0271-41fd-b6f3-0b28a0c1fc3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Request method failure captured: Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac HTTP/1.1 Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisBydWR9hXTdRdgEMgIPM-1lAL620VtySsJQPtX3E4eETT6X1pqkxCAdBrQ05QM3sLf2M6w4suLslwDczM450U7T03NmXju7Tum6YsJN5wR3uh9QywM_y5Z98mk3Ttcwbp4tjIhwIlNWuRc740_x69DYuTSos87GlveyHMBK04lJyYJs Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:22:39.869077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:22:39.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:22:39.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:22:39.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:22:39.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:22:39.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:22:39.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:22:39.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:22:39.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: af0dee4e1dfb4f879dfe41622a9e23b1 Jun 20 07:22:39.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:22:39.870436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ddf5f-9ea6-4168-8c00-0ddba9613c90) Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'server_id': 'b2be05cc-d645-4d3b-9fcb-dbacd92e2f75', 'id': '14acc9ca-9ac6-446e-b502-951bbf9876ac'} Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:22:39.871267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ddf5f-9ea6-4168-8c00-0ddba9613c90) Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:22:39.873279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ddf5f-9ea6-4168-8c00-0ddba9613c90) Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.874414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ddf5f-9ea6-4168-8c00-0ddba9613c90) Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:39.877640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ddf5f-9ea6-4168-8c00-0ddba9613c90) Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ddf5f-9ea6-4168-8c00-0ddba9613c90) Jun 20 07:22:39.879381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.882414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4cae2da7-0271-41fd-b6f3-0b28a0c1fc3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d70ddf5f-9ea6-4168-8c00-0ddba9613c90) {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:22:39.882414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4cae2da7-0271-41fd-b6f3-0b28a0c1fc3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac" status: 400 len: 269 microversion: 2.1 time: 0.164977 Jun 20 07:22:39.882414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 534/963] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:22:39 2022] DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments/14acc9ca-9ac6-446e-b502-951bbf9876ac => generated 269 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:22:39.882414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e3f9af96-b7d7-4898-8edd-5efdd90777c9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:39.882940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e3f9af96-b7d7-4898-8edd-5efdd90777c9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:39.888978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3f9af96-b7d7-4898-8edd-5efdd90777c9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.889563 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3f9af96-b7d7-4898-8edd-5efdd90777c9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.890530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3f9af96-b7d7-4898-8edd-5efdd90777c9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.890969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3f9af96-b7d7-4898-8edd-5efdd90777c9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.905981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-9cfe31ec-fe95-4685-a2e7-bfac1c82a0a1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9fe1ad3-fad0-4dcf-a000-32f17e79e145) Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9cfe31ec-fe95-4685-a2e7-bfac1c82a0a1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Request method failure captured: Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204 HTTP/1.1 Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisBz47HIB8ZxJkWPj5ZLY_NsTpIgvWQZXKqonc3bKLxnwQuMaHGWlMg0NHsewOFBH8fRwvjVE8-76dCRN4LngC5Q4MhlNitbfKfwKLNwxzz0fwViP3sEWKk-bWLprMOdRhwpyXBAv96wQ88SFVbmY9WGj37T0HFlg-ZqLJp7aoUlv75c Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 1583bd5823544e54b32e1eaf308cd261 Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:22:39.908753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:22:39.910123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1583bd5823544e54b32e1eaf308cd261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:22:39.910123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:22:39.910123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 1583bd5823544e54b32e1eaf308cd261 Jun 20 07:22:39.910123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-672847046 Jun 20 07:22:39.910123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesSnapshotTestJSON-672847046-project Jun 20 07:22:39.910123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:22:39.910123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:22:39.910123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: 0dbf681122194384812c2eb96d1adfbc Jun 20 07:22:39.910123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesSnapshotTestJSON-672847046-project Jun 20 07:22:39.910123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9fe1ad3-fad0-4dcf-a000-32f17e79e145) Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'server_id': 'ec0ea04e-5c9f-4536-b200-1eaf64edef9c', 'id': '1506b860-9804-4937-91ad-42a1a0896204'} Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:22:39.910749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9fe1ad3-fad0-4dcf-a000-32f17e79e145) Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:22:39.911774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9fe1ad3-fad0-4dcf-a000-32f17e79e145) Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.913004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9fe1ad3-fad0-4dcf-a000-32f17e79e145) Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:39.914008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9fe1ad3-fad0-4dcf-a000-32f17e79e145) Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9fe1ad3-fad0-4dcf-a000-32f17e79e145) Jun 20 07:22:39.915083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:39.916086 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9cfe31ec-fe95-4685-a2e7-bfac1c82a0a1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9fe1ad3-fad0-4dcf-a000-32f17e79e145) {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:22:39.916086 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9cfe31ec-fe95-4685-a2e7-bfac1c82a0a1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204" status: 400 len: 269 microversion: 2.1 time: 0.184270 Jun 20 07:22:39.916086 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 430/964] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:22:39 2022] DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c/os-volume_attachments/1506b860-9804-4937-91ad-42a1a0896204 => generated 269 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:22:39.918741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8e036725-0203-40f5-b4cc-b725c9cc6329 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:39.918741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8e036725-0203-40f5-b4cc-b725c9cc6329 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:39.925472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e036725-0203-40f5-b4cc-b725c9cc6329 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.925935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e036725-0203-40f5-b4cc-b725c9cc6329 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.926395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3f9af96-b7d7-4898-8edd-5efdd90777c9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.926765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e036725-0203-40f5-b4cc-b725c9cc6329 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.926903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3f9af96-b7d7-4898-8edd-5efdd90777c9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.927171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e036725-0203-40f5-b4cc-b725c9cc6329 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.927884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-e3f9af96-b7d7-4898-8edd-5efdd90777c9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lazy-loading 'fault' on Instance uuid de77ef2f-9577-403b-99e7-2540b785a6d3 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:22:39.965681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8e036725-0203-40f5-b4cc-b725c9cc6329 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053492 Jun 20 07:22:39.970244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 431/965] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:39 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:39.976063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-157d5359-7c9c-45a0-822a-d2953a89b89d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:39.976909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-157d5359-7c9c-45a0-822a-d2953a89b89d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:39.980849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e3f9af96-b7d7-4898-8edd-5efdd90777c9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1404717904a14000a11f06c6c8291105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a98ee7cefc4c759c846f6cacb646a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:22:39.991057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e3f9af96-b7d7-4898-8edd-5efdd90777c9 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 200 len: 1229 microversion: 2.1 time: 0.118658 Jun 20 07:22:39.991696 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-157d5359-7c9c-45a0-822a-d2953a89b89d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.991821 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 535/966] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:39 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 1229 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:22:39.992551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-157d5359-7c9c-45a0-822a-d2953a89b89d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:39.993754 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-157d5359-7c9c-45a0-822a-d2953a89b89d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:39.994227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-157d5359-7c9c-45a0-822a-d2953a89b89d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:40.010523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-157d5359-7c9c-45a0-822a-d2953a89b89d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-157d5359-7c9c-45a0-822a-d2953a89b89d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 HTTP/1.1 Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:22:40.012687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:22:40.014066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:22:40.014066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:22:40.014066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:22:40.014066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:22:40.014066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:22:40.014066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:22:40.014066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:22:40.014066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:22:40.014066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:22:40.014066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:22:40.014066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:22:40.014066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '11509895-4f58-4838-bae7-bf59aa04d5a8'} Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:22:40.014881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:22:40.019350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.020498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-157d5359-7c9c-45a0-822a-d2953a89b89d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:22:40.020498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-157d5359-7c9c-45a0-822a-d2953a89b89d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 404 len: 111 microversion: 2.1 time: 0.042807 Jun 20 07:22:40.020498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 432/967] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:39 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:22:40.020736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-45ec68f8-ed63-407a-8145-6849b58a6b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:40.022078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-45ec68f8-ed63-407a-8145-6849b58a6b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:40.023154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bbfe5adf-8ca2-46ac-9904-65252c152815 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '.version_select at 0x7ffa1fc1d280>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:40.029576 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45ec68f8-ed63-407a-8145-6849b58a6b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:40.030337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45ec68f8-ed63-407a-8145-6849b58a6b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:40.031414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45ec68f8-ed63-407a-8145-6849b58a6b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:40.033436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45ec68f8-ed63-407a-8145-6849b58a6b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:40.045745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bbfe5adf-8ca2-46ac-9904-65252c152815 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576413692" status: 202 len: 0 microversion: 2.1 time: 0.026283 Jun 20 07:22:40.050198 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 433/968] 10.222.0.23 () {58 vars in 1220 bytes} [Mon Jun 20 07:22:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576413692 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 07:22:40.071108 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-45ec68f8-ed63-407a-8145-6849b58a6b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066648 Jun 20 07:22:40.071682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 536/969] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:39 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:40.504862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-077e0a94-7d3f-4bff-8188-b1a954680c2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:40.505353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-077e0a94-7d3f-4bff-8188-b1a954680c2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:40.514089 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-077e0a94-7d3f-4bff-8188-b1a954680c2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:40.514536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-077e0a94-7d3f-4bff-8188-b1a954680c2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:40.515298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-077e0a94-7d3f-4bff-8188-b1a954680c2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:40.515729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-077e0a94-7d3f-4bff-8188-b1a954680c2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:40.529063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-077e0a94-7d3f-4bff-8188-b1a954680c2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] HTTP exception thrown: Instance de77ef2f-9577-403b-99e7-2540b785a6d3 could not be found. Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-077e0a94-7d3f-4bff-8188-b1a954680c2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Request method failure captured: Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 HTTP/1.1 Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisB0RYVZH2JuAuSwb8B5NejJ5iQE2jphLyNIUi8ZS7zWRx20UDXcSMdK27pJwDWC33EaANEaTm9otT9iLDSOL5Tm5yfbjLES_yv0vJxtzSqds4QUYY-6p8E-Vuq0WkQtMTv9KQ5NilkeH3f4kNp-grxnTRkW8WZHWzOo-sfgsxpjKSsE Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: f5a98ee7cefc4c759c846f6cacb646a8 Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestVolumeBootPattern-23472585 Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:22:40.530679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:22:40.532360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5a98ee7cefc4c759c846f6cacb646a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5a98ee7cefc4c759c846f6cacb646a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5a98ee7cefc4c759c846f6cacb646a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5a98ee7cefc4c759c846f6cacb646a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:22:40.532360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestVolumeBootPattern-23472585 Jun 20 07:22:40.532360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: f5a98ee7cefc4c759c846f6cacb646a8 Jun 20 07:22:40.532360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestVolumeBootPattern-23472585 Jun 20 07:22:40.532360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-TestVolumeBootPattern-23472585-project Jun 20 07:22:40.532360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:22:40.532360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:22:40.532360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: 1404717904a14000a11f06c6c8291105 Jun 20 07:22:40.532360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestVolumeBootPattern-23472585-project Jun 20 07:22:40.532360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:22:40.532360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance de77ef2f-9577-403b-99e7-2540b785a6d3 could not be found. Jun 20 07:22:40.532360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': 'de77ef2f-9577-403b-99e7-2540b785a6d3'} Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de77ef2f-9577-403b-99e7-2540b785a6d3 could not be found. Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:22:40.533174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de77ef2f-9577-403b-99e7-2540b785a6d3 could not be found. Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de77ef2f-9577-403b-99e7-2540b785a6d3 could not be found. Jun 20 07:22:40.534467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.535818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-077e0a94-7d3f-4bff-8188-b1a954680c2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Returning 404 to user: Instance de77ef2f-9577-403b-99e7-2540b785a6d3 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:22:40.535818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-077e0a94-7d3f-4bff-8188-b1a954680c2f tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "DELETE /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 404 len: 111 microversion: 2.1 time: 0.031606 Jun 20 07:22:40.535818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 434/970] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:22:40 2022] DELETE /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:22:40.541358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d11148ea-c8f6-4569-95ec-7be2583ed75d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:40.541964 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d11148ea-c8f6-4569-95ec-7be2583ed75d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] [instance: de77ef2f-9577-403b-99e7-2540b785a6d3] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:40.547826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d11148ea-c8f6-4569-95ec-7be2583ed75d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:40.548304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d11148ea-c8f6-4569-95ec-7be2583ed75d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:40.549055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d11148ea-c8f6-4569-95ec-7be2583ed75d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:40.549486 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d11148ea-c8f6-4569-95ec-7be2583ed75d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:40.563235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-d11148ea-c8f6-4569-95ec-7be2583ed75d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] HTTP exception thrown: Instance de77ef2f-9577-403b-99e7-2540b785a6d3 could not be found. Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d11148ea-c8f6-4569-95ec-7be2583ed75d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Request method failure captured: Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 HTTP/1.1 Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisB0RYVZH2JuAuSwb8B5NejJ5iQE2jphLyNIUi8ZS7zWRx20UDXcSMdK27pJwDWC33EaANEaTm9otT9iLDSOL5Tm5yfbjLES_yv0vJxtzSqds4QUYY-6p8E-Vuq0WkQtMTv9KQ5NilkeH3f4kNp-grxnTRkW8WZHWzOo-sfgsxpjKSsE Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: f5a98ee7cefc4c759c846f6cacb646a8 Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-TestVolumeBootPattern-23472585 Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:22:40.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:22:40.566364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5a98ee7cefc4c759c846f6cacb646a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5a98ee7cefc4c759c846f6cacb646a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5a98ee7cefc4c759c846f6cacb646a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5a98ee7cefc4c759c846f6cacb646a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:22:40.566364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-TestVolumeBootPattern-23472585 Jun 20 07:22:40.566364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: f5a98ee7cefc4c759c846f6cacb646a8 Jun 20 07:22:40.566364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-TestVolumeBootPattern-23472585 Jun 20 07:22:40.566364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-TestVolumeBootPattern-23472585-project Jun 20 07:22:40.566364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:22:40.566364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:22:40.566364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 1404717904a14000a11f06c6c8291105 Jun 20 07:22:40.566364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-TestVolumeBootPattern-23472585-project Jun 20 07:22:40.566364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:22:40.566364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance de77ef2f-9577-403b-99e7-2540b785a6d3 could not be found. Jun 20 07:22:40.566364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': 'de77ef2f-9577-403b-99e7-2540b785a6d3'} Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de77ef2f-9577-403b-99e7-2540b785a6d3 could not be found. Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:22:40.570430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de77ef2f-9577-403b-99e7-2540b785a6d3 could not be found. Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de77ef2f-9577-403b-99e7-2540b785a6d3 could not be found. Jun 20 07:22:40.571902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:22:40.573831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d11148ea-c8f6-4569-95ec-7be2583ed75d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Returning 404 to user: Instance de77ef2f-9577-403b-99e7-2540b785a6d3 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:22:40.573831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d11148ea-c8f6-4569-95ec-7be2583ed75d tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3" status: 404 len: 111 microversion: 2.1 time: 0.029221 Jun 20 07:22:40.573831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 537/971] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:40 2022] GET /compute/v2.1/servers/de77ef2f-9577-403b-99e7-2540b785a6d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:22:40.708166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ce3d33e3-098d-4044-a871-7aa7ea7386df tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Action: 'create', calling method: .version_select at 0x7ffa1fbf3700>, body: {"keypair": {"name": "tempest-keypair-726525667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+12Wtlz5yYWYvVQL0XcBknp32UCx7Lo/NEM9F4VHXz/YpDIVwjyEW4kRiLHwfxBgHqSNMzsskU50obVqqNOdtmrIO0J7223gcdmL5sVLGINrfSSF8ozV9sAk0c/10myg=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:22:40.721746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-ce3d33e3-098d-4044-a871-7aa7ea7386df tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:22:40.726223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-ce3d33e3-098d-4044-a871-7aa7ea7386df tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for user f66183ca9d884f43befaace02099c7f2 and project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:22:40.747792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ce3d33e3-098d-4044-a871-7aa7ea7386df tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044701 Jun 20 07:22:40.748421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 435/972] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 07:22:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:40.977877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-79f54bf5-9464-48fa-b4fd-80e80227f799 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:40.978794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-79f54bf5-9464-48fa-b4fd-80e80227f799 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:40.984702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79f54bf5-9464-48fa-b4fd-80e80227f799 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:40.985143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79f54bf5-9464-48fa-b4fd-80e80227f799 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:40.986258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79f54bf5-9464-48fa-b4fd-80e80227f799 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:40.986694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-79f54bf5-9464-48fa-b4fd-80e80227f799 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:41.020857 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-79f54bf5-9464-48fa-b4fd-80e80227f799 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047006 Jun 20 07:22:41.022332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 538/973] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:40 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:22:41.083088 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c98f315c-8786-429d-bbfb-34d8b8604a6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:41.084983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c98f315c-8786-429d-bbfb-34d8b8604a6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:41.091025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c98f315c-8786-429d-bbfb-34d8b8604a6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:41.091478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c98f315c-8786-429d-bbfb-34d8b8604a6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:41.092307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c98f315c-8786-429d-bbfb-34d8b8604a6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:41.092745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c98f315c-8786-429d-bbfb-34d8b8604a6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:41.122087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c98f315c-8786-429d-bbfb-34d8b8604a6a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043164 Jun 20 07:22:41.122658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 436/974] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:42.025455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1747407733", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "882e9092-6971-4957-9705-059b858de12f"}], "security_groups": [{"name": "tempest-securitygroup--718564656"}], "key_name": "tempest-keypair-726525667", "user_data": "}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:22:42.033182 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5e623671-49e4-4d67-88e3-2c8274bae3fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:42.034187 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5e623671-49e4-4d67-88e3-2c8274bae3fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:42.041170 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e623671-49e4-4d67-88e3-2c8274bae3fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:42.041621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e623671-49e4-4d67-88e3-2c8274bae3fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:42.042389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e623671-49e4-4d67-88e3-2c8274bae3fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:42.042915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e623671-49e4-4d67-88e3-2c8274bae3fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:42.074465 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5e623671-49e4-4d67-88e3-2c8274bae3fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045125 Jun 20 07:22:42.078678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 437/975] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:42 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:22:42.132776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] validate_networks() for [('882e9092-6971-4957-9705-059b858de12f', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:22:42.133726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab29187e-345c-4980-93aa-afb9441cd0df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:42.134647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab29187e-345c-4980-93aa-afb9441cd0df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:42.140822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab29187e-345c-4980-93aa-afb9441cd0df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:42.141261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab29187e-345c-4980-93aa-afb9441cd0df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:42.142044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab29187e-345c-4980-93aa-afb9441cd0df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:42.142477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab29187e-345c-4980-93aa-afb9441cd0df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:42.171694 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab29187e-345c-4980-93aa-afb9441cd0df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041831 Jun 20 07:22:42.172280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 438/976] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:42 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:22:42.610434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:22:42.610861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:22:42.611368 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:22:42.611779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:22:42.612224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:22:42.620996 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:42.621442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:42.622238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:42.622671 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:42.639532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:22:42.643440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Getting quotas for user f66183ca9d884f43befaace02099c7f2 and project 31415828d04241249f14fb3ef6a3aa0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:22:42.654752 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:22:42.657084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:22:42.703170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a3e61b5a-ffd0-4246-8acf-1f31f488ef1d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.681900 Jun 20 07:22:42.703988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 539/977] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:22:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:22:42.714173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-66fe30e5-a15b-452e-a304-9ef0b2322817 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:42.714792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-66fe30e5-a15b-452e-a304-9ef0b2322817 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:42.767061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-66fe30e5-a15b-452e-a304-9ef0b2322817 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:22:42.775021 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-66fe30e5-a15b-452e-a304-9ef0b2322817 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 200 len: 1241 microversion: 2.1 time: 0.064531 Jun 20 07:22:42.775577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 439/978] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:42 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:22:43.087250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2efa52fa-f6bd-4a29-b207-fc6171165a64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:43.088402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2efa52fa-f6bd-4a29-b207-fc6171165a64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:43.095265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2efa52fa-f6bd-4a29-b207-fc6171165a64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:43.095721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2efa52fa-f6bd-4a29-b207-fc6171165a64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:43.096771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2efa52fa-f6bd-4a29-b207-fc6171165a64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:43.097414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2efa52fa-f6bd-4a29-b207-fc6171165a64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:43.127777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2efa52fa-f6bd-4a29-b207-fc6171165a64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Jun 20 07:22:43.132304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 540/979] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:43 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:43.185130 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef8c8beb-00bd-4327-875f-6ba897e70ad4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:43.186682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ef8c8beb-00bd-4327-875f-6ba897e70ad4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:43.193877 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef8c8beb-00bd-4327-875f-6ba897e70ad4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:43.194326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef8c8beb-00bd-4327-875f-6ba897e70ad4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:43.195082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef8c8beb-00bd-4327-875f-6ba897e70ad4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:43.195544 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef8c8beb-00bd-4327-875f-6ba897e70ad4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:43.223842 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ef8c8beb-00bd-4327-875f-6ba897e70ad4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043592 Jun 20 07:22:43.224961 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 440/980] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:43 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:43.792366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5965ff03-2af3-42c7-b1b2-b215a301cdea tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:43.792915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5965ff03-2af3-42c7-b1b2-b215a301cdea tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:43.799161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5965ff03-2af3-42c7-b1b2-b215a301cdea tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:43.800178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5965ff03-2af3-42c7-b1b2-b215a301cdea tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:43.800391 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5965ff03-2af3-42c7-b1b2-b215a301cdea tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:43.801009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5965ff03-2af3-42c7-b1b2-b215a301cdea tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:43.876896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5965ff03-2af3-42c7-b1b2-b215a301cdea tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:22:43.885048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5965ff03-2af3-42c7-b1b2-b215a301cdea tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 200 len: 1299 microversion: 2.1 time: 0.096816 Jun 20 07:22:43.894672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 541/981] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:43 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:22:44.140477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6c931fa4-3cd5-48e0-9789-75240cdcf5da tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:44.141388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6c931fa4-3cd5-48e0-9789-75240cdcf5da tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:44.147949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c931fa4-3cd5-48e0-9789-75240cdcf5da tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:44.148420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c931fa4-3cd5-48e0-9789-75240cdcf5da tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:44.149169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c931fa4-3cd5-48e0-9789-75240cdcf5da tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:44.149599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c931fa4-3cd5-48e0-9789-75240cdcf5da tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:44.180251 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6c931fa4-3cd5-48e0-9789-75240cdcf5da tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043923 Jun 20 07:22:44.180832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 441/982] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:44 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:44.236446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-66dadaf9-d28f-4655-b7b9-569e24d18fab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:44.237401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-66dadaf9-d28f-4655-b7b9-569e24d18fab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:44.243806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66dadaf9-d28f-4655-b7b9-569e24d18fab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:44.244291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66dadaf9-d28f-4655-b7b9-569e24d18fab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:44.245081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66dadaf9-d28f-4655-b7b9-569e24d18fab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:44.245516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66dadaf9-d28f-4655-b7b9-569e24d18fab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:44.280123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-66dadaf9-d28f-4655-b7b9-569e24d18fab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047818 Jun 20 07:22:44.280712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 542/983] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:45.088664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b93dc1e9-cb0d-4a74-b4c1-7c898820b611 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:45.089428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b93dc1e9-cb0d-4a74-b4c1-7c898820b611 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:45.096223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b93dc1e9-cb0d-4a74-b4c1-7c898820b611 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:45.097214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b93dc1e9-cb0d-4a74-b4c1-7c898820b611 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:45.098007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b93dc1e9-cb0d-4a74-b4c1-7c898820b611 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:45.098450 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b93dc1e9-cb0d-4a74-b4c1-7c898820b611 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:45.123318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-6b69fa0e-2f40-4f62-90b5-c6f6eae44901 req-a8aaebaa-e380-4fb2-9935-6d989e56fad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ffe5f4-e1f6-4e33-9318-4ae736a72266", "tag": "56ece4d3-64a2-459e-87e3-b75711334839"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:22:45.134037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6b69fa0e-2f40-4f62-90b5-c6f6eae44901 req-a8aaebaa-e380-4fb2-9935-6d989e56fad2 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:45.134480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6b69fa0e-2f40-4f62-90b5-c6f6eae44901 req-a8aaebaa-e380-4fb2-9935-6d989e56fad2 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:45.159750 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-6b69fa0e-2f40-4f62-90b5-c6f6eae44901 req-a8aaebaa-e380-4fb2-9935-6d989e56fad2 service nova] Creating event network-changed:56ece4d3-64a2-459e-87e3-b75711334839 for instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 on hv-cinder-77819 Jun 20 07:22:45.168080 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-6b69fa0e-2f40-4f62-90b5-c6f6eae44901 req-a8aaebaa-e380-4fb2-9935-6d989e56fad2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048579 Jun 20 07:22:45.169375 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 543/984] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:22:45.386038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-445e0111-0c6d-4cb3-addf-f3359f195bd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:45.387588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-445e0111-0c6d-4cb3-addf-f3359f195bd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:45.395349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-445e0111-0c6d-4cb3-addf-f3359f195bd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:45.396609 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-445e0111-0c6d-4cb3-addf-f3359f195bd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:45.398028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-445e0111-0c6d-4cb3-addf-f3359f195bd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:45.398639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-445e0111-0c6d-4cb3-addf-f3359f195bd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:45.432923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-445e0111-0c6d-4cb3-addf-f3359f195bd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.245570 Jun 20 07:22:45.433491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 544/985] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:45 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:22:45.503784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b93dc1e9-cb0d-4a74-b4c1-7c898820b611 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:22:45.511983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b93dc1e9-cb0d-4a74-b4c1-7c898820b611 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 200 len: 1366 microversion: 2.1 time: 0.614351 Jun 20 07:22:45.512746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 442/986] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:44 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 1366 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:22:45.555087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3f12a0a2-b5a3-4293-8a89-c2e7d8f36064 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:45.556014 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3f12a0a2-b5a3-4293-8a89-c2e7d8f36064 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:45.562121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f12a0a2-b5a3-4293-8a89-c2e7d8f36064 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:45.562574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f12a0a2-b5a3-4293-8a89-c2e7d8f36064 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:45.563342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f12a0a2-b5a3-4293-8a89-c2e7d8f36064 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:45.563784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f12a0a2-b5a3-4293-8a89-c2e7d8f36064 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:45.593749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3f12a0a2-b5a3-4293-8a89-c2e7d8f36064 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159145 Jun 20 07:22:45.594313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 545/987] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:46.444507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c5886957-78ba-4f1e-aa17-afde4c21de02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:46.445588 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c5886957-78ba-4f1e-aa17-afde4c21de02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:46.451995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5886957-78ba-4f1e-aa17-afde4c21de02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:46.452475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5886957-78ba-4f1e-aa17-afde4c21de02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:46.453229 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5886957-78ba-4f1e-aa17-afde4c21de02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:46.453661 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5886957-78ba-4f1e-aa17-afde4c21de02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:46.482262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c5886957-78ba-4f1e-aa17-afde4c21de02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041756 Jun 20 07:22:46.482813 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 443/988] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:46 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:46.529499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b2abb353-7a9f-45a7-b3f6-3c2bb558c2a5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:46.530135 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b2abb353-7a9f-45a7-b3f6-3c2bb558c2a5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:46.537225 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2abb353-7a9f-45a7-b3f6-3c2bb558c2a5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:46.537567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2abb353-7a9f-45a7-b3f6-3c2bb558c2a5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:46.539893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2abb353-7a9f-45a7-b3f6-3c2bb558c2a5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:46.540354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2abb353-7a9f-45a7-b3f6-3c2bb558c2a5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:46.605145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f74a980a-92ad-431c-aa96-386b67e85ac3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:46.606115 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f74a980a-92ad-431c-aa96-386b67e85ac3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:46.612067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f74a980a-92ad-431c-aa96-386b67e85ac3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:46.612545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f74a980a-92ad-431c-aa96-386b67e85ac3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:46.613306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f74a980a-92ad-431c-aa96-386b67e85ac3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:46.613749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f74a980a-92ad-431c-aa96-386b67e85ac3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:46.645210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f74a980a-92ad-431c-aa96-386b67e85ac3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Jun 20 07:22:46.646278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 444/989] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:22:46.847893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b2abb353-7a9f-45a7-b3f6-3c2bb558c2a5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:22:46.856791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b2abb353-7a9f-45a7-b3f6-3c2bb558c2a5 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 200 len: 1366 microversion: 2.1 time: 0.331030 Jun 20 07:22:46.857394 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 546/990] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:46 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:22:47.495814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ffbdbe1c-b88f-4252-9d06-0d39df5ecbc0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:47.495814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ffbdbe1c-b88f-4252-9d06-0d39df5ecbc0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:47.502344 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffbdbe1c-b88f-4252-9d06-0d39df5ecbc0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:47.502797 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffbdbe1c-b88f-4252-9d06-0d39df5ecbc0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:47.503559 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffbdbe1c-b88f-4252-9d06-0d39df5ecbc0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:47.503997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffbdbe1c-b88f-4252-9d06-0d39df5ecbc0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:47.532969 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ffbdbe1c-b88f-4252-9d06-0d39df5ecbc0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043178 Jun 20 07:22:47.533560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 445/991] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:47 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:47.657860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c71a4e08-db4b-463c-914d-d98640fa2c59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:47.658700 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c71a4e08-db4b-463c-914d-d98640fa2c59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:47.665633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c71a4e08-db4b-463c-914d-d98640fa2c59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:47.666083 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c71a4e08-db4b-463c-914d-d98640fa2c59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:47.666871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c71a4e08-db4b-463c-914d-d98640fa2c59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:47.667300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c71a4e08-db4b-463c-914d-d98640fa2c59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:47.696084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c71a4e08-db4b-463c-914d-d98640fa2c59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042259 Jun 20 07:22:47.696674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 547/992] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:47 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:47.872871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-597d2763-4d62-4b57-a947-4d314a64cf11 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:47.873487 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-597d2763-4d62-4b57-a947-4d314a64cf11 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:47.879384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-597d2763-4d62-4b57-a947-4d314a64cf11 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:47.879831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-597d2763-4d62-4b57-a947-4d314a64cf11 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:47.880618 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-597d2763-4d62-4b57-a947-4d314a64cf11 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:47.881052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-597d2763-4d62-4b57-a947-4d314a64cf11 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:48.008819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-597d2763-4d62-4b57-a947-4d314a64cf11 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:22:48.016354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-597d2763-4d62-4b57-a947-4d314a64cf11 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 200 len: 1366 microversion: 2.1 time: 0.147278 Jun 20 07:22:48.016910 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 446/993] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:47 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:22:48.545352 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cc004ceb-7444-458e-90c9-4ec33a1e7e64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:48.546268 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cc004ceb-7444-458e-90c9-4ec33a1e7e64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:48.552312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc004ceb-7444-458e-90c9-4ec33a1e7e64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:48.552762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc004ceb-7444-458e-90c9-4ec33a1e7e64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:48.553581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc004ceb-7444-458e-90c9-4ec33a1e7e64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:48.554045 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cc004ceb-7444-458e-90c9-4ec33a1e7e64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:48.584852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cc004ceb-7444-458e-90c9-4ec33a1e7e64 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043311 Jun 20 07:22:48.585410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 548/994] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:48 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:48.709621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-353b3aa5-e049-475b-982a-709f01ebb88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:48.710023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-353b3aa5-e049-475b-982a-709f01ebb88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:48.716972 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-353b3aa5-e049-475b-982a-709f01ebb88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:48.717426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-353b3aa5-e049-475b-982a-709f01ebb88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:48.718235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-353b3aa5-e049-475b-982a-709f01ebb88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:48.718674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-353b3aa5-e049-475b-982a-709f01ebb88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:48.753249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-353b3aa5-e049-475b-982a-709f01ebb88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049143 Jun 20 07:22:48.754053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 447/995] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:48 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:48.992836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-1ffda932-325e-4956-a553-b6d5130ee2c2 req-7dc0a05e-2dda-4041-823e-13d47cc74160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ffe5f4-e1f6-4e33-9318-4ae736a72266", "name": "network-vif-plugged", "status": "completed", "tag": "56ece4d3-64a2-459e-87e3-b75711334839"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:22:49.000887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-1ffda932-325e-4956-a553-b6d5130ee2c2 req-7dc0a05e-2dda-4041-823e-13d47cc74160 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:49.001335 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-1ffda932-325e-4956-a553-b6d5130ee2c2 req-7dc0a05e-2dda-4041-823e-13d47cc74160 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:49.013209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-1ffda932-325e-4956-a553-b6d5130ee2c2 req-7dc0a05e-2dda-4041-823e-13d47cc74160 service nova] Creating event network-vif-plugged:56ece4d3-64a2-459e-87e3-b75711334839 for instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 on hv-cinder-77819 Jun 20 07:22:49.018076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-1ffda932-325e-4956-a553-b6d5130ee2c2 req-7dc0a05e-2dda-4041-823e-13d47cc74160 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084696 Jun 20 07:22:49.018661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 549/996] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:49.033066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-77818701-ed6c-4de0-aeec-22e1e57768a9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:49.033691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-77818701-ed6c-4de0-aeec-22e1e57768a9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:49.039740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77818701-ed6c-4de0-aeec-22e1e57768a9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:49.040232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77818701-ed6c-4de0-aeec-22e1e57768a9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:49.041000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77818701-ed6c-4de0-aeec-22e1e57768a9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:49.041440 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77818701-ed6c-4de0-aeec-22e1e57768a9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:49.203869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-77818701-ed6c-4de0-aeec-22e1e57768a9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:22:49.211228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-77818701-ed6c-4de0-aeec-22e1e57768a9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 200 len: 1366 microversion: 2.1 time: 0.182008 Jun 20 07:22:49.211799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 448/997] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:49 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:22:49.597089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-22162df0-f884-4db6-a807-ca3e6381169f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:49.598094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-22162df0-f884-4db6-a807-ca3e6381169f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:49.604924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22162df0-f884-4db6-a807-ca3e6381169f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:49.605376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22162df0-f884-4db6-a807-ca3e6381169f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:49.606133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22162df0-f884-4db6-a807-ca3e6381169f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:49.606564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22162df0-f884-4db6-a807-ca3e6381169f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:49.634778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-22162df0-f884-4db6-a807-ca3e6381169f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041930 Jun 20 07:22:49.635317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 550/998] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:49 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:49.765949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c9fcb9c5-f3ec-4dd6-b872-b063ada057d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:49.766881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c9fcb9c5-f3ec-4dd6-b872-b063ada057d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:49.773464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9fcb9c5-f3ec-4dd6-b872-b063ada057d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:49.773917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9fcb9c5-f3ec-4dd6-b872-b063ada057d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:49.774670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9fcb9c5-f3ec-4dd6-b872-b063ada057d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:49.775146 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9fcb9c5-f3ec-4dd6-b872-b063ada057d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:49.778735 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:22:49.804462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c9fcb9c5-f3ec-4dd6-b872-b063ada057d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042542 Jun 20 07:22:49.805006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 449/999] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:50.228225 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-028cc143-8d0a-45a3-965d-c0472ff5e559 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:50.228826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-028cc143-8d0a-45a3-965d-c0472ff5e559 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:50.235223 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-028cc143-8d0a-45a3-965d-c0472ff5e559 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:50.235664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-028cc143-8d0a-45a3-965d-c0472ff5e559 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:50.236434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-028cc143-8d0a-45a3-965d-c0472ff5e559 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:50.236862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-028cc143-8d0a-45a3-965d-c0472ff5e559 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:50.241365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:22:50.366116 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-028cc143-8d0a-45a3-965d-c0472ff5e559 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:22:50.373477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-028cc143-8d0a-45a3-965d-c0472ff5e559 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 200 len: 1366 microversion: 2.1 time: 0.149567 Jun 20 07:22:50.374049 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 551/1000] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:50 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:22:50.646959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-36d31d1e-2fd5-4779-b870-a040b446c9d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:50.647814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-36d31d1e-2fd5-4779-b870-a040b446c9d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:50.654822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36d31d1e-2fd5-4779-b870-a040b446c9d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:50.655605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36d31d1e-2fd5-4779-b870-a040b446c9d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:50.656975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36d31d1e-2fd5-4779-b870-a040b446c9d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:50.657749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36d31d1e-2fd5-4779-b870-a040b446c9d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:50.688269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-36d31d1e-2fd5-4779-b870-a040b446c9d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045655 Jun 20 07:22:50.689081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 450/1001] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:50 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:50.816082 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-70e1c6bf-f5a1-4660-93c2-e57085e903d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:50.817043 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-70e1c6bf-f5a1-4660-93c2-e57085e903d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:50.823508 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70e1c6bf-f5a1-4660-93c2-e57085e903d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:50.823962 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70e1c6bf-f5a1-4660-93c2-e57085e903d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:50.824760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70e1c6bf-f5a1-4660-93c2-e57085e903d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:50.825196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70e1c6bf-f5a1-4660-93c2-e57085e903d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:50.853387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-70e1c6bf-f5a1-4660-93c2-e57085e903d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 Jun 20 07:22:50.853944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 552/1002] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:51.390249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f475416f-2f92-4792-b648-0f7828c59d68 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:51.390905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f475416f-2f92-4792-b648-0f7828c59d68 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:51.397450 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f475416f-2f92-4792-b648-0f7828c59d68 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:51.397909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f475416f-2f92-4792-b648-0f7828c59d68 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:51.398673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f475416f-2f92-4792-b648-0f7828c59d68 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:51.399106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f475416f-2f92-4792-b648-0f7828c59d68 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:51.522147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f475416f-2f92-4792-b648-0f7828c59d68 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:22:51.529497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f475416f-2f92-4792-b648-0f7828c59d68 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 200 len: 1557 microversion: 2.1 time: 0.143087 Jun 20 07:22:51.530061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 451/1003] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:22:51 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 1557 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:22:51.545939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6300f277-38df-4e31-9610-7ce910b27c18 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:51.546423 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6300f277-38df-4e31-9610-7ce910b27c18 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:51.553452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6300f277-38df-4e31-9610-7ce910b27c18 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:51.553903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6300f277-38df-4e31-9610-7ce910b27c18 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:51.554669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6300f277-38df-4e31-9610-7ce910b27c18 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:51.555106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6300f277-38df-4e31-9610-7ce910b27c18 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:51.634513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6300f277-38df-4e31-9610-7ce910b27c18 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092393 Jun 20 07:22:51.635194 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 553/1004] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 07:22:51 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:51.699137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0bfd0959-1243-442b-82e8-ed4eb3d0c90d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:51.700061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0bfd0959-1243-442b-82e8-ed4eb3d0c90d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:51.706363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bfd0959-1243-442b-82e8-ed4eb3d0c90d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:51.706809 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bfd0959-1243-442b-82e8-ed4eb3d0c90d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:51.707590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bfd0959-1243-442b-82e8-ed4eb3d0c90d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:51.708298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bfd0959-1243-442b-82e8-ed4eb3d0c90d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:51.742644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0bfd0959-1243-442b-82e8-ed4eb3d0c90d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047385 Jun 20 07:22:51.743147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 452/1005] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:51 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:51.865038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-814d8051-b113-45b5-8ef1-73894aa1ba54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:51.866082 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-814d8051-b113-45b5-8ef1-73894aa1ba54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:51.872405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-814d8051-b113-45b5-8ef1-73894aa1ba54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:51.872849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-814d8051-b113-45b5-8ef1-73894aa1ba54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:51.873645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-814d8051-b113-45b5-8ef1-73894aa1ba54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:51.874078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-814d8051-b113-45b5-8ef1-73894aa1ba54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:51.906768 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-814d8051-b113-45b5-8ef1-73894aa1ba54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045585 Jun 20 07:22:51.907349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 554/1006] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:52.754380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-86eccc0f-c900-4e1d-a83c-f26ac017ca26 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:52.757447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-86eccc0f-c900-4e1d-a83c-f26ac017ca26 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:52.765321 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86eccc0f-c900-4e1d-a83c-f26ac017ca26 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:52.765891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86eccc0f-c900-4e1d-a83c-f26ac017ca26 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:52.766763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86eccc0f-c900-4e1d-a83c-f26ac017ca26 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:52.767302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86eccc0f-c900-4e1d-a83c-f26ac017ca26 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:52.779799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-0b3905cd-303f-44af-8855-ca8f8ca72a47 req-9dc87856-5dde-4364-8619-f10bc1a90882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ffe5f4-e1f6-4e33-9318-4ae736a72266", "tag": "56ece4d3-64a2-459e-87e3-b75711334839"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:22:52.783911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:22:52.784069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:22:52.785347 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=6 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:22:52.791801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-0b3905cd-303f-44af-8855-ca8f8ca72a47 req-9dc87856-5dde-4364-8619-f10bc1a90882 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:52.792271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-0b3905cd-303f-44af-8855-ca8f8ca72a47 req-9dc87856-5dde-4364-8619-f10bc1a90882 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:52.802061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-86eccc0f-c900-4e1d-a83c-f26ac017ca26 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051669 Jun 20 07:22:52.802959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 453/1007] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:52 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:52.803709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-0b3905cd-303f-44af-8855-ca8f8ca72a47 req-9dc87856-5dde-4364-8619-f10bc1a90882 service nova] Creating event network-changed:56ece4d3-64a2-459e-87e3-b75711334839 for instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 on hv-cinder-77819 Jun 20 07:22:52.808940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-0b3905cd-303f-44af-8855-ca8f8ca72a47 req-9dc87856-5dde-4364-8619-f10bc1a90882 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033400 Jun 20 07:22:52.809717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 555/1008] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:52.918734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6e07d461-8933-483d-b8ab-3c789ef20813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:52.919917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6e07d461-8933-483d-b8ab-3c789ef20813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:52.925818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e07d461-8933-483d-b8ab-3c789ef20813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:52.926274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e07d461-8933-483d-b8ab-3c789ef20813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:52.927074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e07d461-8933-483d-b8ab-3c789ef20813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:52.927511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e07d461-8933-483d-b8ab-3c789ef20813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:52.957448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6e07d461-8933-483d-b8ab-3c789ef20813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042583 Jun 20 07:22:52.958212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 454/1009] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:53.815005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-90588c5c-2b96-4778-b624-757ea0d2b55c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:53.815925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-90588c5c-2b96-4778-b624-757ea0d2b55c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:53.822311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90588c5c-2b96-4778-b624-757ea0d2b55c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:53.822763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90588c5c-2b96-4778-b624-757ea0d2b55c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:53.823560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90588c5c-2b96-4778-b624-757ea0d2b55c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:53.824004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90588c5c-2b96-4778-b624-757ea0d2b55c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:53.853824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-90588c5c-2b96-4778-b624-757ea0d2b55c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043605 Jun 20 07:22:53.854390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 556/1010] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:53 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:53.970007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b51e9a02-c40f-45cc-9bd1-790109a6d6b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:53.970935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b51e9a02-c40f-45cc-9bd1-790109a6d6b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:53.977892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b51e9a02-c40f-45cc-9bd1-790109a6d6b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:53.978344 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b51e9a02-c40f-45cc-9bd1-790109a6d6b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:53.979104 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b51e9a02-c40f-45cc-9bd1-790109a6d6b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:53.979544 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b51e9a02-c40f-45cc-9bd1-790109a6d6b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:54.008607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b51e9a02-c40f-45cc-9bd1-790109a6d6b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042538 Jun 20 07:22:54.009151 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 455/1011] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:54.865845 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2d61d51c-895c-4ef6-9017-15cdfd4f68a9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:54.866763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2d61d51c-895c-4ef6-9017-15cdfd4f68a9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:54.873162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d61d51c-895c-4ef6-9017-15cdfd4f68a9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:54.873606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d61d51c-895c-4ef6-9017-15cdfd4f68a9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:54.874363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d61d51c-895c-4ef6-9017-15cdfd4f68a9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:54.874791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d61d51c-895c-4ef6-9017-15cdfd4f68a9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:54.903353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2d61d51c-895c-4ef6-9017-15cdfd4f68a9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 Jun 20 07:22:54.903899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 557/1012] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:54 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:55.020199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a40bcfa3-0fec-4c65-8d82-4f6d98b5d580 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:55.021121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a40bcfa3-0fec-4c65-8d82-4f6d98b5d580 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:55.027425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a40bcfa3-0fec-4c65-8d82-4f6d98b5d580 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:55.027868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a40bcfa3-0fec-4c65-8d82-4f6d98b5d580 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:55.028655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a40bcfa3-0fec-4c65-8d82-4f6d98b5d580 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:55.029085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a40bcfa3-0fec-4c65-8d82-4f6d98b5d580 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:55.057240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a40bcfa3-0fec-4c65-8d82-4f6d98b5d580 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040967 Jun 20 07:22:55.057787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 456/1013] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:55 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:55.914487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fbc94f50-09fe-4020-b84a-a6f656374e14 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:55.915410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fbc94f50-09fe-4020-b84a-a6f656374e14 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:55.921881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbc94f50-09fe-4020-b84a-a6f656374e14 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:55.922325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbc94f50-09fe-4020-b84a-a6f656374e14 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:55.923085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbc94f50-09fe-4020-b84a-a6f656374e14 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:55.923520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbc94f50-09fe-4020-b84a-a6f656374e14 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:55.951923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fbc94f50-09fe-4020-b84a-a6f656374e14 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042066 Jun 20 07:22:55.952500 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 558/1014] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:55 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:56.069102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e8d50d07-ad0d-4680-a508-58bd0ff40813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:56.070026 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e8d50d07-ad0d-4680-a508-58bd0ff40813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:56.076397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8d50d07-ad0d-4680-a508-58bd0ff40813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:56.076841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8d50d07-ad0d-4680-a508-58bd0ff40813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:56.077584 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8d50d07-ad0d-4680-a508-58bd0ff40813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:56.078035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8d50d07-ad0d-4680-a508-58bd0ff40813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:56.106167 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e8d50d07-ad0d-4680-a508-58bd0ff40813 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041507 Jun 20 07:22:56.106703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 457/1015] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:56.963372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-74473559-efd8-4622-9f27-ce6aa8fa74f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:56.964330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-74473559-efd8-4622-9f27-ce6aa8fa74f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:56.970717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74473559-efd8-4622-9f27-ce6aa8fa74f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:56.971165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74473559-efd8-4622-9f27-ce6aa8fa74f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:56.971925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74473559-efd8-4622-9f27-ce6aa8fa74f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:56.972389 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-74473559-efd8-4622-9f27-ce6aa8fa74f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:57.000133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-74473559-efd8-4622-9f27-ce6aa8fa74f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040648 Jun 20 07:22:57.000683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 559/1016] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:56 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:57.117374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a264298c-7dd9-45f8-8e29-96b3f00d360a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:57.118322 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a264298c-7dd9-45f8-8e29-96b3f00d360a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:57.124862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a264298c-7dd9-45f8-8e29-96b3f00d360a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:57.125318 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a264298c-7dd9-45f8-8e29-96b3f00d360a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:57.126079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a264298c-7dd9-45f8-8e29-96b3f00d360a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:57.126516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a264298c-7dd9-45f8-8e29-96b3f00d360a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:57.155140 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a264298c-7dd9-45f8-8e29-96b3f00d360a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042207 Jun 20 07:22:57.155680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 458/1017] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:57 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:58.012257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-adf5b8ab-3599-49a9-9bc0-09e91c65737e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:58.013184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-adf5b8ab-3599-49a9-9bc0-09e91c65737e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:58.019585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-adf5b8ab-3599-49a9-9bc0-09e91c65737e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:58.020036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-adf5b8ab-3599-49a9-9bc0-09e91c65737e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:58.020829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-adf5b8ab-3599-49a9-9bc0-09e91c65737e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:58.021263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-adf5b8ab-3599-49a9-9bc0-09e91c65737e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:58.049230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-adf5b8ab-3599-49a9-9bc0-09e91c65737e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041154 Jun 20 07:22:58.049781 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 560/1018] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:58 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:58.167097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-65f7d59c-af3c-44bd-b864-03c74ac34722 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:58.167958 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-65f7d59c-af3c-44bd-b864-03c74ac34722 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:58.174449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65f7d59c-af3c-44bd-b864-03c74ac34722 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:58.174897 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65f7d59c-af3c-44bd-b864-03c74ac34722 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:58.175677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65f7d59c-af3c-44bd-b864-03c74ac34722 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:58.176132 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-65f7d59c-af3c-44bd-b864-03c74ac34722 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:58.204367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-65f7d59c-af3c-44bd-b864-03c74ac34722 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041241 Jun 20 07:22:58.204907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 459/1019] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:59.061096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6224e5b3-a2b3-4143-b32f-31fd3d5ee2ca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:59.062216 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6224e5b3-a2b3-4143-b32f-31fd3d5ee2ca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:59.069085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6224e5b3-a2b3-4143-b32f-31fd3d5ee2ca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:59.069528 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6224e5b3-a2b3-4143-b32f-31fd3d5ee2ca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:59.070279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6224e5b3-a2b3-4143-b32f-31fd3d5ee2ca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:59.070708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6224e5b3-a2b3-4143-b32f-31fd3d5ee2ca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:59.099474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6224e5b3-a2b3-4143-b32f-31fd3d5ee2ca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042225 Jun 20 07:22:59.099953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 561/1020] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:59 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:22:59.215679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f83d6bae-24ae-4777-922c-db3e9efe9bfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:22:59.216655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f83d6bae-24ae-4777-922c-db3e9efe9bfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:22:59.223067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f83d6bae-24ae-4777-922c-db3e9efe9bfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:59.223516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f83d6bae-24ae-4777-922c-db3e9efe9bfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:59.224359 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f83d6bae-24ae-4777-922c-db3e9efe9bfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:22:59.224797 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f83d6bae-24ae-4777-922c-db3e9efe9bfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:22:59.253828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f83d6bae-24ae-4777-922c-db3e9efe9bfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042094 Jun 20 07:22:59.254408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 460/1021] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:22:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:00.110803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e5d0fb97-763f-4477-8af5-1597f151137b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:00.111717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e5d0fb97-763f-4477-8af5-1597f151137b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:00.118092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5d0fb97-763f-4477-8af5-1597f151137b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:00.118538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5d0fb97-763f-4477-8af5-1597f151137b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:00.119300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5d0fb97-763f-4477-8af5-1597f151137b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:00.119764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5d0fb97-763f-4477-8af5-1597f151137b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:00.148752 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e5d0fb97-763f-4477-8af5-1597f151137b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041813 Jun 20 07:23:00.149307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 562/1022] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:00 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:00.266027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b8db58f-b736-4a2e-a345-7169a5ceb049 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:00.267054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4b8db58f-b736-4a2e-a345-7169a5ceb049 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:00.274087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b8db58f-b736-4a2e-a345-7169a5ceb049 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:00.274545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b8db58f-b736-4a2e-a345-7169a5ceb049 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:00.275320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b8db58f-b736-4a2e-a345-7169a5ceb049 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:00.275761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b8db58f-b736-4a2e-a345-7169a5ceb049 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:00.305764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4b8db58f-b736-4a2e-a345-7169a5ceb049 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043664 Jun 20 07:23:00.306324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 461/1023] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:00 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:01.160046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2e33ec6d-5e32-4573-a204-0e14e90255e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:01.161579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2e33ec6d-5e32-4573-a204-0e14e90255e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:01.168271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e33ec6d-5e32-4573-a204-0e14e90255e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:01.168724 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e33ec6d-5e32-4573-a204-0e14e90255e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:01.169490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e33ec6d-5e32-4573-a204-0e14e90255e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:01.169927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2e33ec6d-5e32-4573-a204-0e14e90255e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:01.198463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2e33ec6d-5e32-4573-a204-0e14e90255e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042360 Jun 20 07:23:01.199023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 563/1024] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:01 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:01.317425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-03b581e1-46e5-4ced-8460-8bb6337efa5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:01.318258 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-03b581e1-46e5-4ced-8460-8bb6337efa5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:01.324733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03b581e1-46e5-4ced-8460-8bb6337efa5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:01.325188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03b581e1-46e5-4ced-8460-8bb6337efa5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:01.325945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03b581e1-46e5-4ced-8460-8bb6337efa5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:01.326380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03b581e1-46e5-4ced-8460-8bb6337efa5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:01.355833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-03b581e1-46e5-4ced-8460-8bb6337efa5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042439 Jun 20 07:23:01.356434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 462/1025] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:01 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:02.209636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0749e6a4-44d5-4d56-901b-a4c129e60c22 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:02.210587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0749e6a4-44d5-4d56-901b-a4c129e60c22 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:02.216989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0749e6a4-44d5-4d56-901b-a4c129e60c22 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:02.217438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0749e6a4-44d5-4d56-901b-a4c129e60c22 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:02.218198 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0749e6a4-44d5-4d56-901b-a4c129e60c22 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:02.218638 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0749e6a4-44d5-4d56-901b-a4c129e60c22 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:02.246677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0749e6a4-44d5-4d56-901b-a4c129e60c22 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041673 Jun 20 07:23:02.247219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 564/1026] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:02 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:02.367943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-16cb333c-245e-4b70-8733-84cb3d2a8c99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:02.368819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-16cb333c-245e-4b70-8733-84cb3d2a8c99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:02.375103 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-16cb333c-245e-4b70-8733-84cb3d2a8c99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:02.375545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-16cb333c-245e-4b70-8733-84cb3d2a8c99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:02.376329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-16cb333c-245e-4b70-8733-84cb3d2a8c99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:02.376760 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-16cb333c-245e-4b70-8733-84cb3d2a8c99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:02.405389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-16cb333c-245e-4b70-8733-84cb3d2a8c99 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041946 Jun 20 07:23:02.405923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 463/1027] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:03.257372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-69125ae4-fb01-47e6-9cce-7f7e97d54415 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:03.258292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-69125ae4-fb01-47e6-9cce-7f7e97d54415 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:03.265155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69125ae4-fb01-47e6-9cce-7f7e97d54415 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:03.265602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69125ae4-fb01-47e6-9cce-7f7e97d54415 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:03.266362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69125ae4-fb01-47e6-9cce-7f7e97d54415 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:03.266797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-69125ae4-fb01-47e6-9cce-7f7e97d54415 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:03.296407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-69125ae4-fb01-47e6-9cce-7f7e97d54415 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042777 Jun 20 07:23:03.296891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 565/1028] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:03 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:23:03.416780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe986c3b-2fe7-45c5-b0b1-426ac314a5cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:03.417743 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe986c3b-2fe7-45c5-b0b1-426ac314a5cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:03.424278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe986c3b-2fe7-45c5-b0b1-426ac314a5cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:03.424735 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe986c3b-2fe7-45c5-b0b1-426ac314a5cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:03.425505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe986c3b-2fe7-45c5-b0b1-426ac314a5cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:03.425945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe986c3b-2fe7-45c5-b0b1-426ac314a5cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:03.454126 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe986c3b-2fe7-45c5-b0b1-426ac314a5cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041250 Jun 20 07:23:03.454673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 464/1029] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:03 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:04.308096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-987bd168-8fe7-4868-b304-727fb9e30370 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:04.309041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-987bd168-8fe7-4868-b304-727fb9e30370 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:04.315115 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-987bd168-8fe7-4868-b304-727fb9e30370 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:04.315565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-987bd168-8fe7-4868-b304-727fb9e30370 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:04.316362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-987bd168-8fe7-4868-b304-727fb9e30370 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:04.316803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-987bd168-8fe7-4868-b304-727fb9e30370 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:04.345535 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-987bd168-8fe7-4868-b304-727fb9e30370 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041342 Jun 20 07:23:04.346090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 566/1030] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:04 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:04.465955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-19caf445-1f13-4c46-b106-3469396384d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:04.466881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-19caf445-1f13-4c46-b106-3469396384d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:04.473835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19caf445-1f13-4c46-b106-3469396384d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:04.474289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19caf445-1f13-4c46-b106-3469396384d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:04.475053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19caf445-1f13-4c46-b106-3469396384d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:04.475542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19caf445-1f13-4c46-b106-3469396384d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:04.499904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:23:04.504763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-19caf445-1f13-4c46-b106-3469396384d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042778 Jun 20 07:23:04.505306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 465/1031] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:04 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:05.357417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a16d73c8-6b6e-4fd0-85ec-df48579a4a17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:05.358343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a16d73c8-6b6e-4fd0-85ec-df48579a4a17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:05.365294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a16d73c8-6b6e-4fd0-85ec-df48579a4a17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:05.365752 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a16d73c8-6b6e-4fd0-85ec-df48579a4a17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:05.366515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a16d73c8-6b6e-4fd0-85ec-df48579a4a17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:05.366953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a16d73c8-6b6e-4fd0-85ec-df48579a4a17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:05.395914 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a16d73c8-6b6e-4fd0-85ec-df48579a4a17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042429 Jun 20 07:23:05.396490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 567/1032] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:05 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:05.516689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8ae42be1-1a4f-485a-bd09-f8d4efe496d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:05.517643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8ae42be1-1a4f-485a-bd09-f8d4efe496d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:05.524058 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ae42be1-1a4f-485a-bd09-f8d4efe496d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:05.524543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ae42be1-1a4f-485a-bd09-f8d4efe496d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:05.525304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ae42be1-1a4f-485a-bd09-f8d4efe496d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:05.525745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ae42be1-1a4f-485a-bd09-f8d4efe496d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:05.554025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8ae42be1-1a4f-485a-bd09-f8d4efe496d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041583 Jun 20 07:23:05.554567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 466/1033] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:05 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:06.406705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1287eb30-1d4c-469f-9358-578a48533b5a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:06.407629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1287eb30-1d4c-469f-9358-578a48533b5a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:06.410035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:23:06.416785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1287eb30-1d4c-469f-9358-578a48533b5a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:06.417239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1287eb30-1d4c-469f-9358-578a48533b5a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:06.418004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1287eb30-1d4c-469f-9358-578a48533b5a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:06.418445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1287eb30-1d4c-469f-9358-578a48533b5a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:06.443057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:23:06.448131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1287eb30-1d4c-469f-9358-578a48533b5a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045339 Jun 20 07:23:06.448715 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 568/1034] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:06 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:06.565570 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f13b27bb-8e38-4d7b-80ab-851567a58ad8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:06.566415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f13b27bb-8e38-4d7b-80ab-851567a58ad8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:06.569245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:23:06.574433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f13b27bb-8e38-4d7b-80ab-851567a58ad8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:06.574876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f13b27bb-8e38-4d7b-80ab-851567a58ad8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:06.575623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f13b27bb-8e38-4d7b-80ab-851567a58ad8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:06.576054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f13b27bb-8e38-4d7b-80ab-851567a58ad8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:06.610375 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f13b27bb-8e38-4d7b-80ab-851567a58ad8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048659 Jun 20 07:23:06.610983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 467/1035] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:06 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:07.458848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b09c2161-0f52-4e2f-b38a-cca135a62b75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:07.459790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b09c2161-0f52-4e2f-b38a-cca135a62b75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:07.466353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b09c2161-0f52-4e2f-b38a-cca135a62b75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:07.466793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b09c2161-0f52-4e2f-b38a-cca135a62b75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:07.467543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b09c2161-0f52-4e2f-b38a-cca135a62b75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:07.467969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b09c2161-0f52-4e2f-b38a-cca135a62b75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:07.496584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b09c2161-0f52-4e2f-b38a-cca135a62b75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041717 Jun 20 07:23:07.497126 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 569/1036] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:07 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:07.622074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7bc87636-338a-4793-a3d5-90178c58d414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:07.622927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7bc87636-338a-4793-a3d5-90178c58d414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:07.629327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bc87636-338a-4793-a3d5-90178c58d414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:07.629780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bc87636-338a-4793-a3d5-90178c58d414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:07.630538 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bc87636-338a-4793-a3d5-90178c58d414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:07.631010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bc87636-338a-4793-a3d5-90178c58d414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:07.659302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7bc87636-338a-4793-a3d5-90178c58d414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041245 Jun 20 07:23:07.659851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 468/1037] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:07 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:23:08.507748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fbf78b71-1fa7-410a-99b6-4bcab140e3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:08.508700 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fbf78b71-1fa7-410a-99b6-4bcab140e3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:08.515338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbf78b71-1fa7-410a-99b6-4bcab140e3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:08.515779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbf78b71-1fa7-410a-99b6-4bcab140e3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:08.516565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbf78b71-1fa7-410a-99b6-4bcab140e3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:08.517007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbf78b71-1fa7-410a-99b6-4bcab140e3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:08.545788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fbf78b71-1fa7-410a-99b6-4bcab140e3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 Jun 20 07:23:08.546330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 570/1038] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:08 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:08.670934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-99105605-2b53-4de6-aa04-23cf0cf07d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:08.671794 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-99105605-2b53-4de6-aa04-23cf0cf07d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:08.678292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99105605-2b53-4de6-aa04-23cf0cf07d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:08.678745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99105605-2b53-4de6-aa04-23cf0cf07d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:08.679508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99105605-2b53-4de6-aa04-23cf0cf07d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:08.679947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99105605-2b53-4de6-aa04-23cf0cf07d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:08.709772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-99105605-2b53-4de6-aa04-23cf0cf07d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042832 Jun 20 07:23:08.710508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 469/1039] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:08 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:09.556961 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5f874388-bdb4-45a5-b819-dd1cac1e58ab tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:09.557881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5f874388-bdb4-45a5-b819-dd1cac1e58ab tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:09.564221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f874388-bdb4-45a5-b819-dd1cac1e58ab tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:09.564665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f874388-bdb4-45a5-b819-dd1cac1e58ab tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:09.565410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f874388-bdb4-45a5-b819-dd1cac1e58ab tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:09.565839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f874388-bdb4-45a5-b819-dd1cac1e58ab tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:09.594414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5f874388-bdb4-45a5-b819-dd1cac1e58ab tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041320 Jun 20 07:23:09.594949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 571/1040] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:09 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:09.721675 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3edf6860-3b1e-4301-9d9c-e3d8d90dd413 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:09.722545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3edf6860-3b1e-4301-9d9c-e3d8d90dd413 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:09.730094 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3edf6860-3b1e-4301-9d9c-e3d8d90dd413 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:09.730768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3edf6860-3b1e-4301-9d9c-e3d8d90dd413 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:09.731553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3edf6860-3b1e-4301-9d9c-e3d8d90dd413 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:09.731999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3edf6860-3b1e-4301-9d9c-e3d8d90dd413 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:09.762458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3edf6860-3b1e-4301-9d9c-e3d8d90dd413 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Jun 20 07:23:09.763013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 470/1041] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:09 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:10.606585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f9d4ef59-f323-494a-a794-38c8f140d75f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:10.607508 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f9d4ef59-f323-494a-a794-38c8f140d75f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:10.613994 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9d4ef59-f323-494a-a794-38c8f140d75f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:10.614441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9d4ef59-f323-494a-a794-38c8f140d75f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:10.615842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9d4ef59-f323-494a-a794-38c8f140d75f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:10.615842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9d4ef59-f323-494a-a794-38c8f140d75f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:10.647182 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f9d4ef59-f323-494a-a794-38c8f140d75f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044600 Jun 20 07:23:10.647733 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 572/1042] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:10 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:10.774649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-92b9f637-2816-42d6-a8ca-9a99b539858f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:10.775505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-92b9f637-2816-42d6-a8ca-9a99b539858f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:10.781914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92b9f637-2816-42d6-a8ca-9a99b539858f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:10.782352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92b9f637-2816-42d6-a8ca-9a99b539858f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:10.783096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92b9f637-2816-42d6-a8ca-9a99b539858f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:10.783521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92b9f637-2816-42d6-a8ca-9a99b539858f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:10.811998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-92b9f637-2816-42d6-a8ca-9a99b539858f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041841 Jun 20 07:23:10.812577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 471/1043] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:10 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:11.659847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-22af17a4-2a21-4487-af79-a45f08b13a2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:11.661350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-22af17a4-2a21-4487-af79-a45f08b13a2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:11.668262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22af17a4-2a21-4487-af79-a45f08b13a2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:11.668719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22af17a4-2a21-4487-af79-a45f08b13a2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:11.669486 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22af17a4-2a21-4487-af79-a45f08b13a2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:11.669923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22af17a4-2a21-4487-af79-a45f08b13a2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:11.704941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-22af17a4-2a21-4487-af79-a45f08b13a2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049054 Jun 20 07:23:11.705812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 573/1044] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:11 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:11.823390 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cb3a5894-57e8-4eb7-b004-03ff4c21ac56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:11.824336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cb3a5894-57e8-4eb7-b004-03ff4c21ac56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:11.830619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb3a5894-57e8-4eb7-b004-03ff4c21ac56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:11.831062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb3a5894-57e8-4eb7-b004-03ff4c21ac56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:11.831816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb3a5894-57e8-4eb7-b004-03ff4c21ac56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:11.832270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb3a5894-57e8-4eb7-b004-03ff4c21ac56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:11.860519 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cb3a5894-57e8-4eb7-b004-03ff4c21ac56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041025 Jun 20 07:23:11.861074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 472/1045] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:11 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:12.717237 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6a6678df-65a6-4593-8022-6736242ada93 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:12.718155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6a6678df-65a6-4593-8022-6736242ada93 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:12.724624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a6678df-65a6-4593-8022-6736242ada93 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:12.725076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a6678df-65a6-4593-8022-6736242ada93 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:12.725871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a6678df-65a6-4593-8022-6736242ada93 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:12.726305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a6678df-65a6-4593-8022-6736242ada93 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:12.754687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6a6678df-65a6-4593-8022-6736242ada93 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040973 Jun 20 07:23:12.755236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 574/1046] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:12 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:12.872661 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cff5017b-73ec-49c5-a631-897c8837f7f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:12.873592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cff5017b-73ec-49c5-a631-897c8837f7f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:12.880733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cff5017b-73ec-49c5-a631-897c8837f7f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:12.881126 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cff5017b-73ec-49c5-a631-897c8837f7f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:12.881892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cff5017b-73ec-49c5-a631-897c8837f7f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:12.882331 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cff5017b-73ec-49c5-a631-897c8837f7f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:12.910174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cff5017b-73ec-49c5-a631-897c8837f7f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041465 Jun 20 07:23:12.910723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 473/1047] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:12 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:13.766092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f2264ae1-9135-47c6-a85b-6914df05d036 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:13.767042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f2264ae1-9135-47c6-a85b-6914df05d036 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:13.774131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2264ae1-9135-47c6-a85b-6914df05d036 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:13.774562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2264ae1-9135-47c6-a85b-6914df05d036 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:13.775317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2264ae1-9135-47c6-a85b-6914df05d036 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:13.775753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f2264ae1-9135-47c6-a85b-6914df05d036 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:13.804217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f2264ae1-9135-47c6-a85b-6914df05d036 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042078 Jun 20 07:23:13.804761 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 575/1048] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:13 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:13.921714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-be5f441f-888f-463b-b90b-f9ef210687f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:13.922646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-be5f441f-888f-463b-b90b-f9ef210687f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:13.929272 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be5f441f-888f-463b-b90b-f9ef210687f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:13.929679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be5f441f-888f-463b-b90b-f9ef210687f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:13.930446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be5f441f-888f-463b-b90b-f9ef210687f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:13.930886 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be5f441f-888f-463b-b90b-f9ef210687f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:13.959608 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-be5f441f-888f-463b-b90b-f9ef210687f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041906 Jun 20 07:23:13.960166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 474/1049] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:13 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:14.820837 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-38baa2a9-816c-4337-9072-a4a71cab007b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:14.821793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-38baa2a9-816c-4337-9072-a4a71cab007b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:14.828256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-38baa2a9-816c-4337-9072-a4a71cab007b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:14.828712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-38baa2a9-816c-4337-9072-a4a71cab007b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:14.829478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-38baa2a9-816c-4337-9072-a4a71cab007b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:14.829917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-38baa2a9-816c-4337-9072-a4a71cab007b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:14.858866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-38baa2a9-816c-4337-9072-a4a71cab007b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042557 Jun 20 07:23:14.859412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 576/1050] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:14 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:14.970799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6db15bf5-4969-49b5-991c-0eb5c9755ce8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:14.971647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6db15bf5-4969-49b5-991c-0eb5c9755ce8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:14.978002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6db15bf5-4969-49b5-991c-0eb5c9755ce8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:14.978442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6db15bf5-4969-49b5-991c-0eb5c9755ce8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:14.979188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6db15bf5-4969-49b5-991c-0eb5c9755ce8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:14.979619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6db15bf5-4969-49b5-991c-0eb5c9755ce8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:15.007397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6db15bf5-4969-49b5-991c-0eb5c9755ce8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040593 Jun 20 07:23:15.007933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 475/1051] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:14 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:15.870606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5e6e9cc4-1068-495c-af62-7f36aef567e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:15.871530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5e6e9cc4-1068-495c-af62-7f36aef567e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:15.878025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5e6e9cc4-1068-495c-af62-7f36aef567e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:15.878485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5e6e9cc4-1068-495c-af62-7f36aef567e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:15.879900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5e6e9cc4-1068-495c-af62-7f36aef567e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:15.880378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5e6e9cc4-1068-495c-af62-7f36aef567e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:15.908461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5e6e9cc4-1068-495c-af62-7f36aef567e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041801 Jun 20 07:23:15.909010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 577/1052] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:15 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:16.018713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2398b60c-401b-4a5f-9f41-1ec88c4cf33e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:16.019637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2398b60c-401b-4a5f-9f41-1ec88c4cf33e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:16.026012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2398b60c-401b-4a5f-9f41-1ec88c4cf33e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:16.026456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2398b60c-401b-4a5f-9f41-1ec88c4cf33e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:16.027211 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2398b60c-401b-4a5f-9f41-1ec88c4cf33e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:16.027644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2398b60c-401b-4a5f-9f41-1ec88c4cf33e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:16.055933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2398b60c-401b-4a5f-9f41-1ec88c4cf33e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041104 Jun 20 07:23:16.056521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 476/1053] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:16 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:16.918702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-73aff35d-2b8c-4132-9f68-03048db36819 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:16.919647 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-73aff35d-2b8c-4132-9f68-03048db36819 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:16.926060 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73aff35d-2b8c-4132-9f68-03048db36819 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:16.926487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73aff35d-2b8c-4132-9f68-03048db36819 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:16.927241 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73aff35d-2b8c-4132-9f68-03048db36819 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:16.927667 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73aff35d-2b8c-4132-9f68-03048db36819 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:16.956485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-73aff35d-2b8c-4132-9f68-03048db36819 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041637 Jun 20 07:23:16.957040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 578/1054] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:16 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:17.067840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-18d14c07-7391-4529-9d3e-4dd04cdf077b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:17.068815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-18d14c07-7391-4529-9d3e-4dd04cdf077b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:17.075223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18d14c07-7391-4529-9d3e-4dd04cdf077b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:17.075668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18d14c07-7391-4529-9d3e-4dd04cdf077b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:17.076452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18d14c07-7391-4529-9d3e-4dd04cdf077b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:17.076883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18d14c07-7391-4529-9d3e-4dd04cdf077b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:17.105326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-18d14c07-7391-4529-9d3e-4dd04cdf077b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041931 Jun 20 07:23:17.105805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 477/1055] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:17 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:17.968213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bd8e3d94-cc26-48a4-a9b2-3187cdbc4a6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:17.969131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bd8e3d94-cc26-48a4-a9b2-3187cdbc4a6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:17.976040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd8e3d94-cc26-48a4-a9b2-3187cdbc4a6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:17.976521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd8e3d94-cc26-48a4-a9b2-3187cdbc4a6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:17.977279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd8e3d94-cc26-48a4-a9b2-3187cdbc4a6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:17.977710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd8e3d94-cc26-48a4-a9b2-3187cdbc4a6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:18.006216 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bd8e3d94-cc26-48a4-a9b2-3187cdbc4a6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041886 Jun 20 07:23:18.006763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 579/1056] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:17 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:18.116639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-47921519-aad2-4687-adba-253489b8eedc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:18.117555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-47921519-aad2-4687-adba-253489b8eedc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:18.123847 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47921519-aad2-4687-adba-253489b8eedc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:18.124343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47921519-aad2-4687-adba-253489b8eedc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:18.125090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47921519-aad2-4687-adba-253489b8eedc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:18.125546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47921519-aad2-4687-adba-253489b8eedc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:18.153859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-47921519-aad2-4687-adba-253489b8eedc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041141 Jun 20 07:23:18.154399 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 478/1057] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:18 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:19.017590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-77cf6fbd-a778-4eff-84ab-d9750f0ec984 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:19.018592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-77cf6fbd-a778-4eff-84ab-d9750f0ec984 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:19.025240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77cf6fbd-a778-4eff-84ab-d9750f0ec984 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:19.025690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77cf6fbd-a778-4eff-84ab-d9750f0ec984 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:19.026648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77cf6fbd-a778-4eff-84ab-d9750f0ec984 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:19.027075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77cf6fbd-a778-4eff-84ab-d9750f0ec984 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:19.056800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-77cf6fbd-a778-4eff-84ab-d9750f0ec984 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043128 Jun 20 07:23:19.057354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 580/1058] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:19 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:19.165936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-492fd3c9-4abd-43bc-84a6-37ba8a8ec985 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:19.166862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-492fd3c9-4abd-43bc-84a6-37ba8a8ec985 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:19.173348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-492fd3c9-4abd-43bc-84a6-37ba8a8ec985 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:19.173801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-492fd3c9-4abd-43bc-84a6-37ba8a8ec985 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:19.174567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-492fd3c9-4abd-43bc-84a6-37ba8a8ec985 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:19.175007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-492fd3c9-4abd-43bc-84a6-37ba8a8ec985 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:19.204206 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-492fd3c9-4abd-43bc-84a6-37ba8a8ec985 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042143 Jun 20 07:23:19.204706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 479/1059] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:19 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:20.068663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-de53da3c-3c48-4ff1-9513-d92ee235d967 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:20.069591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-de53da3c-3c48-4ff1-9513-d92ee235d967 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:20.076289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de53da3c-3c48-4ff1-9513-d92ee235d967 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:20.076748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de53da3c-3c48-4ff1-9513-d92ee235d967 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:20.077542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de53da3c-3c48-4ff1-9513-d92ee235d967 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:20.078007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de53da3c-3c48-4ff1-9513-d92ee235d967 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:20.106644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-de53da3c-3c48-4ff1-9513-d92ee235d967 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042407 Jun 20 07:23:20.107199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 581/1060] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:20 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:20.216000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6c25ba7e-d4ec-4ca9-b985-c6a051bde01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:20.216959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6c25ba7e-d4ec-4ca9-b985-c6a051bde01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:20.222965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c25ba7e-d4ec-4ca9-b985-c6a051bde01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:20.223417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c25ba7e-d4ec-4ca9-b985-c6a051bde01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:20.224215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c25ba7e-d4ec-4ca9-b985-c6a051bde01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:20.224658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6c25ba7e-d4ec-4ca9-b985-c6a051bde01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:20.252321 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6c25ba7e-d4ec-4ca9-b985-c6a051bde01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040485 Jun 20 07:23:20.252817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 480/1061] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:20 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:21.118107 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-71feec57-0c2d-4c2f-93d2-163a4438503b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:21.119068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-71feec57-0c2d-4c2f-93d2-163a4438503b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:21.125598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71feec57-0c2d-4c2f-93d2-163a4438503b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:21.126049 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71feec57-0c2d-4c2f-93d2-163a4438503b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:21.126811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71feec57-0c2d-4c2f-93d2-163a4438503b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:21.127248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71feec57-0c2d-4c2f-93d2-163a4438503b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:21.157406 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-71feec57-0c2d-4c2f-93d2-163a4438503b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043197 Jun 20 07:23:21.157956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 582/1062] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:21 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:21.264440 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3a9609f0-1a13-4e71-a578-3d0635b80fc9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:21.265354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3a9609f0-1a13-4e71-a578-3d0635b80fc9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:21.272185 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a9609f0-1a13-4e71-a578-3d0635b80fc9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:21.272625 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a9609f0-1a13-4e71-a578-3d0635b80fc9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:21.273370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a9609f0-1a13-4e71-a578-3d0635b80fc9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:21.273802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a9609f0-1a13-4e71-a578-3d0635b80fc9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:21.302194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3a9609f0-1a13-4e71-a578-3d0635b80fc9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041841 Jun 20 07:23:21.302676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 481/1063] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:21 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:22.168934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6dda1878-68bd-499a-bb77-41693a915d75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:22.169860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6dda1878-68bd-499a-bb77-41693a915d75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:22.175962 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6dda1878-68bd-499a-bb77-41693a915d75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:22.176420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6dda1878-68bd-499a-bb77-41693a915d75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:22.177186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6dda1878-68bd-499a-bb77-41693a915d75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:22.177629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6dda1878-68bd-499a-bb77-41693a915d75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:22.205842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6dda1878-68bd-499a-bb77-41693a915d75 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040877 Jun 20 07:23:22.206388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 583/1064] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:22 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:22.313221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f8c403ed-25d4-4d5b-8688-873debeb1ab8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:22.314173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f8c403ed-25d4-4d5b-8688-873debeb1ab8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:22.321164 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8c403ed-25d4-4d5b-8688-873debeb1ab8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:22.321620 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8c403ed-25d4-4d5b-8688-873debeb1ab8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:22.322381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8c403ed-25d4-4d5b-8688-873debeb1ab8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:22.322855 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8c403ed-25d4-4d5b-8688-873debeb1ab8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:22.339487 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:23:22.352375 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f8c403ed-25d4-4d5b-8688-873debeb1ab8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 Jun 20 07:23:22.352924 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 482/1065] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:22 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:23:23.217930 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-312eaf27-035e-4ed9-97db-fb2fda9e93ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:23.218977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-312eaf27-035e-4ed9-97db-fb2fda9e93ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:23.226217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-312eaf27-035e-4ed9-97db-fb2fda9e93ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:23.226661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-312eaf27-035e-4ed9-97db-fb2fda9e93ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:23.227417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-312eaf27-035e-4ed9-97db-fb2fda9e93ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:23.227847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-312eaf27-035e-4ed9-97db-fb2fda9e93ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:23.256059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-312eaf27-035e-4ed9-97db-fb2fda9e93ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042182 Jun 20 07:23:23.256625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 584/1066] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:23 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:23.363638 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63320a9b-653a-438f-b463-b9af464403a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:23.364519 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63320a9b-653a-438f-b463-b9af464403a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:23.370959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63320a9b-653a-438f-b463-b9af464403a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:23.371415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63320a9b-653a-438f-b463-b9af464403a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:23.372200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63320a9b-653a-438f-b463-b9af464403a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:23.372642 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63320a9b-653a-438f-b463-b9af464403a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:23.401165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63320a9b-653a-438f-b463-b9af464403a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041350 Jun 20 07:23:23.401713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 483/1067] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:23 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:24.267052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0e593a73-bd2e-47fa-b9ec-f4aeeca9579c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:24.267965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0e593a73-bd2e-47fa-b9ec-f4aeeca9579c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:24.274651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e593a73-bd2e-47fa-b9ec-f4aeeca9579c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:24.275105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e593a73-bd2e-47fa-b9ec-f4aeeca9579c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:24.275874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e593a73-bd2e-47fa-b9ec-f4aeeca9579c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:24.276341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e593a73-bd2e-47fa-b9ec-f4aeeca9579c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:24.292699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:23:24.306344 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0e593a73-bd2e-47fa-b9ec-f4aeeca9579c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043193 Jun 20 07:23:24.306898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 585/1068] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:24 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:24.413263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cd76e2df-ec58-4c07-9405-66e947220416 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:24.414130 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cd76e2df-ec58-4c07-9405-66e947220416 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:24.420623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd76e2df-ec58-4c07-9405-66e947220416 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:24.421076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd76e2df-ec58-4c07-9405-66e947220416 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:24.421832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd76e2df-ec58-4c07-9405-66e947220416 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:24.422269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd76e2df-ec58-4c07-9405-66e947220416 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:24.450421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cd76e2df-ec58-4c07-9405-66e947220416 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041679 Jun 20 07:23:24.450957 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 484/1069] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:24 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:25.317994 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-45d7b072-468e-4182-aaf2-30c5fa5ce505 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:25.318923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-45d7b072-468e-4182-aaf2-30c5fa5ce505 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:25.325183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45d7b072-468e-4182-aaf2-30c5fa5ce505 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:25.325710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45d7b072-468e-4182-aaf2-30c5fa5ce505 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:25.326486 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45d7b072-468e-4182-aaf2-30c5fa5ce505 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:25.326952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-45d7b072-468e-4182-aaf2-30c5fa5ce505 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:25.356590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-45d7b072-468e-4182-aaf2-30c5fa5ce505 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042437 Jun 20 07:23:25.357153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 586/1070] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:25 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:25.461826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-507eb53e-87a5-4019-b075-11dcb5e4745a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:25.462787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-507eb53e-87a5-4019-b075-11dcb5e4745a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:25.469218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-507eb53e-87a5-4019-b075-11dcb5e4745a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:25.469673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-507eb53e-87a5-4019-b075-11dcb5e4745a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:25.470439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-507eb53e-87a5-4019-b075-11dcb5e4745a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:25.470878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-507eb53e-87a5-4019-b075-11dcb5e4745a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:25.499905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-507eb53e-87a5-4019-b075-11dcb5e4745a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041986 Jun 20 07:23:25.500416 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 485/1071] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:25 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:26.371160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d83234af-de10-4fad-8664-b69f5833819b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:26.375344 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d83234af-de10-4fad-8664-b69f5833819b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:26.382608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d83234af-de10-4fad-8664-b69f5833819b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:26.383050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d83234af-de10-4fad-8664-b69f5833819b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:26.383835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d83234af-de10-4fad-8664-b69f5833819b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:26.384295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d83234af-de10-4fad-8664-b69f5833819b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:26.412434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d83234af-de10-4fad-8664-b69f5833819b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047368 Jun 20 07:23:26.412980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 587/1072] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:26 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:26.511388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-21fe0236-7dc3-4b6d-adeb-a5e7eb8960db tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:26.512358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-21fe0236-7dc3-4b6d-adeb-a5e7eb8960db tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:26.518741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21fe0236-7dc3-4b6d-adeb-a5e7eb8960db tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:26.519199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21fe0236-7dc3-4b6d-adeb-a5e7eb8960db tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:26.519954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21fe0236-7dc3-4b6d-adeb-a5e7eb8960db tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:26.520414 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21fe0236-7dc3-4b6d-adeb-a5e7eb8960db tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:26.548549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-21fe0236-7dc3-4b6d-adeb-a5e7eb8960db tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041239 Jun 20 07:23:26.549028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 486/1073] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:26 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:27.423738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-72acebb0-087d-4559-af9a-cf63c86bf77c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:27.424759 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-72acebb0-087d-4559-af9a-cf63c86bf77c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:27.431171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72acebb0-087d-4559-af9a-cf63c86bf77c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:27.431627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72acebb0-087d-4559-af9a-cf63c86bf77c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:27.432416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72acebb0-087d-4559-af9a-cf63c86bf77c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:27.432850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72acebb0-087d-4559-af9a-cf63c86bf77c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:27.463394 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-72acebb0-087d-4559-af9a-cf63c86bf77c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043412 Jun 20 07:23:27.464192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 588/1074] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:27 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:27.559651 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b4de393-f05b-44bf-8946-1799573fd5a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:27.560604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4b4de393-f05b-44bf-8946-1799573fd5a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:27.567386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b4de393-f05b-44bf-8946-1799573fd5a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:27.567826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b4de393-f05b-44bf-8946-1799573fd5a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:27.568607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b4de393-f05b-44bf-8946-1799573fd5a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:27.569040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b4de393-f05b-44bf-8946-1799573fd5a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:27.597371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4b4de393-f05b-44bf-8946-1799573fd5a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041549 Jun 20 07:23:27.597877 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 487/1075] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:27 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:28.474641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-59e3dd64-b50a-46a2-8642-50539baa8033 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:28.476139 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-59e3dd64-b50a-46a2-8642-50539baa8033 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:28.482629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59e3dd64-b50a-46a2-8642-50539baa8033 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:28.483083 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59e3dd64-b50a-46a2-8642-50539baa8033 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:28.484708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59e3dd64-b50a-46a2-8642-50539baa8033 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:28.485144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59e3dd64-b50a-46a2-8642-50539baa8033 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:28.515751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-59e3dd64-b50a-46a2-8642-50539baa8033 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 Jun 20 07:23:28.516353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 589/1076] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:28 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:28.608759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bbe169cd-769b-4584-be35-982870d45074 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:28.609689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bbe169cd-769b-4584-be35-982870d45074 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:28.616661 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbe169cd-769b-4584-be35-982870d45074 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:28.617116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbe169cd-769b-4584-be35-982870d45074 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:28.617880 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbe169cd-769b-4584-be35-982870d45074 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:28.618320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbe169cd-769b-4584-be35-982870d45074 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:28.647382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bbe169cd-769b-4584-be35-982870d45074 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042552 Jun 20 07:23:28.647861 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 488/1077] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:28 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:29.023342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-baa75cb1-0b64-4c73-a595-6e8fb5c333e9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:29.023839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-baa75cb1-0b64-4c73-a595-6e8fb5c333e9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:29.029823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-baa75cb1-0b64-4c73-a595-6e8fb5c333e9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:29.030270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-baa75cb1-0b64-4c73-a595-6e8fb5c333e9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:29.031031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-baa75cb1-0b64-4c73-a595-6e8fb5c333e9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:29.031469 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-baa75cb1-0b64-4c73-a595-6e8fb5c333e9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:29.055976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-baa75cb1-0b64-4c73-a595-6e8fb5c333e9 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266/ips" status: 200 len: 151 microversion: 2.1 time: 0.036427 Jun 20 07:23:29.056578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 590/1078] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 07:23:29 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:29.528266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63902c15-5fc6-4c6b-a1e6-a142145d8e6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:29.529367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63902c15-5fc6-4c6b-a1e6-a142145d8e6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:29.539536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63902c15-5fc6-4c6b-a1e6-a142145d8e6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:29.539536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63902c15-5fc6-4c6b-a1e6-a142145d8e6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:29.539536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63902c15-5fc6-4c6b-a1e6-a142145d8e6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:29.539536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63902c15-5fc6-4c6b-a1e6-a142145d8e6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:29.566879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63902c15-5fc6-4c6b-a1e6-a142145d8e6d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042105 Jun 20 07:23:29.567427 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 489/1079] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:29 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:29.657845 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-97998cc2-717b-42de-a2c1-82451ec1ed2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:29.658774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-97998cc2-717b-42de-a2c1-82451ec1ed2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:29.665682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-97998cc2-717b-42de-a2c1-82451ec1ed2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:29.666136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-97998cc2-717b-42de-a2c1-82451ec1ed2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:29.666901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-97998cc2-717b-42de-a2c1-82451ec1ed2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:29.667341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-97998cc2-717b-42de-a2c1-82451ec1ed2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:29.695849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-97998cc2-717b-42de-a2c1-82451ec1ed2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041898 Jun 20 07:23:29.696442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 591/1080] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:29 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:30.578154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b6a57a0c-cc0f-42ec-bb4a-16e24a03612e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:30.579174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b6a57a0c-cc0f-42ec-bb4a-16e24a03612e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:30.586383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6a57a0c-cc0f-42ec-bb4a-16e24a03612e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:30.586832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6a57a0c-cc0f-42ec-bb4a-16e24a03612e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:30.587587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6a57a0c-cc0f-42ec-bb4a-16e24a03612e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:30.588018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6a57a0c-cc0f-42ec-bb4a-16e24a03612e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:30.615464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b6a57a0c-cc0f-42ec-bb4a-16e24a03612e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041256 Jun 20 07:23:30.616010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 490/1081] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:30 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:30.707585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c91d859-9490-4469-8f94-9e220a2c511b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:30.708541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2c91d859-9490-4469-8f94-9e220a2c511b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:30.715002 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c91d859-9490-4469-8f94-9e220a2c511b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:30.715450 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c91d859-9490-4469-8f94-9e220a2c511b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:30.716239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c91d859-9490-4469-8f94-9e220a2c511b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:30.716673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c91d859-9490-4469-8f94-9e220a2c511b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:30.747718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2c91d859-9490-4469-8f94-9e220a2c511b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044732 Jun 20 07:23:30.748303 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 592/1082] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:30 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:31.626729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3a7dae8b-b28a-418e-a62a-be97edb45728 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:31.627768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3a7dae8b-b28a-418e-a62a-be97edb45728 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:31.634821 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a7dae8b-b28a-418e-a62a-be97edb45728 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:31.635569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a7dae8b-b28a-418e-a62a-be97edb45728 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:31.636368 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a7dae8b-b28a-418e-a62a-be97edb45728 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:31.636806 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a7dae8b-b28a-418e-a62a-be97edb45728 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:31.665508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3a7dae8b-b28a-418e-a62a-be97edb45728 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042743 Jun 20 07:23:31.666066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 491/1083] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:31 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:31.759849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3516ca1b-f77b-4745-ade3-d9c261816492 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:31.761050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3516ca1b-f77b-4745-ade3-d9c261816492 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:31.767420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3516ca1b-f77b-4745-ade3-d9c261816492 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:31.767868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3516ca1b-f77b-4745-ade3-d9c261816492 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:31.768664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3516ca1b-f77b-4745-ade3-d9c261816492 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:31.769102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3516ca1b-f77b-4745-ade3-d9c261816492 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:31.796891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3516ca1b-f77b-4745-ade3-d9c261816492 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041006 Jun 20 07:23:31.797431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 593/1084] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:31 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:32.677520 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5d6910b5-0798-4f2d-98fa-6e266b9c9d47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:32.678395 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5d6910b5-0798-4f2d-98fa-6e266b9c9d47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:32.684863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d6910b5-0798-4f2d-98fa-6e266b9c9d47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:32.685321 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d6910b5-0798-4f2d-98fa-6e266b9c9d47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:32.686091 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d6910b5-0798-4f2d-98fa-6e266b9c9d47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:32.686532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d6910b5-0798-4f2d-98fa-6e266b9c9d47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:32.716157 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5d6910b5-0798-4f2d-98fa-6e266b9c9d47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042790 Jun 20 07:23:32.716718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 492/1085] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:32 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:23:32.808737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e8e1966b-f48f-48e9-b667-361a12eeaf9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:32.809664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e8e1966b-f48f-48e9-b667-361a12eeaf9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:32.816171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8e1966b-f48f-48e9-b667-361a12eeaf9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:32.816628 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8e1966b-f48f-48e9-b667-361a12eeaf9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:32.817392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8e1966b-f48f-48e9-b667-361a12eeaf9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:32.817825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8e1966b-f48f-48e9-b667-361a12eeaf9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:32.845482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e8e1966b-f48f-48e9-b667-361a12eeaf9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040762 Jun 20 07:23:32.846021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 594/1086] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:32 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:33.726734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b75158c-fbc0-4b75-adee-5fd1beb96f36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:33.727690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b75158c-fbc0-4b75-adee-5fd1beb96f36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:33.734230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b75158c-fbc0-4b75-adee-5fd1beb96f36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:33.734619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b75158c-fbc0-4b75-adee-5fd1beb96f36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:33.735377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b75158c-fbc0-4b75-adee-5fd1beb96f36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:33.735801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b75158c-fbc0-4b75-adee-5fd1beb96f36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:33.765020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b75158c-fbc0-4b75-adee-5fd1beb96f36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042210 Jun 20 07:23:33.765569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 493/1087] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:33 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:33.856708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bf04c6a0-7870-49b1-81cd-ed817b234d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:33.857663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bf04c6a0-7870-49b1-81cd-ed817b234d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:33.864692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf04c6a0-7870-49b1-81cd-ed817b234d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:33.865151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf04c6a0-7870-49b1-81cd-ed817b234d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:33.865915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf04c6a0-7870-49b1-81cd-ed817b234d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:33.866351 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bf04c6a0-7870-49b1-81cd-ed817b234d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:33.895147 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bf04c6a0-7870-49b1-81cd-ed817b234d2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042359 Jun 20 07:23:33.895724 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 595/1088] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:33 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:34.776866 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73f2ebb8-a95b-4417-a193-078b55498e76 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:34.777928 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73f2ebb8-a95b-4417-a193-078b55498e76 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:34.784669 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73f2ebb8-a95b-4417-a193-078b55498e76 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:34.785078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73f2ebb8-a95b-4417-a193-078b55498e76 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:34.785855 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73f2ebb8-a95b-4417-a193-078b55498e76 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:34.786868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73f2ebb8-a95b-4417-a193-078b55498e76 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:34.815591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73f2ebb8-a95b-4417-a193-078b55498e76 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042644 Jun 20 07:23:34.816154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 494/1089] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:34 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:34.906653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4d5ae045-fc3c-4bb5-a8a9-6a3c41775706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:34.907572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4d5ae045-fc3c-4bb5-a8a9-6a3c41775706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:34.913692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d5ae045-fc3c-4bb5-a8a9-6a3c41775706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:34.914138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d5ae045-fc3c-4bb5-a8a9-6a3c41775706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:34.914895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d5ae045-fc3c-4bb5-a8a9-6a3c41775706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:34.915329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d5ae045-fc3c-4bb5-a8a9-6a3c41775706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:34.943298 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4d5ae045-fc3c-4bb5-a8a9-6a3c41775706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040747 Jun 20 07:23:34.943844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 596/1090] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:35.827346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2422d144-0d26-4ea4-8511-cbbc3d43d894 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:35.828324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2422d144-0d26-4ea4-8511-cbbc3d43d894 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:35.835049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2422d144-0d26-4ea4-8511-cbbc3d43d894 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:35.835446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2422d144-0d26-4ea4-8511-cbbc3d43d894 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:35.836246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2422d144-0d26-4ea4-8511-cbbc3d43d894 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:35.836688 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2422d144-0d26-4ea4-8511-cbbc3d43d894 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:35.866315 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2422d144-0d26-4ea4-8511-cbbc3d43d894 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043234 Jun 20 07:23:35.866899 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 495/1091] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:35 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:35.954490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e7f07601-bece-4b72-b17b-735a0d643dc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:35.955416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e7f07601-bece-4b72-b17b-735a0d643dc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:35.961872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7f07601-bece-4b72-b17b-735a0d643dc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:35.962322 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7f07601-bece-4b72-b17b-735a0d643dc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:35.963085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7f07601-bece-4b72-b17b-735a0d643dc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:35.963522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e7f07601-bece-4b72-b17b-735a0d643dc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:35.992548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e7f07601-bece-4b72-b17b-735a0d643dc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042004 Jun 20 07:23:35.993096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 597/1092] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:35 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:36.877430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e0d0657b-8a11-43c6-b1fb-c695c2d5701b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:36.878450 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e0d0657b-8a11-43c6-b1fb-c695c2d5701b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:36.881594 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=58 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:23:36.887183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0d0657b-8a11-43c6-b1fb-c695c2d5701b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:36.887638 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0d0657b-8a11-43c6-b1fb-c695c2d5701b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:36.888484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0d0657b-8a11-43c6-b1fb-c695c2d5701b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:36.888876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0d0657b-8a11-43c6-b1fb-c695c2d5701b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:36.917437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e0d0657b-8a11-43c6-b1fb-c695c2d5701b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 Jun 20 07:23:36.917984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 496/1093] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:36 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:37.003619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-461d3676-d2bf-4b46-9ebb-070ec907303d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:37.004562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-461d3676-d2bf-4b46-9ebb-070ec907303d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:37.007494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=60 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:23:37.012988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-461d3676-d2bf-4b46-9ebb-070ec907303d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:37.013439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-461d3676-d2bf-4b46-9ebb-070ec907303d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:37.014199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-461d3676-d2bf-4b46-9ebb-070ec907303d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:37.014634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-461d3676-d2bf-4b46-9ebb-070ec907303d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:37.042723 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-461d3676-d2bf-4b46-9ebb-070ec907303d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043075 Jun 20 07:23:37.043266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 598/1094] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:36 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:37.928720 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb7d95c1-fc45-4c97-b013-ead29f84f5b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:37.929648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb7d95c1-fc45-4c97-b013-ead29f84f5b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:37.936372 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb7d95c1-fc45-4c97-b013-ead29f84f5b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:37.936834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb7d95c1-fc45-4c97-b013-ead29f84f5b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:37.937603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb7d95c1-fc45-4c97-b013-ead29f84f5b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:37.938046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb7d95c1-fc45-4c97-b013-ead29f84f5b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:37.968406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb7d95c1-fc45-4c97-b013-ead29f84f5b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042732 Jun 20 07:23:37.968406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 497/1095] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:37 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:38.055906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d1e24a4d-f454-4126-8c6c-1029757b27be tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:38.056866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d1e24a4d-f454-4126-8c6c-1029757b27be tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:38.063695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1e24a4d-f454-4126-8c6c-1029757b27be tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:38.064315 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1e24a4d-f454-4126-8c6c-1029757b27be tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:38.065086 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1e24a4d-f454-4126-8c6c-1029757b27be tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:38.065517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1e24a4d-f454-4126-8c6c-1029757b27be tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:38.094593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d1e24a4d-f454-4126-8c6c-1029757b27be tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Jun 20 07:23:38.095152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 599/1096] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:38 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:38.979167 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab1181a1-f95b-43af-924a-99cced83cc92 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:38.980087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab1181a1-f95b-43af-924a-99cced83cc92 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:38.986543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab1181a1-f95b-43af-924a-99cced83cc92 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:38.986986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab1181a1-f95b-43af-924a-99cced83cc92 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:38.987734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab1181a1-f95b-43af-924a-99cced83cc92 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:38.988191 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab1181a1-f95b-43af-924a-99cced83cc92 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:39.017529 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab1181a1-f95b-43af-924a-99cced83cc92 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042216 Jun 20 07:23:39.018076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 498/1097] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:38 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:39.106204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-16aae19b-9003-4790-bfb4-aaccfd535559 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:39.107153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-16aae19b-9003-4790-bfb4-aaccfd535559 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:39.113768 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16aae19b-9003-4790-bfb4-aaccfd535559 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:39.114217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16aae19b-9003-4790-bfb4-aaccfd535559 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:39.114984 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16aae19b-9003-4790-bfb4-aaccfd535559 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:39.115420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16aae19b-9003-4790-bfb4-aaccfd535559 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:39.143545 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-16aae19b-9003-4790-bfb4-aaccfd535559 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041324 Jun 20 07:23:39.144096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 600/1098] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:39 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:40.029402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff567dcb-de97-48ae-9916-cae6d9416520 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:40.030327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff567dcb-de97-48ae-9916-cae6d9416520 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:40.037225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff567dcb-de97-48ae-9916-cae6d9416520 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:40.037676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff567dcb-de97-48ae-9916-cae6d9416520 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:40.043053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff567dcb-de97-48ae-9916-cae6d9416520 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:40.043921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff567dcb-de97-48ae-9916-cae6d9416520 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:40.048072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:23:40.074838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff567dcb-de97-48ae-9916-cae6d9416520 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049379 Jun 20 07:23:40.075386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 499/1099] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:40 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:40.154764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6f4c3f08-3adb-4c8c-b0c3-612db36f32ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:40.155680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6f4c3f08-3adb-4c8c-b0c3-612db36f32ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:40.162568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f4c3f08-3adb-4c8c-b0c3-612db36f32ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:40.163012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f4c3f08-3adb-4c8c-b0c3-612db36f32ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:40.163769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f4c3f08-3adb-4c8c-b0c3-612db36f32ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:40.164229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6f4c3f08-3adb-4c8c-b0c3-612db36f32ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:40.192488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6f4c3f08-3adb-4c8c-b0c3-612db36f32ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041625 Jun 20 07:23:40.193068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 601/1100] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:40 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:41.086968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-037a5af0-be7c-41f5-8085-4f043f178e56 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:41.087819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-037a5af0-be7c-41f5-8085-4f043f178e56 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:41.094492 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-037a5af0-be7c-41f5-8085-4f043f178e56 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:41.094935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-037a5af0-be7c-41f5-8085-4f043f178e56 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:41.095687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-037a5af0-be7c-41f5-8085-4f043f178e56 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:41.096128 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-037a5af0-be7c-41f5-8085-4f043f178e56 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:41.124032 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-037a5af0-be7c-41f5-8085-4f043f178e56 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041602 Jun 20 07:23:41.124611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 500/1101] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:41 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:41.203800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-57306972-8b57-438d-8412-14a84eaa01a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:41.204808 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-57306972-8b57-438d-8412-14a84eaa01a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:41.211915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57306972-8b57-438d-8412-14a84eaa01a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:41.212467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57306972-8b57-438d-8412-14a84eaa01a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:41.213235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57306972-8b57-438d-8412-14a84eaa01a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:41.213675 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57306972-8b57-438d-8412-14a84eaa01a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:41.230399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:23:41.243672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-57306972-8b57-438d-8412-14a84eaa01a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043774 Jun 20 07:23:41.244245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 602/1102] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:42.135706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b54d9b65-1046-4242-8008-7a093d32d0a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:42.136661 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b54d9b65-1046-4242-8008-7a093d32d0a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:42.144749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b54d9b65-1046-4242-8008-7a093d32d0a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:42.145211 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b54d9b65-1046-4242-8008-7a093d32d0a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:42.145989 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b54d9b65-1046-4242-8008-7a093d32d0a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:42.146430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b54d9b65-1046-4242-8008-7a093d32d0a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:42.175030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b54d9b65-1046-4242-8008-7a093d32d0a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043672 Jun 20 07:23:42.175838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 501/1103] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:42 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:42.255769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-22a3cbe0-2f91-4f07-af01-e158eba6f67c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:42.256685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-22a3cbe0-2f91-4f07-af01-e158eba6f67c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:42.263497 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22a3cbe0-2f91-4f07-af01-e158eba6f67c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:42.263955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22a3cbe0-2f91-4f07-af01-e158eba6f67c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:42.264772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22a3cbe0-2f91-4f07-af01-e158eba6f67c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:42.265237 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22a3cbe0-2f91-4f07-af01-e158eba6f67c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:42.293456 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-22a3cbe0-2f91-4f07-af01-e158eba6f67c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042332 Jun 20 07:23:42.294007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 603/1104] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:42 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:43.186737 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d22e0110-70c0-4c57-864e-fdfd1451a6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:43.187685 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d22e0110-70c0-4c57-864e-fdfd1451a6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:43.194908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d22e0110-70c0-4c57-864e-fdfd1451a6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:43.195349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d22e0110-70c0-4c57-864e-fdfd1451a6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:43.196135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d22e0110-70c0-4c57-864e-fdfd1451a6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:43.196579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d22e0110-70c0-4c57-864e-fdfd1451a6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:43.225348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d22e0110-70c0-4c57-864e-fdfd1451a6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042545 Jun 20 07:23:43.226062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 502/1105] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:43 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:43.305024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a72ed6a4-dfd1-44a2-a7d2-33d1c2da5150 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:43.305937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a72ed6a4-dfd1-44a2-a7d2-33d1c2da5150 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:43.312319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72ed6a4-dfd1-44a2-a7d2-33d1c2da5150 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:43.312763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72ed6a4-dfd1-44a2-a7d2-33d1c2da5150 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:43.313511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72ed6a4-dfd1-44a2-a7d2-33d1c2da5150 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:43.313938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72ed6a4-dfd1-44a2-a7d2-33d1c2da5150 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:43.342735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a72ed6a4-dfd1-44a2-a7d2-33d1c2da5150 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041724 Jun 20 07:23:43.343270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 604/1106] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:43 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:44.236597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-631e65dd-338c-43ed-83fe-4eefce34a2f6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:44.237537 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-631e65dd-338c-43ed-83fe-4eefce34a2f6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:44.244561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-631e65dd-338c-43ed-83fe-4eefce34a2f6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:44.245009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-631e65dd-338c-43ed-83fe-4eefce34a2f6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:44.245761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-631e65dd-338c-43ed-83fe-4eefce34a2f6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:44.246196 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-631e65dd-338c-43ed-83fe-4eefce34a2f6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:44.275471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-631e65dd-338c-43ed-83fe-4eefce34a2f6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042760 Jun 20 07:23:44.279550 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 503/1107] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:44 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:44.354931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-70453d11-98aa-400a-ab36-c779184f293f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:44.355858 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-70453d11-98aa-400a-ab36-c779184f293f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:44.362295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70453d11-98aa-400a-ab36-c779184f293f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:44.362749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70453d11-98aa-400a-ab36-c779184f293f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:44.363513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70453d11-98aa-400a-ab36-c779184f293f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:44.364065 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70453d11-98aa-400a-ab36-c779184f293f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:44.392184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-70453d11-98aa-400a-ab36-c779184f293f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041275 Jun 20 07:23:44.392731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 605/1108] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:45.094878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:23:45.095045 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:23:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:23:45.286813 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-893e67ba-3456-4970-b855-58c6d4fcadd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:45.287733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-893e67ba-3456-4970-b855-58c6d4fcadd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:45.294599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893e67ba-3456-4970-b855-58c6d4fcadd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:45.295076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893e67ba-3456-4970-b855-58c6d4fcadd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:45.295853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893e67ba-3456-4970-b855-58c6d4fcadd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:45.296412 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893e67ba-3456-4970-b855-58c6d4fcadd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:45.333009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-893e67ba-3456-4970-b855-58c6d4fcadd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050158 Jun 20 07:23:45.333741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 504/1109] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:45 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:45.404317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ff7dfd77-c5ce-4b0c-a593-a018be062ec1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:45.405279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ff7dfd77-c5ce-4b0c-a593-a018be062ec1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:45.412411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff7dfd77-c5ce-4b0c-a593-a018be062ec1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:45.412866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff7dfd77-c5ce-4b0c-a593-a018be062ec1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:45.413628 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff7dfd77-c5ce-4b0c-a593-a018be062ec1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:45.414070 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff7dfd77-c5ce-4b0c-a593-a018be062ec1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:45.442998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ff7dfd77-c5ce-4b0c-a593-a018be062ec1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042705 Jun 20 07:23:45.443545 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 606/1110] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:46.344623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-917b020a-7f07-4a1d-a765-4c00600b4bbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:46.345578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-917b020a-7f07-4a1d-a765-4c00600b4bbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:46.351958 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-917b020a-7f07-4a1d-a765-4c00600b4bbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:46.352468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-917b020a-7f07-4a1d-a765-4c00600b4bbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:46.353235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-917b020a-7f07-4a1d-a765-4c00600b4bbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:46.353674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-917b020a-7f07-4a1d-a765-4c00600b4bbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:46.390065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-917b020a-7f07-4a1d-a765-4c00600b4bbd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 Jun 20 07:23:46.390065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 505/1111] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:46 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:46.454348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-289c4737-ba93-479e-a197-5b356d3d3bae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:46.455264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-289c4737-ba93-479e-a197-5b356d3d3bae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:46.463939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-289c4737-ba93-479e-a197-5b356d3d3bae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:46.463939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-289c4737-ba93-479e-a197-5b356d3d3bae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:46.463939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-289c4737-ba93-479e-a197-5b356d3d3bae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:46.464258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-289c4737-ba93-479e-a197-5b356d3d3bae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:46.493486 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-289c4737-ba93-479e-a197-5b356d3d3bae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043012 Jun 20 07:23:46.494046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 607/1112] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:47.397257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b3cf1ff8-e452-4738-8503-bf37228e7d84 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:47.398180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b3cf1ff8-e452-4738-8503-bf37228e7d84 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:47.404660 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3cf1ff8-e452-4738-8503-bf37228e7d84 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:47.405114 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3cf1ff8-e452-4738-8503-bf37228e7d84 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:47.405885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3cf1ff8-e452-4738-8503-bf37228e7d84 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:47.406320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3cf1ff8-e452-4738-8503-bf37228e7d84 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:47.435052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b3cf1ff8-e452-4738-8503-bf37228e7d84 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042252 Jun 20 07:23:47.435607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 506/1113] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:47 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:47.504583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6a5651c8-deb2-4bce-adbf-03e9fd3887b3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:47.505533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6a5651c8-deb2-4bce-adbf-03e9fd3887b3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:47.512395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a5651c8-deb2-4bce-adbf-03e9fd3887b3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:47.512845 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a5651c8-deb2-4bce-adbf-03e9fd3887b3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:47.513601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a5651c8-deb2-4bce-adbf-03e9fd3887b3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:47.514035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6a5651c8-deb2-4bce-adbf-03e9fd3887b3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:47.544590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6a5651c8-deb2-4bce-adbf-03e9fd3887b3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Jun 20 07:23:47.545152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 608/1114] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:47 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:48.446173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-26677dc6-d63a-4ae3-9262-fe119be7985e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:48.447124 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-26677dc6-d63a-4ae3-9262-fe119be7985e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:48.453641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26677dc6-d63a-4ae3-9262-fe119be7985e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:48.454092 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26677dc6-d63a-4ae3-9262-fe119be7985e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:48.454855 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26677dc6-d63a-4ae3-9262-fe119be7985e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:48.455294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26677dc6-d63a-4ae3-9262-fe119be7985e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:48.484060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-26677dc6-d63a-4ae3-9262-fe119be7985e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041776 Jun 20 07:23:48.484498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 507/1115] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:48 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:48.556127 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-532d4956-ba99-4bfb-a398-489774ee3dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:48.557039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-532d4956-ba99-4bfb-a398-489774ee3dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:48.563386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-532d4956-ba99-4bfb-a398-489774ee3dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:48.563829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-532d4956-ba99-4bfb-a398-489774ee3dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:48.564613 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-532d4956-ba99-4bfb-a398-489774ee3dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:48.565044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-532d4956-ba99-4bfb-a398-489774ee3dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:48.592800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-532d4956-ba99-4bfb-a398-489774ee3dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040651 Jun 20 07:23:48.593337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 609/1116] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:48 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:49.495730 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3b6864e2-e56d-4efe-9eb0-892e3baefea6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:49.496720 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3b6864e2-e56d-4efe-9eb0-892e3baefea6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:49.502850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b6864e2-e56d-4efe-9eb0-892e3baefea6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:49.503367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b6864e2-e56d-4efe-9eb0-892e3baefea6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:49.504193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b6864e2-e56d-4efe-9eb0-892e3baefea6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:49.504636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b6864e2-e56d-4efe-9eb0-892e3baefea6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:49.534706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3b6864e2-e56d-4efe-9eb0-892e3baefea6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042919 Jun 20 07:23:49.535263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 508/1117] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:49 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:49.604065 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d0e67e26-836f-400c-84c3-7cd62b18265a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:49.605035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d0e67e26-836f-400c-84c3-7cd62b18265a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:49.611540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0e67e26-836f-400c-84c3-7cd62b18265a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:49.612025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0e67e26-836f-400c-84c3-7cd62b18265a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:49.612822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0e67e26-836f-400c-84c3-7cd62b18265a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:49.613265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0e67e26-836f-400c-84c3-7cd62b18265a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:49.647876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d0e67e26-836f-400c-84c3-7cd62b18265a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047680 Jun 20 07:23:49.648652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 610/1118] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:50.546126 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e40aeb32-7ab0-4b95-8ace-e49e494b95cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:50.547067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e40aeb32-7ab0-4b95-8ace-e49e494b95cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:50.553843 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e40aeb32-7ab0-4b95-8ace-e49e494b95cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:50.554297 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e40aeb32-7ab0-4b95-8ace-e49e494b95cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:50.555009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e40aeb32-7ab0-4b95-8ace-e49e494b95cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:50.555444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e40aeb32-7ab0-4b95-8ace-e49e494b95cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:50.584076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e40aeb32-7ab0-4b95-8ace-e49e494b95cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041934 Jun 20 07:23:50.584713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 509/1119] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:50 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:50.659821 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1cff23df-a091-474c-9be5-007b12070e22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:50.660720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1cff23df-a091-474c-9be5-007b12070e22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:50.667192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1cff23df-a091-474c-9be5-007b12070e22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:50.667645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1cff23df-a091-474c-9be5-007b12070e22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:50.668436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1cff23df-a091-474c-9be5-007b12070e22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:50.668874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1cff23df-a091-474c-9be5-007b12070e22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:50.697343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1cff23df-a091-474c-9be5-007b12070e22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041496 Jun 20 07:23:50.697905 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 611/1120] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:51.594730 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8dcd9b25-b73e-4889-bdd5-407ce5e4ca42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:51.595660 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8dcd9b25-b73e-4889-bdd5-407ce5e4ca42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:51.603208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8dcd9b25-b73e-4889-bdd5-407ce5e4ca42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:51.603670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8dcd9b25-b73e-4889-bdd5-407ce5e4ca42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:51.604474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8dcd9b25-b73e-4889-bdd5-407ce5e4ca42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:51.604951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8dcd9b25-b73e-4889-bdd5-407ce5e4ca42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:51.634294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8dcd9b25-b73e-4889-bdd5-407ce5e4ca42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 Jun 20 07:23:51.635114 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 510/1121] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:51 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:51.708639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cf1b94f8-496a-4838-b522-b8d47c24e20f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:51.709557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cf1b94f8-496a-4838-b522-b8d47c24e20f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:51.716055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf1b94f8-496a-4838-b522-b8d47c24e20f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:51.716538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf1b94f8-496a-4838-b522-b8d47c24e20f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:51.717308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf1b94f8-496a-4838-b522-b8d47c24e20f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:51.717746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf1b94f8-496a-4838-b522-b8d47c24e20f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:51.746785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cf1b94f8-496a-4838-b522-b8d47c24e20f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042229 Jun 20 07:23:51.747334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 612/1122] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:52.545164 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:23:52.545307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:23:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:23:52.645273 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-27aa2dc8-948b-47f3-957b-3efad5533440 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:52.646200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-27aa2dc8-948b-47f3-957b-3efad5533440 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:52.652758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27aa2dc8-948b-47f3-957b-3efad5533440 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:52.653209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27aa2dc8-948b-47f3-957b-3efad5533440 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:52.653979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27aa2dc8-948b-47f3-957b-3efad5533440 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:52.654419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27aa2dc8-948b-47f3-957b-3efad5533440 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:52.684031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-27aa2dc8-948b-47f3-957b-3efad5533440 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042630 Jun 20 07:23:52.684647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 511/1123] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:52 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:52.758816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-235e3e08-ef26-4f0e-a29a-45be5930c034 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:52.759729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-235e3e08-ef26-4f0e-a29a-45be5930c034 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:52.766362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-235e3e08-ef26-4f0e-a29a-45be5930c034 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:52.766811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-235e3e08-ef26-4f0e-a29a-45be5930c034 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:52.767563 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-235e3e08-ef26-4f0e-a29a-45be5930c034 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:52.767995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-235e3e08-ef26-4f0e-a29a-45be5930c034 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:52.798160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-235e3e08-ef26-4f0e-a29a-45be5930c034 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Jun 20 07:23:52.798719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 613/1124] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:53.695228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-657ca061-bbf7-4080-ba27-2568f027dbe5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:53.696182 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-657ca061-bbf7-4080-ba27-2568f027dbe5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:53.705333 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-657ca061-bbf7-4080-ba27-2568f027dbe5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:53.705794 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-657ca061-bbf7-4080-ba27-2568f027dbe5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:53.706577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-657ca061-bbf7-4080-ba27-2568f027dbe5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:53.707008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-657ca061-bbf7-4080-ba27-2568f027dbe5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:53.737596 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-657ca061-bbf7-4080-ba27-2568f027dbe5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046739 Jun 20 07:23:53.738164 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 512/1125] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:53 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:53.809219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-95a825de-bad9-4e38-b95b-a236ce513d2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:53.810144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-95a825de-bad9-4e38-b95b-a236ce513d2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:53.816597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95a825de-bad9-4e38-b95b-a236ce513d2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:53.817047 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95a825de-bad9-4e38-b95b-a236ce513d2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:53.818367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95a825de-bad9-4e38-b95b-a236ce513d2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:53.818805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-95a825de-bad9-4e38-b95b-a236ce513d2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:53.847056 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-95a825de-bad9-4e38-b95b-a236ce513d2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041700 Jun 20 07:23:53.847597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 614/1126] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:54.749550 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-14345b19-d92a-4950-8417-1c5b12287e87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:54.750467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-14345b19-d92a-4950-8417-1c5b12287e87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:54.756935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14345b19-d92a-4950-8417-1c5b12287e87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:54.757383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14345b19-d92a-4950-8417-1c5b12287e87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:54.758137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14345b19-d92a-4950-8417-1c5b12287e87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:54.758574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14345b19-d92a-4950-8417-1c5b12287e87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:54.788542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-14345b19-d92a-4950-8417-1c5b12287e87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042796 Jun 20 07:23:54.789113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 513/1127] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:54 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:54.858434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7c1b0311-6efb-4b46-b520-89163e0d654a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:54.859358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7c1b0311-6efb-4b46-b520-89163e0d654a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:54.865835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c1b0311-6efb-4b46-b520-89163e0d654a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:54.866277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c1b0311-6efb-4b46-b520-89163e0d654a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:54.867032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c1b0311-6efb-4b46-b520-89163e0d654a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:54.867466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c1b0311-6efb-4b46-b520-89163e0d654a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:54.897028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7c1b0311-6efb-4b46-b520-89163e0d654a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042544 Jun 20 07:23:54.897575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 615/1128] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:54 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:55.799839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eca38a16-afaa-4fa7-a1a8-5862c56e4dff tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:55.800790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eca38a16-afaa-4fa7-a1a8-5862c56e4dff tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:55.807804 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eca38a16-afaa-4fa7-a1a8-5862c56e4dff tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:55.808298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eca38a16-afaa-4fa7-a1a8-5862c56e4dff tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:55.809058 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eca38a16-afaa-4fa7-a1a8-5862c56e4dff tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:55.809494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eca38a16-afaa-4fa7-a1a8-5862c56e4dff tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:55.839709 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eca38a16-afaa-4fa7-a1a8-5862c56e4dff tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043708 Jun 20 07:23:55.840851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 514/1129] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:55 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:55.908024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e1097301-5722-4b8b-a0bc-bdfa0929485d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:55.908976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e1097301-5722-4b8b-a0bc-bdfa0929485d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:55.915958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1097301-5722-4b8b-a0bc-bdfa0929485d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:55.916444 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1097301-5722-4b8b-a0bc-bdfa0929485d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:55.917214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1097301-5722-4b8b-a0bc-bdfa0929485d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:55.917653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1097301-5722-4b8b-a0bc-bdfa0929485d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:55.946241 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e1097301-5722-4b8b-a0bc-bdfa0929485d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042086 Jun 20 07:23:55.946785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 616/1130] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:55 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:56.851064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ee28de47-9c4f-4e07-a013-3d42d3e6b6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:56.851974 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ee28de47-9c4f-4e07-a013-3d42d3e6b6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:56.858287 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee28de47-9c4f-4e07-a013-3d42d3e6b6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:56.858730 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee28de47-9c4f-4e07-a013-3d42d3e6b6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:56.859479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee28de47-9c4f-4e07-a013-3d42d3e6b6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:56.859906 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee28de47-9c4f-4e07-a013-3d42d3e6b6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:56.884430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:23:56.889724 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ee28de47-9c4f-4e07-a013-3d42d3e6b6a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042539 Jun 20 07:23:56.890281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 515/1131] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:56 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:56.959444 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4c7ce042-c5fd-4e6b-8d36-1d2f4b555e1f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:56.960408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4c7ce042-c5fd-4e6b-8d36-1d2f4b555e1f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:56.966741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c7ce042-c5fd-4e6b-8d36-1d2f4b555e1f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:56.967192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c7ce042-c5fd-4e6b-8d36-1d2f4b555e1f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:56.967940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c7ce042-c5fd-4e6b-8d36-1d2f4b555e1f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:56.968397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c7ce042-c5fd-4e6b-8d36-1d2f4b555e1f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:56.996910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4c7ce042-c5fd-4e6b-8d36-1d2f4b555e1f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041943 Jun 20 07:23:56.997408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 617/1132] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:57.901668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-33348e76-ff58-43a9-aab3-09e2237b3bce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:57.902579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-33348e76-ff58-43a9-aab3-09e2237b3bce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:57.908857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33348e76-ff58-43a9-aab3-09e2237b3bce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:57.909304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33348e76-ff58-43a9-aab3-09e2237b3bce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:57.910057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33348e76-ff58-43a9-aab3-09e2237b3bce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:57.910488 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33348e76-ff58-43a9-aab3-09e2237b3bce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:57.939079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-33348e76-ff58-43a9-aab3-09e2237b3bce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041443 Jun 20 07:23:57.939634 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 516/1133] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:57 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:58.008189 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d1e00f64-2bb1-4d0d-8f98-1f3f970476a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:58.009050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d1e00f64-2bb1-4d0d-8f98-1f3f970476a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:58.015693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1e00f64-2bb1-4d0d-8f98-1f3f970476a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:58.016163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1e00f64-2bb1-4d0d-8f98-1f3f970476a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:58.016920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1e00f64-2bb1-4d0d-8f98-1f3f970476a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:58.017353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d1e00f64-2bb1-4d0d-8f98-1f3f970476a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:58.045803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d1e00f64-2bb1-4d0d-8f98-1f3f970476a1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041580 Jun 20 07:23:58.046334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 618/1134] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:58.955540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-52273e53-b0bf-446d-b9d0-ee187a229a3d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:58.956488 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-52273e53-b0bf-446d-b9d0-ee187a229a3d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:58.962870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52273e53-b0bf-446d-b9d0-ee187a229a3d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:58.963313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52273e53-b0bf-446d-b9d0-ee187a229a3d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:58.964063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52273e53-b0bf-446d-b9d0-ee187a229a3d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:58.964523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52273e53-b0bf-446d-b9d0-ee187a229a3d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:58.993922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-52273e53-b0bf-446d-b9d0-ee187a229a3d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042280 Jun 20 07:23:58.994664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 517/1135] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:58 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:23:59.057744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e67cc408-eca4-41b4-9a6a-1aeccea0e182 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:23:59.058648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e67cc408-eca4-41b4-9a6a-1aeccea0e182 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:23:59.065035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e67cc408-eca4-41b4-9a6a-1aeccea0e182 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:59.065479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e67cc408-eca4-41b4-9a6a-1aeccea0e182 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:59.066227 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e67cc408-eca4-41b4-9a6a-1aeccea0e182 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:23:59.066656 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e67cc408-eca4-41b4-9a6a-1aeccea0e182 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:23:59.070251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:23:59.094825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e67cc408-eca4-41b4-9a6a-1aeccea0e182 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040931 Jun 20 07:23:59.095371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 619/1136] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:23:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:00.005266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fa6f6889-11f3-4b6e-88aa-1cb91b0fa653 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:00.006196 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fa6f6889-11f3-4b6e-88aa-1cb91b0fa653 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:00.012928 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa6f6889-11f3-4b6e-88aa-1cb91b0fa653 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:00.013379 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa6f6889-11f3-4b6e-88aa-1cb91b0fa653 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:00.014135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa6f6889-11f3-4b6e-88aa-1cb91b0fa653 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:00.014569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa6f6889-11f3-4b6e-88aa-1cb91b0fa653 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:00.044048 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fa6f6889-11f3-4b6e-88aa-1cb91b0fa653 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042672 Jun 20 07:24:00.044631 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 518/1137] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:00 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:00.107060 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0f59049b-380b-4dce-8cf9-12110b512337 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:00.107972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0f59049b-380b-4dce-8cf9-12110b512337 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:00.114329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f59049b-380b-4dce-8cf9-12110b512337 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:00.114773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f59049b-380b-4dce-8cf9-12110b512337 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:00.115517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f59049b-380b-4dce-8cf9-12110b512337 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:00.115941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f59049b-380b-4dce-8cf9-12110b512337 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:00.143594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0f59049b-380b-4dce-8cf9-12110b512337 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040537 Jun 20 07:24:00.144133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 620/1138] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:00 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:01.056137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c00696e3-4f1c-44ce-80da-78126c3fa70c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:01.057088 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c00696e3-4f1c-44ce-80da-78126c3fa70c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:01.064612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c00696e3-4f1c-44ce-80da-78126c3fa70c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:01.065082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c00696e3-4f1c-44ce-80da-78126c3fa70c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:01.065867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c00696e3-4f1c-44ce-80da-78126c3fa70c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:01.066312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c00696e3-4f1c-44ce-80da-78126c3fa70c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:01.104305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c00696e3-4f1c-44ce-80da-78126c3fa70c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052633 Jun 20 07:24:01.104867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 519/1139] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:01 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:01.155309 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-749b16fb-c2eb-4a54-89c4-3f372288ce59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:01.156256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-749b16fb-c2eb-4a54-89c4-3f372288ce59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:01.163154 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-749b16fb-c2eb-4a54-89c4-3f372288ce59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:01.163599 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-749b16fb-c2eb-4a54-89c4-3f372288ce59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:01.164387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-749b16fb-c2eb-4a54-89c4-3f372288ce59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:01.164822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-749b16fb-c2eb-4a54-89c4-3f372288ce59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:01.193234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-749b16fb-c2eb-4a54-89c4-3f372288ce59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041844 Jun 20 07:24:01.193780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 621/1140] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:01 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:02.116466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a79917b7-b959-4256-a5d2-db39e6cc42a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:02.117393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a79917b7-b959-4256-a5d2-db39e6cc42a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:02.123816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a79917b7-b959-4256-a5d2-db39e6cc42a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:02.124320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a79917b7-b959-4256-a5d2-db39e6cc42a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:02.125087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a79917b7-b959-4256-a5d2-db39e6cc42a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:02.125524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a79917b7-b959-4256-a5d2-db39e6cc42a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:02.153949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a79917b7-b959-4256-a5d2-db39e6cc42a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042055 Jun 20 07:24:02.154725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 520/1141] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:02 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:02.204034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0304b31f-ab8b-4952-a9ca-e6f3b943b4cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:02.204938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0304b31f-ab8b-4952-a9ca-e6f3b943b4cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:02.211357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0304b31f-ab8b-4952-a9ca-e6f3b943b4cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:02.211804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0304b31f-ab8b-4952-a9ca-e6f3b943b4cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:02.212593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0304b31f-ab8b-4952-a9ca-e6f3b943b4cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:02.213032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0304b31f-ab8b-4952-a9ca-e6f3b943b4cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:02.241971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0304b31f-ab8b-4952-a9ca-e6f3b943b4cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041873 Jun 20 07:24:02.242518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 622/1142] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:03.164394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-884119da-3a00-4b69-a4e0-ecd5fb7617be tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:03.165320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-884119da-3a00-4b69-a4e0-ecd5fb7617be tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:03.171902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-884119da-3a00-4b69-a4e0-ecd5fb7617be tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:03.172383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-884119da-3a00-4b69-a4e0-ecd5fb7617be tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:03.173147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-884119da-3a00-4b69-a4e0-ecd5fb7617be tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:03.173586 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-884119da-3a00-4b69-a4e0-ecd5fb7617be tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:03.203505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-884119da-3a00-4b69-a4e0-ecd5fb7617be tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043014 Jun 20 07:24:03.204063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 521/1143] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:03 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:03.253221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5025c5a0-d1bb-42db-a720-faa86aaa7736 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:03.254148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5025c5a0-d1bb-42db-a720-faa86aaa7736 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:03.261597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5025c5a0-d1bb-42db-a720-faa86aaa7736 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:03.262050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5025c5a0-d1bb-42db-a720-faa86aaa7736 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:03.262815 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5025c5a0-d1bb-42db-a720-faa86aaa7736 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:03.263254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5025c5a0-d1bb-42db-a720-faa86aaa7736 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:03.291118 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5025c5a0-d1bb-42db-a720-faa86aaa7736 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041844 Jun 20 07:24:03.291660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 623/1144] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:03 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:04.214766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3d3fcb27-3dfe-4d74-bf00-3524f430b03b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:04.215683 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3d3fcb27-3dfe-4d74-bf00-3524f430b03b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:04.222059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d3fcb27-3dfe-4d74-bf00-3524f430b03b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:04.222504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d3fcb27-3dfe-4d74-bf00-3524f430b03b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:04.223260 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d3fcb27-3dfe-4d74-bf00-3524f430b03b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:04.223692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d3fcb27-3dfe-4d74-bf00-3524f430b03b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:04.251833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3d3fcb27-3dfe-4d74-bf00-3524f430b03b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040887 Jun 20 07:24:04.252592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 522/1145] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:04 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:04.302693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7fe8a9ac-45ca-462d-9ea0-32d0d12f684c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:04.303617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7fe8a9ac-45ca-462d-9ea0-32d0d12f684c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:04.309617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fe8a9ac-45ca-462d-9ea0-32d0d12f684c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:04.310070 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fe8a9ac-45ca-462d-9ea0-32d0d12f684c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:04.310834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fe8a9ac-45ca-462d-9ea0-32d0d12f684c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:04.311270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fe8a9ac-45ca-462d-9ea0-32d0d12f684c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:04.340327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7fe8a9ac-45ca-462d-9ea0-32d0d12f684c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041701 Jun 20 07:24:04.340873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 624/1146] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:04 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:05.263833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6b8035f2-149f-4901-9ac5-627d436bf385 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:05.264766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6b8035f2-149f-4901-9ac5-627d436bf385 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:05.271578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b8035f2-149f-4901-9ac5-627d436bf385 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:05.272015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b8035f2-149f-4901-9ac5-627d436bf385 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:05.272789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b8035f2-149f-4901-9ac5-627d436bf385 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:05.273220 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b8035f2-149f-4901-9ac5-627d436bf385 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:05.301954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6b8035f2-149f-4901-9ac5-627d436bf385 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042230 Jun 20 07:24:05.302507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 523/1147] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:05 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:05.351509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7066417e-4478-4e1d-bc65-133003f87f54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:05.352426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7066417e-4478-4e1d-bc65-133003f87f54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:05.358787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7066417e-4478-4e1d-bc65-133003f87f54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:05.359232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7066417e-4478-4e1d-bc65-133003f87f54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:05.359989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7066417e-4478-4e1d-bc65-133003f87f54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:05.360450 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7066417e-4478-4e1d-bc65-133003f87f54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:05.389077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7066417e-4478-4e1d-bc65-133003f87f54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042237 Jun 20 07:24:05.389629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 625/1148] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:05 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:06.313394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d687e909-d266-4c27-a481-7d25dea64327 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:06.314349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d687e909-d266-4c27-a481-7d25dea64327 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:06.321499 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d687e909-d266-4c27-a481-7d25dea64327 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:06.321948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d687e909-d266-4c27-a481-7d25dea64327 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:06.322711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d687e909-d266-4c27-a481-7d25dea64327 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:06.323148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d687e909-d266-4c27-a481-7d25dea64327 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:06.351937 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d687e909-d266-4c27-a481-7d25dea64327 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042439 Jun 20 07:24:06.352529 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 524/1149] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:06 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:06.400021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4a5ec753-418e-44f0-9c89-7685c4e71b87 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:06.400891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4a5ec753-418e-44f0-9c89-7685c4e71b87 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:06.407376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a5ec753-418e-44f0-9c89-7685c4e71b87 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:06.407824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a5ec753-418e-44f0-9c89-7685c4e71b87 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:06.408617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a5ec753-418e-44f0-9c89-7685c4e71b87 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:06.409052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a5ec753-418e-44f0-9c89-7685c4e71b87 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:06.437805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4a5ec753-418e-44f0-9c89-7685c4e71b87 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041821 Jun 20 07:24:06.438339 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 626/1150] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:06 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:24:07.363221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-00a2856f-d4e3-45f6-af49-3413a0c86387 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:07.364200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-00a2856f-d4e3-45f6-af49-3413a0c86387 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:07.366484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=58 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:24:07.371994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00a2856f-d4e3-45f6-af49-3413a0c86387 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:07.372503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00a2856f-d4e3-45f6-af49-3413a0c86387 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:07.373297 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00a2856f-d4e3-45f6-af49-3413a0c86387 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:07.373740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00a2856f-d4e3-45f6-af49-3413a0c86387 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:07.403825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-00a2856f-d4e3-45f6-af49-3413a0c86387 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Jun 20 07:24:07.404424 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 525/1151] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:07 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:07.448989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fbf89c61-77fa-4d45-8d65-d44c5936e774 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:07.449841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fbf89c61-77fa-4d45-8d65-d44c5936e774 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:07.452091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=58 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:24:07.457248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbf89c61-77fa-4d45-8d65-d44c5936e774 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:07.458323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbf89c61-77fa-4d45-8d65-d44c5936e774 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:07.459087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbf89c61-77fa-4d45-8d65-d44c5936e774 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:07.459515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fbf89c61-77fa-4d45-8d65-d44c5936e774 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:07.487386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fbf89c61-77fa-4d45-8d65-d44c5936e774 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042433 Jun 20 07:24:07.487929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 627/1152] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:07 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:08.416421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-83c31877-25e1-4781-8d4e-4c87826f5c87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:08.417272 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-83c31877-25e1-4781-8d4e-4c87826f5c87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:08.423607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83c31877-25e1-4781-8d4e-4c87826f5c87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:08.424186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83c31877-25e1-4781-8d4e-4c87826f5c87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:08.424948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83c31877-25e1-4781-8d4e-4c87826f5c87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:08.425379 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83c31877-25e1-4781-8d4e-4c87826f5c87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:08.454280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-83c31877-25e1-4781-8d4e-4c87826f5c87 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041778 Jun 20 07:24:08.455018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 526/1153] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:08 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:08.498762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a6cb7239-6e88-4ee2-b9db-a3217734e12f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:08.499700 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a6cb7239-6e88-4ee2-b9db-a3217734e12f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:08.506073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6cb7239-6e88-4ee2-b9db-a3217734e12f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:08.506526 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6cb7239-6e88-4ee2-b9db-a3217734e12f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:08.507289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6cb7239-6e88-4ee2-b9db-a3217734e12f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:08.507728 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a6cb7239-6e88-4ee2-b9db-a3217734e12f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:08.536823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a6cb7239-6e88-4ee2-b9db-a3217734e12f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041956 Jun 20 07:24:08.537378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 628/1154] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:08 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:09.466294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-00e948c2-8593-4e95-aa7d-a5f5b30d6ca5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:09.467237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-00e948c2-8593-4e95-aa7d-a5f5b30d6ca5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:09.476364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00e948c2-8593-4e95-aa7d-a5f5b30d6ca5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:09.476807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00e948c2-8593-4e95-aa7d-a5f5b30d6ca5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:09.477563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00e948c2-8593-4e95-aa7d-a5f5b30d6ca5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:09.477996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00e948c2-8593-4e95-aa7d-a5f5b30d6ca5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:09.508798 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-00e948c2-8593-4e95-aa7d-a5f5b30d6ca5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046358 Jun 20 07:24:09.512963 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 527/1155] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:09 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:09.548213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e22adaf-d345-42f5-b7d6-96799515a4ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:09.549080 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e22adaf-d345-42f5-b7d6-96799515a4ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:09.556030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e22adaf-d345-42f5-b7d6-96799515a4ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:09.556506 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e22adaf-d345-42f5-b7d6-96799515a4ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:09.557269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e22adaf-d345-42f5-b7d6-96799515a4ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:09.557706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e22adaf-d345-42f5-b7d6-96799515a4ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:09.585336 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e22adaf-d345-42f5-b7d6-96799515a4ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041094 Jun 20 07:24:09.585873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 629/1156] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:09 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:10.520496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-97b8a362-adfc-4761-9a06-10213bea85ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:10.521409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-97b8a362-adfc-4761-9a06-10213bea85ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:10.527725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97b8a362-adfc-4761-9a06-10213bea85ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:10.528212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97b8a362-adfc-4761-9a06-10213bea85ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:10.528966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97b8a362-adfc-4761-9a06-10213bea85ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:10.529403 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97b8a362-adfc-4761-9a06-10213bea85ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:10.558141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-97b8a362-adfc-4761-9a06-10213bea85ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041569 Jun 20 07:24:10.558699 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 528/1157] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:10 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:10.595719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d721a274-d171-4803-bd74-215c17c00800 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:10.596700 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d721a274-d171-4803-bd74-215c17c00800 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:10.603062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d721a274-d171-4803-bd74-215c17c00800 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:10.603508 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d721a274-d171-4803-bd74-215c17c00800 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:10.604301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d721a274-d171-4803-bd74-215c17c00800 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:10.604737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d721a274-d171-4803-bd74-215c17c00800 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:10.633594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d721a274-d171-4803-bd74-215c17c00800 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041736 Jun 20 07:24:10.634142 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 630/1158] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:10 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:11.569376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7d1afe4a-d6be-4a4a-bfb6-fd7fad94fff1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:11.570300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7d1afe4a-d6be-4a4a-bfb6-fd7fad94fff1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:11.576674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d1afe4a-d6be-4a4a-bfb6-fd7fad94fff1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:11.577128 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d1afe4a-d6be-4a4a-bfb6-fd7fad94fff1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:11.577892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d1afe4a-d6be-4a4a-bfb6-fd7fad94fff1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:11.578336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d1afe4a-d6be-4a4a-bfb6-fd7fad94fff1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:11.608023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7d1afe4a-d6be-4a4a-bfb6-fd7fad94fff1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Jun 20 07:24:11.608612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 529/1159] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:11 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:11.645871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3021eece-249f-4a94-85fa-c4d948368527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:11.646759 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3021eece-249f-4a94-85fa-c4d948368527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:11.653121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3021eece-249f-4a94-85fa-c4d948368527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:11.653564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3021eece-249f-4a94-85fa-c4d948368527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:11.654320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3021eece-249f-4a94-85fa-c4d948368527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:11.654754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3021eece-249f-4a94-85fa-c4d948368527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:11.683613 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3021eece-249f-4a94-85fa-c4d948368527 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 Jun 20 07:24:11.684217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 631/1160] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:11 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:12.619423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f7ce00c-4bf1-4600-8f78-b60cd4bf8175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:12.620382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9f7ce00c-4bf1-4600-8f78-b60cd4bf8175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:12.626791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f7ce00c-4bf1-4600-8f78-b60cd4bf8175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:12.627255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f7ce00c-4bf1-4600-8f78-b60cd4bf8175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:12.628004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f7ce00c-4bf1-4600-8f78-b60cd4bf8175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:12.628473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f7ce00c-4bf1-4600-8f78-b60cd4bf8175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:12.656929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9f7ce00c-4bf1-4600-8f78-b60cd4bf8175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041462 Jun 20 07:24:12.657490 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 530/1161] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:12 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:12.694826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2984967f-1a96-4ed5-a820-5efa839320bd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:12.695859 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2984967f-1a96-4ed5-a820-5efa839320bd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:12.702400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2984967f-1a96-4ed5-a820-5efa839320bd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:12.702953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2984967f-1a96-4ed5-a820-5efa839320bd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:12.703834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2984967f-1a96-4ed5-a820-5efa839320bd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:12.704498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2984967f-1a96-4ed5-a820-5efa839320bd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:12.733584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2984967f-1a96-4ed5-a820-5efa839320bd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042651 Jun 20 07:24:12.734146 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 632/1162] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:12 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:13.668958 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b0c3782a-2d30-46ae-8d88-5163c1b50aac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:13.669982 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b0c3782a-2d30-46ae-8d88-5163c1b50aac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:13.676981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b0c3782a-2d30-46ae-8d88-5163c1b50aac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:13.677507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b0c3782a-2d30-46ae-8d88-5163c1b50aac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:13.678281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b0c3782a-2d30-46ae-8d88-5163c1b50aac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:13.678717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b0c3782a-2d30-46ae-8d88-5163c1b50aac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:13.709016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b0c3782a-2d30-46ae-8d88-5163c1b50aac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043896 Jun 20 07:24:13.710137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 531/1163] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:13 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:13.745475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ddfd054f-2c46-477d-b56c-79243628b338 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:13.746731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ddfd054f-2c46-477d-b56c-79243628b338 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:13.753249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddfd054f-2c46-477d-b56c-79243628b338 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:13.753775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddfd054f-2c46-477d-b56c-79243628b338 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:13.755173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddfd054f-2c46-477d-b56c-79243628b338 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:13.755730 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddfd054f-2c46-477d-b56c-79243628b338 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:13.784607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ddfd054f-2c46-477d-b56c-79243628b338 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 Jun 20 07:24:13.785524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 633/1164] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:13 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:14.720584 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3af0da7a-acf5-48f4-940a-863629638bba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:14.721525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3af0da7a-acf5-48f4-940a-863629638bba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:14.727877 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3af0da7a-acf5-48f4-940a-863629638bba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:14.728352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3af0da7a-acf5-48f4-940a-863629638bba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:14.729098 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3af0da7a-acf5-48f4-940a-863629638bba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:14.729528 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3af0da7a-acf5-48f4-940a-863629638bba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:14.745408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:24:14.759085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3af0da7a-acf5-48f4-940a-863629638bba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042384 Jun 20 07:24:14.759889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 532/1165] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:14 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:14.796203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-94b87214-bd99-4c68-8f79-6f9f838a0b7d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:14.797204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-94b87214-bd99-4c68-8f79-6f9f838a0b7d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:14.803714 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94b87214-bd99-4c68-8f79-6f9f838a0b7d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:14.804197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94b87214-bd99-4c68-8f79-6f9f838a0b7d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:14.804965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94b87214-bd99-4c68-8f79-6f9f838a0b7d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:14.805405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94b87214-bd99-4c68-8f79-6f9f838a0b7d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:14.834504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-94b87214-bd99-4c68-8f79-6f9f838a0b7d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042369 Jun 20 07:24:14.835002 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 634/1166] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:14 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:15.771223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9792a8d2-1d46-4a66-a58c-adb53e5ecfad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:15.772168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9792a8d2-1d46-4a66-a58c-adb53e5ecfad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:15.778651 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9792a8d2-1d46-4a66-a58c-adb53e5ecfad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:15.779104 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9792a8d2-1d46-4a66-a58c-adb53e5ecfad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:15.779861 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9792a8d2-1d46-4a66-a58c-adb53e5ecfad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:15.780331 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9792a8d2-1d46-4a66-a58c-adb53e5ecfad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:15.808946 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9792a8d2-1d46-4a66-a58c-adb53e5ecfad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042171 Jun 20 07:24:15.809687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 533/1167] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:15 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:15.846712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2714431b-fd73-44a1-8002-1f41eca8a728 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:15.848277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2714431b-fd73-44a1-8002-1f41eca8a728 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:15.854694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2714431b-fd73-44a1-8002-1f41eca8a728 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:15.855142 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2714431b-fd73-44a1-8002-1f41eca8a728 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:15.855904 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2714431b-fd73-44a1-8002-1f41eca8a728 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:15.856364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2714431b-fd73-44a1-8002-1f41eca8a728 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:15.880710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:24:15.886048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2714431b-fd73-44a1-8002-1f41eca8a728 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043312 Jun 20 07:24:15.886614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 635/1168] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:15 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:24:16.821175 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f155f810-484f-4cac-b3ec-6bae3c7ee448 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:16.822099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f155f810-484f-4cac-b3ec-6bae3c7ee448 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:16.828836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f155f810-484f-4cac-b3ec-6bae3c7ee448 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:16.829291 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f155f810-484f-4cac-b3ec-6bae3c7ee448 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:16.830054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f155f810-484f-4cac-b3ec-6bae3c7ee448 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:16.830507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f155f810-484f-4cac-b3ec-6bae3c7ee448 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:16.858933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f155f810-484f-4cac-b3ec-6bae3c7ee448 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042189 Jun 20 07:24:16.862506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 534/1169] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:16 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:16.897697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fc4f3b28-d58e-4e53-ab45-3787e10b5168 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:16.898743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fc4f3b28-d58e-4e53-ab45-3787e10b5168 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:16.906003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4f3b28-d58e-4e53-ab45-3787e10b5168 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:16.906703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4f3b28-d58e-4e53-ab45-3787e10b5168 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:16.907469 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4f3b28-d58e-4e53-ab45-3787e10b5168 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:16.907904 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc4f3b28-d58e-4e53-ab45-3787e10b5168 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:16.937295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fc4f3b28-d58e-4e53-ab45-3787e10b5168 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043790 Jun 20 07:24:16.937776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 636/1170] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:16 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:17.870103 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5c0008c4-12bf-4d9a-8068-981ed0d9d196 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:17.871081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5c0008c4-12bf-4d9a-8068-981ed0d9d196 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:17.877603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c0008c4-12bf-4d9a-8068-981ed0d9d196 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:17.878063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c0008c4-12bf-4d9a-8068-981ed0d9d196 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:17.879342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c0008c4-12bf-4d9a-8068-981ed0d9d196 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:17.879779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c0008c4-12bf-4d9a-8068-981ed0d9d196 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:17.908756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5c0008c4-12bf-4d9a-8068-981ed0d9d196 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042535 Jun 20 07:24:17.909325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 535/1171] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:17 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:17.948625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b6f5fffe-fbe4-4765-a291-be5d4a302e97 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:17.949571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b6f5fffe-fbe4-4765-a291-be5d4a302e97 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:17.955915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6f5fffe-fbe4-4765-a291-be5d4a302e97 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:17.956402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6f5fffe-fbe4-4765-a291-be5d4a302e97 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:17.957803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6f5fffe-fbe4-4765-a291-be5d4a302e97 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:17.958230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6f5fffe-fbe4-4765-a291-be5d4a302e97 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:17.986272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b6f5fffe-fbe4-4765-a291-be5d4a302e97 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041491 Jun 20 07:24:17.986825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 637/1172] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:17 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:18.921279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-770ea227-85e4-41a9-b8cf-4459ba7f49b5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:18.922275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-770ea227-85e4-41a9-b8cf-4459ba7f49b5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:18.928701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-770ea227-85e4-41a9-b8cf-4459ba7f49b5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:18.929162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-770ea227-85e4-41a9-b8cf-4459ba7f49b5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:18.929923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-770ea227-85e4-41a9-b8cf-4459ba7f49b5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:18.930360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-770ea227-85e4-41a9-b8cf-4459ba7f49b5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:18.958842 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-770ea227-85e4-41a9-b8cf-4459ba7f49b5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041911 Jun 20 07:24:18.959397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 536/1173] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:18 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:18.998388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-92663507-13ff-4712-8774-21584df59899 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:18.999311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-92663507-13ff-4712-8774-21584df59899 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:19.005737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-92663507-13ff-4712-8774-21584df59899 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:19.006190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-92663507-13ff-4712-8774-21584df59899 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:19.006962 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-92663507-13ff-4712-8774-21584df59899 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:19.007402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-92663507-13ff-4712-8774-21584df59899 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:19.038026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-92663507-13ff-4712-8774-21584df59899 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Jun 20 07:24:19.038586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 638/1174] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:18 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:19.969879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b3a8bc22-f2d1-479a-94a0-0715ec7d7c2f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:19.970754 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b3a8bc22-f2d1-479a-94a0-0715ec7d7c2f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:19.976975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3a8bc22-f2d1-479a-94a0-0715ec7d7c2f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:19.977430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3a8bc22-f2d1-479a-94a0-0715ec7d7c2f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:19.978199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3a8bc22-f2d1-479a-94a0-0715ec7d7c2f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:19.978674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3a8bc22-f2d1-479a-94a0-0715ec7d7c2f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:20.007139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b3a8bc22-f2d1-479a-94a0-0715ec7d7c2f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041422 Jun 20 07:24:20.007688 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 537/1175] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:19 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:20.049875 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f3ef88d6-c300-4aaf-a34e-369e433f89b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:20.050909 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f3ef88d6-c300-4aaf-a34e-369e433f89b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:20.057302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3ef88d6-c300-4aaf-a34e-369e433f89b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:20.057746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3ef88d6-c300-4aaf-a34e-369e433f89b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:20.058500 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3ef88d6-c300-4aaf-a34e-369e433f89b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:20.058930 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3ef88d6-c300-4aaf-a34e-369e433f89b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:20.087706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f3ef88d6-c300-4aaf-a34e-369e433f89b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041946 Jun 20 07:24:20.088271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 639/1176] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:20 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:21.018709 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bb906792-0a88-4844-a63a-6c61d0befb2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:21.019650 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bb906792-0a88-4844-a63a-6c61d0befb2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:21.026567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb906792-0a88-4844-a63a-6c61d0befb2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:21.027017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb906792-0a88-4844-a63a-6c61d0befb2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:21.027785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb906792-0a88-4844-a63a-6c61d0befb2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:21.028268 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb906792-0a88-4844-a63a-6c61d0befb2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:21.058209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bb906792-0a88-4844-a63a-6c61d0befb2c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043398 Jun 20 07:24:21.058775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 538/1177] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:21 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:21.098717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d4d27146-b50d-487d-a411-7a9d0656af2a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:21.099633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d4d27146-b50d-487d-a411-7a9d0656af2a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:21.105830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d4d27146-b50d-487d-a411-7a9d0656af2a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:21.106276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d4d27146-b50d-487d-a411-7a9d0656af2a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:21.107029 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d4d27146-b50d-487d-a411-7a9d0656af2a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:21.107460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d4d27146-b50d-487d-a411-7a9d0656af2a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:21.136844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d4d27146-b50d-487d-a411-7a9d0656af2a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041924 Jun 20 07:24:21.137473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 640/1178] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:21 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:22.069731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dedd46fd-cb40-4f70-82a2-9942bd5bad55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:22.070666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dedd46fd-cb40-4f70-82a2-9942bd5bad55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:22.077926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dedd46fd-cb40-4f70-82a2-9942bd5bad55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:22.078377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dedd46fd-cb40-4f70-82a2-9942bd5bad55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:22.079162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dedd46fd-cb40-4f70-82a2-9942bd5bad55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:22.079592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dedd46fd-cb40-4f70-82a2-9942bd5bad55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:22.108638 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dedd46fd-cb40-4f70-82a2-9942bd5bad55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043091 Jun 20 07:24:22.109184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 539/1179] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:22 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:22.149196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8dc4b4f7-8d3a-4ff0-9eaf-7e7c79485c22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:22.150116 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8dc4b4f7-8d3a-4ff0-9eaf-7e7c79485c22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:22.156658 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8dc4b4f7-8d3a-4ff0-9eaf-7e7c79485c22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:22.157109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8dc4b4f7-8d3a-4ff0-9eaf-7e7c79485c22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:22.157870 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8dc4b4f7-8d3a-4ff0-9eaf-7e7c79485c22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:22.158305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8dc4b4f7-8d3a-4ff0-9eaf-7e7c79485c22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:22.186529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8dc4b4f7-8d3a-4ff0-9eaf-7e7c79485c22 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041209 Jun 20 07:24:22.187074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 641/1180] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:22 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:23.120413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8fdb7231-c26f-4696-87fa-37af15c9a72d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:23.121322 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8fdb7231-c26f-4696-87fa-37af15c9a72d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:23.127762 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fdb7231-c26f-4696-87fa-37af15c9a72d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:23.128233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fdb7231-c26f-4696-87fa-37af15c9a72d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:23.128980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fdb7231-c26f-4696-87fa-37af15c9a72d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:23.129441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8fdb7231-c26f-4696-87fa-37af15c9a72d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:23.157038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8fdb7231-c26f-4696-87fa-37af15c9a72d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040503 Jun 20 07:24:23.157573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 540/1181] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:23 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:23.198040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b28d367e-b22a-4df1-929f-f0f0e7fc3576 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:23.198963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b28d367e-b22a-4df1-929f-f0f0e7fc3576 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:23.205551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b28d367e-b22a-4df1-929f-f0f0e7fc3576 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:23.206003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b28d367e-b22a-4df1-929f-f0f0e7fc3576 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:23.206813 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b28d367e-b22a-4df1-929f-f0f0e7fc3576 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:23.207250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b28d367e-b22a-4df1-929f-f0f0e7fc3576 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:23.236200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b28d367e-b22a-4df1-929f-f0f0e7fc3576 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042086 Jun 20 07:24:23.236747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 642/1182] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:23 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:24.169417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-857b195d-e459-44c7-87d2-dad21d53a4af tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:24.170342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-857b195d-e459-44c7-87d2-dad21d53a4af tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:24.176994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-857b195d-e459-44c7-87d2-dad21d53a4af tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:24.177444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-857b195d-e459-44c7-87d2-dad21d53a4af tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:24.178203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-857b195d-e459-44c7-87d2-dad21d53a4af tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:24.178641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-857b195d-e459-44c7-87d2-dad21d53a4af tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:24.207129 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-857b195d-e459-44c7-87d2-dad21d53a4af tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042096 Jun 20 07:24:24.207678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 541/1183] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:24 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:24.247412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e5a35dc-6666-424c-9f43-a34cc9ccf685 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:24.248382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e5a35dc-6666-424c-9f43-a34cc9ccf685 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:24.255333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e5a35dc-6666-424c-9f43-a34cc9ccf685 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:24.255780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e5a35dc-6666-424c-9f43-a34cc9ccf685 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:24.256573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e5a35dc-6666-424c-9f43-a34cc9ccf685 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:24.257003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e5a35dc-6666-424c-9f43-a34cc9ccf685 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:24.285128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e5a35dc-6666-424c-9f43-a34cc9ccf685 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041652 Jun 20 07:24:24.285674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 643/1184] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:24 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:25.227986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-00925706-6391-4755-b8d6-2cd9da1838a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:25.227986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-00925706-6391-4755-b8d6-2cd9da1838a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:25.227986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00925706-6391-4755-b8d6-2cd9da1838a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:25.227986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00925706-6391-4755-b8d6-2cd9da1838a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:25.228592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00925706-6391-4755-b8d6-2cd9da1838a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:25.228592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00925706-6391-4755-b8d6-2cd9da1838a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:25.256300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-00925706-6391-4755-b8d6-2cd9da1838a5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041721 Jun 20 07:24:25.256858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 542/1185] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:25 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:25.296571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4711c4db-c001-4309-82bf-7df7c709b078 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:25.297491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4711c4db-c001-4309-82bf-7df7c709b078 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:25.304815 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4711c4db-c001-4309-82bf-7df7c709b078 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:25.305268 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4711c4db-c001-4309-82bf-7df7c709b078 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:25.306030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4711c4db-c001-4309-82bf-7df7c709b078 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:25.306466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4711c4db-c001-4309-82bf-7df7c709b078 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:25.334609 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4711c4db-c001-4309-82bf-7df7c709b078 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 Jun 20 07:24:25.335178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 644/1186] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:25 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:24:26.267868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8766d6db-1359-4217-bab5-c84e2c63e9e1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:26.268834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8766d6db-1359-4217-bab5-c84e2c63e9e1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:26.275023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8766d6db-1359-4217-bab5-c84e2c63e9e1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:26.275478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8766d6db-1359-4217-bab5-c84e2c63e9e1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:26.276286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8766d6db-1359-4217-bab5-c84e2c63e9e1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:26.276730 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8766d6db-1359-4217-bab5-c84e2c63e9e1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:26.305073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8766d6db-1359-4217-bab5-c84e2c63e9e1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041106 Jun 20 07:24:26.305623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 543/1187] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:26 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:26.345842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a2d2298b-b49a-4f24-9ab0-9f80a2c18174 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:26.346764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a2d2298b-b49a-4f24-9ab0-9f80a2c18174 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:26.353688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2d2298b-b49a-4f24-9ab0-9f80a2c18174 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:26.354132 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2d2298b-b49a-4f24-9ab0-9f80a2c18174 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:26.354885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2d2298b-b49a-4f24-9ab0-9f80a2c18174 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:26.355312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a2d2298b-b49a-4f24-9ab0-9f80a2c18174 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:26.383313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a2d2298b-b49a-4f24-9ab0-9f80a2c18174 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041301 Jun 20 07:24:26.383943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 645/1188] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:26 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:27.316353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3049feba-0d65-4e51-b037-b7fed851060f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:27.317961 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3049feba-0d65-4e51-b037-b7fed851060f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:27.324460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3049feba-0d65-4e51-b037-b7fed851060f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:27.324917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3049feba-0d65-4e51-b037-b7fed851060f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:27.325687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3049feba-0d65-4e51-b037-b7fed851060f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:27.326127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3049feba-0d65-4e51-b037-b7fed851060f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:27.354327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3049feba-0d65-4e51-b037-b7fed851060f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041945 Jun 20 07:24:27.354877 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 544/1189] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:27 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:27.394856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-66b1808c-c4ad-4e48-afec-073bd47f38f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:27.395934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-66b1808c-c4ad-4e48-afec-073bd47f38f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:27.402473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66b1808c-c4ad-4e48-afec-073bd47f38f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:27.402952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66b1808c-c4ad-4e48-afec-073bd47f38f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:27.403718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66b1808c-c4ad-4e48-afec-073bd47f38f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:27.404180 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66b1808c-c4ad-4e48-afec-073bd47f38f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:27.433401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-66b1808c-c4ad-4e48-afec-073bd47f38f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042568 Jun 20 07:24:27.433948 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 646/1190] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:27 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:28.365498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a1cd30c-52fd-4530-82b7-a239b3f27476 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:28.366430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6a1cd30c-52fd-4530-82b7-a239b3f27476 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:28.372628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a1cd30c-52fd-4530-82b7-a239b3f27476 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:28.373087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a1cd30c-52fd-4530-82b7-a239b3f27476 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:28.373858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a1cd30c-52fd-4530-82b7-a239b3f27476 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:28.374302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a1cd30c-52fd-4530-82b7-a239b3f27476 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:28.403966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6a1cd30c-52fd-4530-82b7-a239b3f27476 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042315 Jun 20 07:24:28.404535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 545/1191] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:28 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:28.444813 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a1f56b8e-ddc7-44e6-b75d-c92f3a0adb40 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:28.445745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a1f56b8e-ddc7-44e6-b75d-c92f3a0adb40 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:28.452213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1f56b8e-ddc7-44e6-b75d-c92f3a0adb40 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:28.452673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1f56b8e-ddc7-44e6-b75d-c92f3a0adb40 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:28.453444 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1f56b8e-ddc7-44e6-b75d-c92f3a0adb40 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:28.453884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1f56b8e-ddc7-44e6-b75d-c92f3a0adb40 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:28.483239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a1f56b8e-ddc7-44e6-b75d-c92f3a0adb40 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042469 Jun 20 07:24:28.483807 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 647/1192] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:28 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:29.415734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e1b21339-332a-4787-bc28-236f812f894a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:29.416975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e1b21339-332a-4787-bc28-236f812f894a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:29.423379 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1b21339-332a-4787-bc28-236f812f894a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:29.423860 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1b21339-332a-4787-bc28-236f812f894a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:29.424614 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1b21339-332a-4787-bc28-236f812f894a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:29.425044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e1b21339-332a-4787-bc28-236f812f894a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:29.454407 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e1b21339-332a-4787-bc28-236f812f894a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042611 Jun 20 07:24:29.454956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 546/1193] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:29 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:29.494592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d158ec85-e5f9-41b1-8b73-f374c84c9224 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:29.495639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d158ec85-e5f9-41b1-8b73-f374c84c9224 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:29.502170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d158ec85-e5f9-41b1-8b73-f374c84c9224 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:29.502621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d158ec85-e5f9-41b1-8b73-f374c84c9224 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:29.503375 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d158ec85-e5f9-41b1-8b73-f374c84c9224 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:29.503804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d158ec85-e5f9-41b1-8b73-f374c84c9224 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:29.533540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d158ec85-e5f9-41b1-8b73-f374c84c9224 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042879 Jun 20 07:24:29.534089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 648/1194] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:29 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:30.466320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4d4ad21f-0141-4b63-95c3-0972b5afdf0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:30.467257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4d4ad21f-0141-4b63-95c3-0972b5afdf0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:30.473857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d4ad21f-0141-4b63-95c3-0972b5afdf0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:30.474311 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d4ad21f-0141-4b63-95c3-0972b5afdf0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:30.475082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d4ad21f-0141-4b63-95c3-0972b5afdf0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:30.475522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d4ad21f-0141-4b63-95c3-0972b5afdf0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:30.505349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4d4ad21f-0141-4b63-95c3-0972b5afdf0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042917 Jun 20 07:24:30.505899 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 547/1195] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:30 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:30.545561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bfda26fa-7e97-4f66-b4ec-a5ab781f88e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:30.546502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bfda26fa-7e97-4f66-b4ec-a5ab781f88e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:30.553036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfda26fa-7e97-4f66-b4ec-a5ab781f88e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:30.553548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfda26fa-7e97-4f66-b4ec-a5ab781f88e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:30.554373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfda26fa-7e97-4f66-b4ec-a5ab781f88e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:30.554917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfda26fa-7e97-4f66-b4ec-a5ab781f88e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:30.585606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bfda26fa-7e97-4f66-b4ec-a5ab781f88e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Jun 20 07:24:30.586164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 649/1196] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:30 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:31.516480 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-938883aa-e251-491b-8cd4-dd5fcb06cb2b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:31.517437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-938883aa-e251-491b-8cd4-dd5fcb06cb2b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:31.523790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-938883aa-e251-491b-8cd4-dd5fcb06cb2b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:31.524265 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-938883aa-e251-491b-8cd4-dd5fcb06cb2b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:31.525038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-938883aa-e251-491b-8cd4-dd5fcb06cb2b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:31.525478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-938883aa-e251-491b-8cd4-dd5fcb06cb2b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:31.554018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-938883aa-e251-491b-8cd4-dd5fcb06cb2b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041419 Jun 20 07:24:31.554568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 548/1197] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:31 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:31.597102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6ed152e1-61f9-40ce-8939-1b86b139e213 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:31.598619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6ed152e1-61f9-40ce-8939-1b86b139e213 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:31.604986 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ed152e1-61f9-40ce-8939-1b86b139e213 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:31.605439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ed152e1-61f9-40ce-8939-1b86b139e213 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:31.606212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ed152e1-61f9-40ce-8939-1b86b139e213 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:31.606648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ed152e1-61f9-40ce-8939-1b86b139e213 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:31.635185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6ed152e1-61f9-40ce-8939-1b86b139e213 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042077 Jun 20 07:24:31.635736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 650/1198] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:31 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:32.568148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba16d0dd-c54d-4a15-9805-5fd3a0e26d01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:32.569072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba16d0dd-c54d-4a15-9805-5fd3a0e26d01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:32.575336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba16d0dd-c54d-4a15-9805-5fd3a0e26d01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:32.575782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba16d0dd-c54d-4a15-9805-5fd3a0e26d01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:32.576571 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba16d0dd-c54d-4a15-9805-5fd3a0e26d01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:32.577000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba16d0dd-c54d-4a15-9805-5fd3a0e26d01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:32.580601 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:24:32.606132 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba16d0dd-c54d-4a15-9805-5fd3a0e26d01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042467 Jun 20 07:24:32.606670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 549/1199] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:32 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:32.645941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7c7b9ef2-933c-4348-bae9-266a6d76f41f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:32.646903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7c7b9ef2-933c-4348-bae9-266a6d76f41f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:32.653509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c7b9ef2-933c-4348-bae9-266a6d76f41f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:32.653964 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c7b9ef2-933c-4348-bae9-266a6d76f41f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:32.654734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c7b9ef2-933c-4348-bae9-266a6d76f41f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:32.655175 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c7b9ef2-933c-4348-bae9-266a6d76f41f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:32.684911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7c7b9ef2-933c-4348-bae9-266a6d76f41f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042937 Jun 20 07:24:32.685460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 651/1200] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:32 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:33.619453 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e26e17b-9987-4a1d-b55c-8c7cd2c5577f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:33.620412 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9e26e17b-9987-4a1d-b55c-8c7cd2c5577f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:33.626751 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e26e17b-9987-4a1d-b55c-8c7cd2c5577f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:33.627215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e26e17b-9987-4a1d-b55c-8c7cd2c5577f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:33.627983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e26e17b-9987-4a1d-b55c-8c7cd2c5577f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:33.628441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e26e17b-9987-4a1d-b55c-8c7cd2c5577f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:33.657714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e26e17b-9987-4a1d-b55c-8c7cd2c5577f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044123 Jun 20 07:24:33.658264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 550/1201] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:33 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:33.696459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-22240869-528b-4d78-bc32-a87f87f348f9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:33.697389 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-22240869-528b-4d78-bc32-a87f87f348f9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:33.703894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22240869-528b-4d78-bc32-a87f87f348f9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:33.704383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22240869-528b-4d78-bc32-a87f87f348f9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:33.705163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22240869-528b-4d78-bc32-a87f87f348f9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:33.705630 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22240869-528b-4d78-bc32-a87f87f348f9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:33.723529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:24:33.736963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-22240869-528b-4d78-bc32-a87f87f348f9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044785 Jun 20 07:24:33.737518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 652/1202] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:33 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:34.669141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab537be0-6af5-4be0-a83a-95e980a54dfc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:34.670072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab537be0-6af5-4be0-a83a-95e980a54dfc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:34.677076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab537be0-6af5-4be0-a83a-95e980a54dfc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:34.677532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab537be0-6af5-4be0-a83a-95e980a54dfc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:34.678306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab537be0-6af5-4be0-a83a-95e980a54dfc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:34.678748 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab537be0-6af5-4be0-a83a-95e980a54dfc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:34.748164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a56d8a58-bb3a-483a-8b6a-290933f423c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:34.749323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a56d8a58-bb3a-483a-8b6a-290933f423c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:34.756213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a56d8a58-bb3a-483a-8b6a-290933f423c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:34.756762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a56d8a58-bb3a-483a-8b6a-290933f423c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:34.757652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a56d8a58-bb3a-483a-8b6a-290933f423c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:34.758092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a56d8a58-bb3a-483a-8b6a-290933f423c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:34.791484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a56d8a58-bb3a-483a-8b6a-290933f423c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047302 Jun 20 07:24:34.792082 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 653/1203] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:24:34.865733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab537be0-6af5-4be0-a83a-95e980a54dfc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200361 Jun 20 07:24:34.866194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 551/1204] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:34 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:35.802681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-10bc5c24-8371-482e-bd94-1e02110f0a60 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:35.803597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-10bc5c24-8371-482e-bd94-1e02110f0a60 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:35.810028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10bc5c24-8371-482e-bd94-1e02110f0a60 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:35.810482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10bc5c24-8371-482e-bd94-1e02110f0a60 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:35.811241 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10bc5c24-8371-482e-bd94-1e02110f0a60 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:35.811708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10bc5c24-8371-482e-bd94-1e02110f0a60 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:35.841302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-10bc5c24-8371-482e-bd94-1e02110f0a60 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042439 Jun 20 07:24:35.841855 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 654/1205] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:35 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:35.885028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1f3daf9-5667-466e-ba9f-3cbc6d20047c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:35.885986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a1f3daf9-5667-466e-ba9f-3cbc6d20047c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:35.892515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1f3daf9-5667-466e-ba9f-3cbc6d20047c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:35.892907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1f3daf9-5667-466e-ba9f-3cbc6d20047c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:35.893676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1f3daf9-5667-466e-ba9f-3cbc6d20047c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:35.894114 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1f3daf9-5667-466e-ba9f-3cbc6d20047c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:35.922519 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a1f3daf9-5667-466e-ba9f-3cbc6d20047c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049242 Jun 20 07:24:35.923061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 552/1206] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:35 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:36.852619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-967b190c-9989-497c-b2a5-ad0e8f74b90c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:36.853555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-967b190c-9989-497c-b2a5-ad0e8f74b90c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:36.859859 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-967b190c-9989-497c-b2a5-ad0e8f74b90c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:36.860337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-967b190c-9989-497c-b2a5-ad0e8f74b90c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:36.861121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-967b190c-9989-497c-b2a5-ad0e8f74b90c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:36.861548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-967b190c-9989-497c-b2a5-ad0e8f74b90c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:36.890979 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-967b190c-9989-497c-b2a5-ad0e8f74b90c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042202 Jun 20 07:24:36.891559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 655/1207] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:36 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:36.934116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-184facc6-be40-4588-a311-fab1aad0e39c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:36.935042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-184facc6-be40-4588-a311-fab1aad0e39c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:36.941558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-184facc6-be40-4588-a311-fab1aad0e39c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:36.941950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-184facc6-be40-4588-a311-fab1aad0e39c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:36.942713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-184facc6-be40-4588-a311-fab1aad0e39c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:36.943152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-184facc6-be40-4588-a311-fab1aad0e39c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:36.971394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-184facc6-be40-4588-a311-fab1aad0e39c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041329 Jun 20 07:24:36.971937 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 553/1208] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:36 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:37.902818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0d13d1ae-c8de-4292-8590-22f833900f0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:37.903982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0d13d1ae-c8de-4292-8590-22f833900f0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:37.906438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=58 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:24:37.912428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d13d1ae-c8de-4292-8590-22f833900f0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:37.912885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d13d1ae-c8de-4292-8590-22f833900f0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:37.913667 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d13d1ae-c8de-4292-8590-22f833900f0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:37.914104 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d13d1ae-c8de-4292-8590-22f833900f0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:37.943997 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0d13d1ae-c8de-4292-8590-22f833900f0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045093 Jun 20 07:24:37.944579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 656/1209] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:37 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:37.984216 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-32c9fa72-adc0-4202-9b5c-150cf4a4a069 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:37.985158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-32c9fa72-adc0-4202-9b5c-150cf4a4a069 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:37.987508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=58 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:24:37.993918 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32c9fa72-adc0-4202-9b5c-150cf4a4a069 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:37.994366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32c9fa72-adc0-4202-9b5c-150cf4a4a069 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:37.995116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32c9fa72-adc0-4202-9b5c-150cf4a4a069 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:37.995544 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32c9fa72-adc0-4202-9b5c-150cf4a4a069 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:38.024510 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-32c9fa72-adc0-4202-9b5c-150cf4a4a069 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Jun 20 07:24:38.027171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 554/1210] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:37 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:38.955089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b3c18d3c-31f4-4a6e-980c-24384077145a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:38.956149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b3c18d3c-31f4-4a6e-980c-24384077145a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:38.963109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3c18d3c-31f4-4a6e-980c-24384077145a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:38.963492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3c18d3c-31f4-4a6e-980c-24384077145a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:38.964275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3c18d3c-31f4-4a6e-980c-24384077145a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:38.964709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3c18d3c-31f4-4a6e-980c-24384077145a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:38.994727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b3c18d3c-31f4-4a6e-980c-24384077145a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043427 Jun 20 07:24:38.995286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 657/1211] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:38 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:39.036269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a75b858a-53cd-441b-8b00-7ba37c8650bb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:24:39.037201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a75b858a-53cd-441b-8b00-7ba37c8650bb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:39.043612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a75b858a-53cd-441b-8b00-7ba37c8650bb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:39.044069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a75b858a-53cd-441b-8b00-7ba37c8650bb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:39.044865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a75b858a-53cd-441b-8b00-7ba37c8650bb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:39.045307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a75b858a-53cd-441b-8b00-7ba37c8650bb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:39.123510 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a75b858a-53cd-441b-8b00-7ba37c8650bb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "POST /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/action" status: 200 len: 75941 microversion: 2.1 time: 0.090874 Jun 20 07:24:39.124178 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 555/1212] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:24:39 2022] POST /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153/action => generated 75941 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:24:40.006250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e00ef6c6-f8b4-4ca9-a0da-107c163062d5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:40.007169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e00ef6c6-f8b4-4ca9-a0da-107c163062d5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:40.013851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e00ef6c6-f8b4-4ca9-a0da-107c163062d5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:40.014364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e00ef6c6-f8b4-4ca9-a0da-107c163062d5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:40.015189 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e00ef6c6-f8b4-4ca9-a0da-107c163062d5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:40.015619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e00ef6c6-f8b4-4ca9-a0da-107c163062d5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:40.045252 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e00ef6c6-f8b4-4ca9-a0da-107c163062d5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043144 Jun 20 07:24:40.045853 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 658/1213] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:40 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:41.058187 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4f42e97c-bcfc-4ec4-bace-a28f0a3e55af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:41.059322 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4f42e97c-bcfc-4ec4-bace-a28f0a3e55af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:41.066800 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f42e97c-bcfc-4ec4-bace-a28f0a3e55af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:41.067249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f42e97c-bcfc-4ec4-bace-a28f0a3e55af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:41.068005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f42e97c-bcfc-4ec4-bace-a28f0a3e55af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:41.068460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f42e97c-bcfc-4ec4-bace-a28f0a3e55af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:41.097987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4f42e97c-bcfc-4ec4-bace-a28f0a3e55af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Jun 20 07:24:41.101978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 556/1214] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:24:42.109757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-39d6ee20-819e-4534-a009-14156ac23f98 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:42.110685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-39d6ee20-819e-4534-a009-14156ac23f98 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:42.117726 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39d6ee20-819e-4534-a009-14156ac23f98 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:42.118179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39d6ee20-819e-4534-a009-14156ac23f98 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:42.118948 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39d6ee20-819e-4534-a009-14156ac23f98 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:42.119372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39d6ee20-819e-4534-a009-14156ac23f98 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:42.148317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-39d6ee20-819e-4534-a009-14156ac23f98 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 Jun 20 07:24:42.148876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 659/1215] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:42 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:43.158684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f3934626-846d-487f-9cff-c72dcfcc14fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:43.159639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f3934626-846d-487f-9cff-c72dcfcc14fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:43.165908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3934626-846d-487f-9cff-c72dcfcc14fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:43.166452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3934626-846d-487f-9cff-c72dcfcc14fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:43.167107 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3934626-846d-487f-9cff-c72dcfcc14fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:43.167553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3934626-846d-487f-9cff-c72dcfcc14fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:43.198711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f3934626-846d-487f-9cff-c72dcfcc14fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043900 Jun 20 07:24:43.199271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 557/1216] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:43 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:44.211198 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-75bdc5f2-c042-4f13-8c2c-1530d88c3a81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:44.212269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-75bdc5f2-c042-4f13-8c2c-1530d88c3a81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:44.218652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75bdc5f2-c042-4f13-8c2c-1530d88c3a81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:44.219092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75bdc5f2-c042-4f13-8c2c-1530d88c3a81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:44.220091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75bdc5f2-c042-4f13-8c2c-1530d88c3a81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:44.220292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75bdc5f2-c042-4f13-8c2c-1530d88c3a81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:44.249046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-75bdc5f2-c042-4f13-8c2c-1530d88c3a81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042397 Jun 20 07:24:44.249601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 660/1217] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:45.260706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8e735075-dc4e-4278-99d4-4d77f4073d06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:45.261637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8e735075-dc4e-4278-99d4-4d77f4073d06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:45.268151 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e735075-dc4e-4278-99d4-4d77f4073d06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:45.268619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e735075-dc4e-4278-99d4-4d77f4073d06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:45.269924 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e735075-dc4e-4278-99d4-4d77f4073d06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:45.270360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e735075-dc4e-4278-99d4-4d77f4073d06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:45.299333 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8e735075-dc4e-4278-99d4-4d77f4073d06 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042778 Jun 20 07:24:45.300085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 558/1218] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:46.310710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c5d6a751-782d-4c8e-bd3c-6104897f8dda tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:46.311621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c5d6a751-782d-4c8e-bd3c-6104897f8dda tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:46.318046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5d6a751-782d-4c8e-bd3c-6104897f8dda tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:46.318555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5d6a751-782d-4c8e-bd3c-6104897f8dda tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:46.319245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5d6a751-782d-4c8e-bd3c-6104897f8dda tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:46.319679 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c5d6a751-782d-4c8e-bd3c-6104897f8dda tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:46.350228 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c5d6a751-782d-4c8e-bd3c-6104897f8dda tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043332 Jun 20 07:24:46.350995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 661/1219] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:47.361682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-427cd1b6-643f-452c-8df5-cc581ba2758e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:47.363177 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-427cd1b6-643f-452c-8df5-cc581ba2758e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:47.369521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-427cd1b6-643f-452c-8df5-cc581ba2758e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:47.369976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-427cd1b6-643f-452c-8df5-cc581ba2758e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:47.370736 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-427cd1b6-643f-452c-8df5-cc581ba2758e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:47.371230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-427cd1b6-643f-452c-8df5-cc581ba2758e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:47.400397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-427cd1b6-643f-452c-8df5-cc581ba2758e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042610 Jun 20 07:24:47.401026 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 559/1220] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:47 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:48.411380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ebf287f-4daf-477b-88e7-232e9323dd11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:48.412355 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1ebf287f-4daf-477b-88e7-232e9323dd11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:48.419006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ebf287f-4daf-477b-88e7-232e9323dd11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:48.419457 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ebf287f-4daf-477b-88e7-232e9323dd11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:48.420245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ebf287f-4daf-477b-88e7-232e9323dd11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:48.420697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ebf287f-4daf-477b-88e7-232e9323dd11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:48.450971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ebf287f-4daf-477b-88e7-232e9323dd11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 Jun 20 07:24:48.451533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 662/1221] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:48 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:49.463039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f3a79c58-0f74-4327-b398-bdb11897ae17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:49.463965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f3a79c58-0f74-4327-b398-bdb11897ae17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:49.472693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3a79c58-0f74-4327-b398-bdb11897ae17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:49.473160 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3a79c58-0f74-4327-b398-bdb11897ae17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:49.473938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3a79c58-0f74-4327-b398-bdb11897ae17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:49.474382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3a79c58-0f74-4327-b398-bdb11897ae17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:49.504271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f3a79c58-0f74-4327-b398-bdb11897ae17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Jun 20 07:24:49.504836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 560/1222] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:50.515877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bd8c308f-7afd-4eca-8712-36cdf2295cc2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:50.516834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bd8c308f-7afd-4eca-8712-36cdf2295cc2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:50.523712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd8c308f-7afd-4eca-8712-36cdf2295cc2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:50.524188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd8c308f-7afd-4eca-8712-36cdf2295cc2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:50.524958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd8c308f-7afd-4eca-8712-36cdf2295cc2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:50.525389 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd8c308f-7afd-4eca-8712-36cdf2295cc2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:50.558199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bd8c308f-7afd-4eca-8712-36cdf2295cc2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046202 Jun 20 07:24:50.558773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 663/1223] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:51.569590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-89d2aa20-63b5-4cda-997e-bee088f0b905 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:51.570516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-89d2aa20-63b5-4cda-997e-bee088f0b905 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:51.576970 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89d2aa20-63b5-4cda-997e-bee088f0b905 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:51.577428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89d2aa20-63b5-4cda-997e-bee088f0b905 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:51.578197 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89d2aa20-63b5-4cda-997e-bee088f0b905 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:51.578637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89d2aa20-63b5-4cda-997e-bee088f0b905 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:51.608993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-89d2aa20-63b5-4cda-997e-bee088f0b905 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043258 Jun 20 07:24:51.609574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 561/1224] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:52.621236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-24c0acda-3cdf-47a8-ab2d-a57651418894 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:52.622163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-24c0acda-3cdf-47a8-ab2d-a57651418894 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:52.628583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24c0acda-3cdf-47a8-ab2d-a57651418894 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:52.629035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24c0acda-3cdf-47a8-ab2d-a57651418894 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:52.629805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24c0acda-3cdf-47a8-ab2d-a57651418894 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:52.630256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24c0acda-3cdf-47a8-ab2d-a57651418894 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:52.660513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-24c0acda-3cdf-47a8-ab2d-a57651418894 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043209 Jun 20 07:24:52.661076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 664/1225] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:53.671825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-da7a1a42-9477-49c6-a2cd-e24b111f7487 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:53.672767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-da7a1a42-9477-49c6-a2cd-e24b111f7487 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:53.679778 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da7a1a42-9477-49c6-a2cd-e24b111f7487 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:53.680259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da7a1a42-9477-49c6-a2cd-e24b111f7487 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:53.681028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da7a1a42-9477-49c6-a2cd-e24b111f7487 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:53.681548 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da7a1a42-9477-49c6-a2cd-e24b111f7487 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:53.712199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-da7a1a42-9477-49c6-a2cd-e24b111f7487 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044260 Jun 20 07:24:53.712763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 562/1226] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:54.723592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-abcec5eb-26e4-45d7-bd03-94d2aa1509e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:54.724589 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-abcec5eb-26e4-45d7-bd03-94d2aa1509e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:54.731142 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abcec5eb-26e4-45d7-bd03-94d2aa1509e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:54.731591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abcec5eb-26e4-45d7-bd03-94d2aa1509e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:54.732377 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abcec5eb-26e4-45d7-bd03-94d2aa1509e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:54.732813 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-abcec5eb-26e4-45d7-bd03-94d2aa1509e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:54.764616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-abcec5eb-26e4-45d7-bd03-94d2aa1509e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044872 Jun 20 07:24:54.765336 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 665/1227] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:54 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:55.775988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8f9acb0-b6a4-4672-a905-354d7e8888b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:55.776944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8f9acb0-b6a4-4672-a905-354d7e8888b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:55.783160 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8f9acb0-b6a4-4672-a905-354d7e8888b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:55.783615 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8f9acb0-b6a4-4672-a905-354d7e8888b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:55.784414 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8f9acb0-b6a4-4672-a905-354d7e8888b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:55.784847 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8f9acb0-b6a4-4672-a905-354d7e8888b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:55.813658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8f9acb0-b6a4-4672-a905-354d7e8888b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041536 Jun 20 07:24:55.814215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 563/1228] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:55 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:56.824985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fb8dae48-45e8-4a5e-80ac-ca4ea1772b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:56.825902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fb8dae48-45e8-4a5e-80ac-ca4ea1772b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:56.832378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb8dae48-45e8-4a5e-80ac-ca4ea1772b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:56.832829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb8dae48-45e8-4a5e-80ac-ca4ea1772b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:56.834152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb8dae48-45e8-4a5e-80ac-ca4ea1772b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:56.834584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb8dae48-45e8-4a5e-80ac-ca4ea1772b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:56.862295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fb8dae48-45e8-4a5e-80ac-ca4ea1772b7a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041256 Jun 20 07:24:56.862834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 666/1229] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:57.873883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab9248ca-3aaf-4c9e-b81a-0ddb6ecf14a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:57.874805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab9248ca-3aaf-4c9e-b81a-0ddb6ecf14a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:57.881833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab9248ca-3aaf-4c9e-b81a-0ddb6ecf14a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:57.882281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab9248ca-3aaf-4c9e-b81a-0ddb6ecf14a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:57.883036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab9248ca-3aaf-4c9e-b81a-0ddb6ecf14a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:57.883469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab9248ca-3aaf-4c9e-b81a-0ddb6ecf14a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:57.911154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab9248ca-3aaf-4c9e-b81a-0ddb6ecf14a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 Jun 20 07:24:57.911686 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 564/1230] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:57 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:58.922830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5ba7ec07-31d5-44e2-abc1-4b99f4852256 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:58.923689 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5ba7ec07-31d5-44e2-abc1-4b99f4852256 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:58.930915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5ba7ec07-31d5-44e2-abc1-4b99f4852256 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:58.931365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5ba7ec07-31d5-44e2-abc1-4b99f4852256 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:58.932153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5ba7ec07-31d5-44e2-abc1-4b99f4852256 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:58.932595 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5ba7ec07-31d5-44e2-abc1-4b99f4852256 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:58.960309 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5ba7ec07-31d5-44e2-abc1-4b99f4852256 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041538 Jun 20 07:24:58.960863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 667/1231] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:24:59.971798 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1cd7b15f-f145-4795-aa5c-fb081f4bd4af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:24:59.972930 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1cd7b15f-f145-4795-aa5c-fb081f4bd4af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:24:59.979224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cd7b15f-f145-4795-aa5c-fb081f4bd4af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:59.979677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cd7b15f-f145-4795-aa5c-fb081f4bd4af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:24:59.980474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cd7b15f-f145-4795-aa5c-fb081f4bd4af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:24:59.980915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cd7b15f-f145-4795-aa5c-fb081f4bd4af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:00.010302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1cd7b15f-f145-4795-aa5c-fb081f4bd4af tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042516 Jun 20 07:25:00.011270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 565/1232] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:24:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:01.022452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-be6166bd-b3c2-4325-8f11-c7e985090a73 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:01.023405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-be6166bd-b3c2-4325-8f11-c7e985090a73 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:01.029893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be6166bd-b3c2-4325-8f11-c7e985090a73 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:01.030347 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be6166bd-b3c2-4325-8f11-c7e985090a73 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:01.031113 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be6166bd-b3c2-4325-8f11-c7e985090a73 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:01.031551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be6166bd-b3c2-4325-8f11-c7e985090a73 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:01.061568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-be6166bd-b3c2-4325-8f11-c7e985090a73 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043502 Jun 20 07:25:01.062131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 668/1233] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:01 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:02.073790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-419c6d0b-fdbc-4d27-bd39-ef3e9b8ffacf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:02.074718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-419c6d0b-fdbc-4d27-bd39-ef3e9b8ffacf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:02.081229 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-419c6d0b-fdbc-4d27-bd39-ef3e9b8ffacf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:02.081684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-419c6d0b-fdbc-4d27-bd39-ef3e9b8ffacf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:02.082448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-419c6d0b-fdbc-4d27-bd39-ef3e9b8ffacf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:02.082888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-419c6d0b-fdbc-4d27-bd39-ef3e9b8ffacf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:02.087132 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:25:02.111767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-419c6d0b-fdbc-4d27-bd39-ef3e9b8ffacf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041899 Jun 20 07:25:02.112349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 566/1234] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:03.123285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-02acb4b5-43ab-4ccc-9f4d-6465122b4c29 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:03.124231 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-02acb4b5-43ab-4ccc-9f4d-6465122b4c29 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:03.131304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02acb4b5-43ab-4ccc-9f4d-6465122b4c29 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:03.131752 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02acb4b5-43ab-4ccc-9f4d-6465122b4c29 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:03.132536 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02acb4b5-43ab-4ccc-9f4d-6465122b4c29 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:03.132972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02acb4b5-43ab-4ccc-9f4d-6465122b4c29 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:03.136806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:25:03.161698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-02acb4b5-43ab-4ccc-9f4d-6465122b4c29 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042371 Jun 20 07:25:03.162256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 669/1235] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:03 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:04.173304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dc3f35ba-52ba-4d7b-9de5-6cd8acb7554f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:04.174242 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dc3f35ba-52ba-4d7b-9de5-6cd8acb7554f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:04.180665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc3f35ba-52ba-4d7b-9de5-6cd8acb7554f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:04.181112 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc3f35ba-52ba-4d7b-9de5-6cd8acb7554f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:04.181884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc3f35ba-52ba-4d7b-9de5-6cd8acb7554f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:04.182464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc3f35ba-52ba-4d7b-9de5-6cd8acb7554f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:04.211341 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dc3f35ba-52ba-4d7b-9de5-6cd8acb7554f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041924 Jun 20 07:25:04.211906 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 567/1236] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:04 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:05.223206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1a714097-7fda-4ab9-906a-47071c1c7c2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:05.224809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a714097-7fda-4ab9-906a-47071c1c7c2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:05.230918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a714097-7fda-4ab9-906a-47071c1c7c2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:05.231356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a714097-7fda-4ab9-906a-47071c1c7c2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:05.232338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a714097-7fda-4ab9-906a-47071c1c7c2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:05.232772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a714097-7fda-4ab9-906a-47071c1c7c2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:05.261562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1a714097-7fda-4ab9-906a-47071c1c7c2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042382 Jun 20 07:25:05.262125 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 670/1237] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:05 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:06.273959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2a7ecaf5-298f-4d58-a22c-ff97747a54c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:06.274480 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2a7ecaf5-298f-4d58-a22c-ff97747a54c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:06.283770 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a7ecaf5-298f-4d58-a22c-ff97747a54c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:06.284311 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a7ecaf5-298f-4d58-a22c-ff97747a54c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:06.285095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a7ecaf5-298f-4d58-a22c-ff97747a54c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:06.285725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a7ecaf5-298f-4d58-a22c-ff97747a54c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:06.323554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2a7ecaf5-298f-4d58-a22c-ff97747a54c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053703 Jun 20 07:25:06.324635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 568/1238] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:06 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:07.335975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f0a983a8-59e5-4193-bcbd-e614e610ef9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:07.336951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0a983a8-59e5-4193-bcbd-e614e610ef9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:07.343450 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0a983a8-59e5-4193-bcbd-e614e610ef9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:07.343896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0a983a8-59e5-4193-bcbd-e614e610ef9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:07.344697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0a983a8-59e5-4193-bcbd-e614e610ef9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:07.345131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0a983a8-59e5-4193-bcbd-e614e610ef9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:07.373274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f0a983a8-59e5-4193-bcbd-e614e610ef9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041784 Jun 20 07:25:07.373827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 671/1239] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:07 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:08.385623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aa35a2ca-6823-4e81-a760-22180f88f86a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:08.386549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aa35a2ca-6823-4e81-a760-22180f88f86a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:08.388889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=30 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:25:08.394324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa35a2ca-6823-4e81-a760-22180f88f86a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:08.394785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa35a2ca-6823-4e81-a760-22180f88f86a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:08.395590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa35a2ca-6823-4e81-a760-22180f88f86a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:08.395983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa35a2ca-6823-4e81-a760-22180f88f86a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:08.425381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aa35a2ca-6823-4e81-a760-22180f88f86a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043956 Jun 20 07:25:08.425945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 569/1240] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:08 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:09.437560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3593418c-77f5-4a16-8d92-346911c2c865 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:09.438473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3593418c-77f5-4a16-8d92-346911c2c865 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:09.440965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=32 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:25:09.446979 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3593418c-77f5-4a16-8d92-346911c2c865 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:09.447369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3593418c-77f5-4a16-8d92-346911c2c865 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:09.448130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3593418c-77f5-4a16-8d92-346911c2c865 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:09.448572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3593418c-77f5-4a16-8d92-346911c2c865 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:09.477812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3593418c-77f5-4a16-8d92-346911c2c865 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Jun 20 07:25:09.478442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 672/1241] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:09 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:10.489152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-04618b5b-4ea4-4994-9f3f-ba14ed77108c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:10.490242 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-04618b5b-4ea4-4994-9f3f-ba14ed77108c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:10.496574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04618b5b-4ea4-4994-9f3f-ba14ed77108c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:10.497023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04618b5b-4ea4-4994-9f3f-ba14ed77108c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:10.497790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04618b5b-4ea4-4994-9f3f-ba14ed77108c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:10.498224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04618b5b-4ea4-4994-9f3f-ba14ed77108c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:10.526848 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-04618b5b-4ea4-4994-9f3f-ba14ed77108c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041687 Jun 20 07:25:10.527401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 570/1242] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:10 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:11.538197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-07b2ac3a-a183-440f-9edb-ba43fec02835 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:11.539157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-07b2ac3a-a183-440f-9edb-ba43fec02835 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:11.545763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07b2ac3a-a183-440f-9edb-ba43fec02835 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:11.546252 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07b2ac3a-a183-440f-9edb-ba43fec02835 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:11.547083 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07b2ac3a-a183-440f-9edb-ba43fec02835 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:11.547515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07b2ac3a-a183-440f-9edb-ba43fec02835 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:11.577562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-07b2ac3a-a183-440f-9edb-ba43fec02835 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Jun 20 07:25:11.578122 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 673/1243] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:11 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:12.588869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31604f94-70dc-4d50-8d4c-97e822c2ec78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:12.589873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-31604f94-70dc-4d50-8d4c-97e822c2ec78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:12.596323 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31604f94-70dc-4d50-8d4c-97e822c2ec78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:12.596775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31604f94-70dc-4d50-8d4c-97e822c2ec78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:12.597544 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31604f94-70dc-4d50-8d4c-97e822c2ec78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:12.597986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31604f94-70dc-4d50-8d4c-97e822c2ec78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:12.631096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-31604f94-70dc-4d50-8d4c-97e822c2ec78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046132 Jun 20 07:25:12.632192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 571/1244] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:12 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:13.645663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4c916bfa-d44f-4d54-a7ab-e1124eadb43c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:13.646658 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4c916bfa-d44f-4d54-a7ab-e1124eadb43c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:13.653147 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c916bfa-d44f-4d54-a7ab-e1124eadb43c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:13.653477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c916bfa-d44f-4d54-a7ab-e1124eadb43c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:13.654242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c916bfa-d44f-4d54-a7ab-e1124eadb43c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:13.654682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c916bfa-d44f-4d54-a7ab-e1124eadb43c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:13.683429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4c916bfa-d44f-4d54-a7ab-e1124eadb43c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041619 Jun 20 07:25:13.683990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 674/1245] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:13 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:14.695238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2868cb70-a6da-4742-a1f7-8bed557862ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:14.697136 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2868cb70-a6da-4742-a1f7-8bed557862ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:14.704030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2868cb70-a6da-4742-a1f7-8bed557862ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:14.704768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2868cb70-a6da-4742-a1f7-8bed557862ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:14.705847 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2868cb70-a6da-4742-a1f7-8bed557862ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:14.706711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2868cb70-a6da-4742-a1f7-8bed557862ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:14.737600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2868cb70-a6da-4742-a1f7-8bed557862ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046672 Jun 20 07:25:14.738166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 572/1246] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:14 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:15.748334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f7daba9d-baf2-48a7-8b2c-e5994020014e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:15.749255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f7daba9d-baf2-48a7-8b2c-e5994020014e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:15.755968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7daba9d-baf2-48a7-8b2c-e5994020014e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:15.756441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7daba9d-baf2-48a7-8b2c-e5994020014e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:15.757208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7daba9d-baf2-48a7-8b2c-e5994020014e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:15.757641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7daba9d-baf2-48a7-8b2c-e5994020014e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:15.786266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f7daba9d-baf2-48a7-8b2c-e5994020014e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041778 Jun 20 07:25:15.786812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 675/1247] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:15 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:16.797630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4c2d5dcf-a6a2-4d51-a0ff-da83de85d51a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:16.798545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4c2d5dcf-a6a2-4d51-a0ff-da83de85d51a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:16.805336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c2d5dcf-a6a2-4d51-a0ff-da83de85d51a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:16.805780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c2d5dcf-a6a2-4d51-a0ff-da83de85d51a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:16.806535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c2d5dcf-a6a2-4d51-a0ff-da83de85d51a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:16.806967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c2d5dcf-a6a2-4d51-a0ff-da83de85d51a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:16.834872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4c2d5dcf-a6a2-4d51-a0ff-da83de85d51a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 Jun 20 07:25:16.835406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 573/1248] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:16 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:17.846275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-57840117-bcc4-4064-b948-ee964b82fefe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:17.847228 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-57840117-bcc4-4064-b948-ee964b82fefe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:17.853625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57840117-bcc4-4064-b948-ee964b82fefe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:17.854088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57840117-bcc4-4064-b948-ee964b82fefe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:17.854932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57840117-bcc4-4064-b948-ee964b82fefe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:17.855388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-57840117-bcc4-4064-b948-ee964b82fefe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:17.885008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-57840117-bcc4-4064-b948-ee964b82fefe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042711 Jun 20 07:25:17.885562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 676/1249] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:17 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:18.896372 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-482a27fe-4151-446d-9a60-b81579e75ba6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:18.897296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-482a27fe-4151-446d-9a60-b81579e75ba6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:18.903710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-482a27fe-4151-446d-9a60-b81579e75ba6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:18.904188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-482a27fe-4151-446d-9a60-b81579e75ba6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:18.904949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-482a27fe-4151-446d-9a60-b81579e75ba6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:18.905385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-482a27fe-4151-446d-9a60-b81579e75ba6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:18.933910 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-482a27fe-4151-446d-9a60-b81579e75ba6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041471 Jun 20 07:25:18.934451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 574/1250] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:18 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:19.945732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e34104d-f7e2-4317-8cfb-37d7bb4c9ba7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:19.946699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e34104d-f7e2-4317-8cfb-37d7bb4c9ba7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:19.953189 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e34104d-f7e2-4317-8cfb-37d7bb4c9ba7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:19.953636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e34104d-f7e2-4317-8cfb-37d7bb4c9ba7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:19.954402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e34104d-f7e2-4317-8cfb-37d7bb4c9ba7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:19.954839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e34104d-f7e2-4317-8cfb-37d7bb4c9ba7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:19.983771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e34104d-f7e2-4317-8cfb-37d7bb4c9ba7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042401 Jun 20 07:25:19.984354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 677/1251] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:19 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:20.994714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e5d4d56e-1a33-4c7c-a1b9-2173d22fde0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:20.995675 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e5d4d56e-1a33-4c7c-a1b9-2173d22fde0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:21.001864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5d4d56e-1a33-4c7c-a1b9-2173d22fde0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:21.002324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5d4d56e-1a33-4c7c-a1b9-2173d22fde0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:21.003082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5d4d56e-1a33-4c7c-a1b9-2173d22fde0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:21.003518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5d4d56e-1a33-4c7c-a1b9-2173d22fde0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:21.032209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e5d4d56e-1a33-4c7c-a1b9-2173d22fde0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041445 Jun 20 07:25:21.032757 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 575/1252] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:20 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:22.043216 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e60f3fa4-da12-4a09-af3a-79bcaa584ec7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:22.044193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e60f3fa4-da12-4a09-af3a-79bcaa584ec7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:22.050522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e60f3fa4-da12-4a09-af3a-79bcaa584ec7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:22.050968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e60f3fa4-da12-4a09-af3a-79bcaa584ec7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:22.051722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e60f3fa4-da12-4a09-af3a-79bcaa584ec7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:22.052174 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e60f3fa4-da12-4a09-af3a-79bcaa584ec7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:22.080610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e60f3fa4-da12-4a09-af3a-79bcaa584ec7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041227 Jun 20 07:25:22.081330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 678/1253] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:22 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:23.091494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-29257ff8-3ded-48f6-9aed-8653f8569575 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:23.092445 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-29257ff8-3ded-48f6-9aed-8653f8569575 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:23.098785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29257ff8-3ded-48f6-9aed-8653f8569575 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:23.099241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29257ff8-3ded-48f6-9aed-8653f8569575 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:23.100008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29257ff8-3ded-48f6-9aed-8653f8569575 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:23.100473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29257ff8-3ded-48f6-9aed-8653f8569575 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:23.128969 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-29257ff8-3ded-48f6-9aed-8653f8569575 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041439 Jun 20 07:25:23.129514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 576/1254] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:23 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:24.141116 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ef3a7ee0-98b8-4a57-8e88-69ba74340ace tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:24.142047 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ef3a7ee0-98b8-4a57-8e88-69ba74340ace tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:24.148942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef3a7ee0-98b8-4a57-8e88-69ba74340ace tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:24.149499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef3a7ee0-98b8-4a57-8e88-69ba74340ace tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:24.150177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef3a7ee0-98b8-4a57-8e88-69ba74340ace tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:24.150580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef3a7ee0-98b8-4a57-8e88-69ba74340ace tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:24.179121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ef3a7ee0-98b8-4a57-8e88-69ba74340ace tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041888 Jun 20 07:25:24.179664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 679/1255] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:24 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:25.190740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dcf137da-17fd-4141-8313-2bce0d2b85a8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:25.191664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dcf137da-17fd-4141-8313-2bce0d2b85a8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:25.198074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcf137da-17fd-4141-8313-2bce0d2b85a8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:25.198530 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcf137da-17fd-4141-8313-2bce0d2b85a8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:25.199292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcf137da-17fd-4141-8313-2bce0d2b85a8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:25.199733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcf137da-17fd-4141-8313-2bce0d2b85a8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:25.230426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dcf137da-17fd-4141-8313-2bce0d2b85a8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043644 Jun 20 07:25:25.231302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 577/1256] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:25 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:25.602190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:25:25.602397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:25:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:25:26.242418 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ffc1d6d1-381f-42e7-9576-8602b2f3cefa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:26.243342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ffc1d6d1-381f-42e7-9576-8602b2f3cefa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:26.249804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffc1d6d1-381f-42e7-9576-8602b2f3cefa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:26.250257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffc1d6d1-381f-42e7-9576-8602b2f3cefa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:26.251031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffc1d6d1-381f-42e7-9576-8602b2f3cefa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:26.251466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ffc1d6d1-381f-42e7-9576-8602b2f3cefa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:26.280569 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ffc1d6d1-381f-42e7-9576-8602b2f3cefa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042516 Jun 20 07:25:26.281323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 680/1257] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:26 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:27.293133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3d88146d-c925-44d7-bbfa-04371653ab8b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:27.294059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3d88146d-c925-44d7-bbfa-04371653ab8b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:27.305330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d88146d-c925-44d7-bbfa-04371653ab8b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:27.305785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d88146d-c925-44d7-bbfa-04371653ab8b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:27.306564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d88146d-c925-44d7-bbfa-04371653ab8b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:27.307010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d88146d-c925-44d7-bbfa-04371653ab8b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:27.336859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3d88146d-c925-44d7-bbfa-04371653ab8b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048248 Jun 20 07:25:27.337404 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 578/1258] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:27 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:28.348879 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f4bf6074-b6f2-4057-ad53-39548c5bfb13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:28.350314 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f4bf6074-b6f2-4057-ad53-39548c5bfb13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:28.356750 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4bf6074-b6f2-4057-ad53-39548c5bfb13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:28.357200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4bf6074-b6f2-4057-ad53-39548c5bfb13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:28.357963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4bf6074-b6f2-4057-ad53-39548c5bfb13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:28.358431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4bf6074-b6f2-4057-ad53-39548c5bfb13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:28.387736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f4bf6074-b6f2-4057-ad53-39548c5bfb13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042752 Jun 20 07:25:28.388317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 681/1259] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:28 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:29.399304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aeb3eb4a-a927-45ea-b1bb-59873e84460b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:29.400269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aeb3eb4a-a927-45ea-b1bb-59873e84460b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:29.406826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aeb3eb4a-a927-45ea-b1bb-59873e84460b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:29.407281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aeb3eb4a-a927-45ea-b1bb-59873e84460b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:29.408043 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aeb3eb4a-a927-45ea-b1bb-59873e84460b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:29.408508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aeb3eb4a-a927-45ea-b1bb-59873e84460b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:29.436791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aeb3eb4a-a927-45ea-b1bb-59873e84460b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 Jun 20 07:25:29.437325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 579/1260] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:29 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:30.449393 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2fbc8faf-c1e4-4eb6-9a03-759541079598 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:30.450384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2fbc8faf-c1e4-4eb6-9a03-759541079598 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:30.456437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fbc8faf-c1e4-4eb6-9a03-759541079598 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:30.456887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fbc8faf-c1e4-4eb6-9a03-759541079598 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:30.457646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fbc8faf-c1e4-4eb6-9a03-759541079598 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:30.458078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fbc8faf-c1e4-4eb6-9a03-759541079598 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:30.486402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2fbc8faf-c1e4-4eb6-9a03-759541079598 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042221 Jun 20 07:25:30.486955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 682/1261] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:30 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:31.498413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-67d9f040-e2ee-45a7-9c0e-f0563a42cf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:31.499366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-67d9f040-e2ee-45a7-9c0e-f0563a42cf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:31.506584 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67d9f040-e2ee-45a7-9c0e-f0563a42cf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:31.507044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67d9f040-e2ee-45a7-9c0e-f0563a42cf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:31.507797 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67d9f040-e2ee-45a7-9c0e-f0563a42cf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:31.508269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-67d9f040-e2ee-45a7-9c0e-f0563a42cf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:31.537434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-67d9f040-e2ee-45a7-9c0e-f0563a42cf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042951 Jun 20 07:25:31.537979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 580/1262] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:31 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:32.548783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-00b25cdd-7ea5-4648-9755-94dc6ce1b523 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:32.549696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-00b25cdd-7ea5-4648-9755-94dc6ce1b523 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:32.556725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00b25cdd-7ea5-4648-9755-94dc6ce1b523 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:32.557169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00b25cdd-7ea5-4648-9755-94dc6ce1b523 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:32.557925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00b25cdd-7ea5-4648-9755-94dc6ce1b523 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:32.558352 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00b25cdd-7ea5-4648-9755-94dc6ce1b523 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:32.588911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-00b25cdd-7ea5-4648-9755-94dc6ce1b523 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 Jun 20 07:25:32.589477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 683/1263] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:32 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:32.777893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:25:32.778058 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:25:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:25:33.600830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7424e5fb-3242-457e-ab86-6a04fed72b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:33.601768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7424e5fb-3242-457e-ab86-6a04fed72b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:33.608087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7424e5fb-3242-457e-ab86-6a04fed72b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:33.608585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7424e5fb-3242-457e-ab86-6a04fed72b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:33.609324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7424e5fb-3242-457e-ab86-6a04fed72b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:33.609752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7424e5fb-3242-457e-ab86-6a04fed72b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:33.611997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=89 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:25:33.638818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7424e5fb-3242-457e-ab86-6a04fed72b02 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042491 Jun 20 07:25:33.639351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 581/1264] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:33 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:34.650147 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f56acf9e-4091-4003-9cbb-899f513b29e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:34.651099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f56acf9e-4091-4003-9cbb-899f513b29e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:34.657317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f56acf9e-4091-4003-9cbb-899f513b29e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:34.657762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f56acf9e-4091-4003-9cbb-899f513b29e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:34.658517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f56acf9e-4091-4003-9cbb-899f513b29e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:34.658953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f56acf9e-4091-4003-9cbb-899f513b29e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:34.662434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=89 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:25:34.687398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f56acf9e-4091-4003-9cbb-899f513b29e5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041187 Jun 20 07:25:34.687941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 684/1265] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:35.699237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a98b6e1e-e750-4a2f-91c6-899ff44e32a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:35.700218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a98b6e1e-e750-4a2f-91c6-899ff44e32a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:35.706808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a98b6e1e-e750-4a2f-91c6-899ff44e32a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:35.707262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a98b6e1e-e750-4a2f-91c6-899ff44e32a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:35.708150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a98b6e1e-e750-4a2f-91c6-899ff44e32a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:35.709145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a98b6e1e-e750-4a2f-91c6-899ff44e32a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:35.737387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a98b6e1e-e750-4a2f-91c6-899ff44e32a0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 Jun 20 07:25:35.737928 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 582/1266] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:35 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:36.748945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2546f37b-feb3-46b9-8764-b53cc0556b54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:36.749903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2546f37b-feb3-46b9-8764-b53cc0556b54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:36.756379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2546f37b-feb3-46b9-8764-b53cc0556b54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:36.756839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2546f37b-feb3-46b9-8764-b53cc0556b54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:36.757605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2546f37b-feb3-46b9-8764-b53cc0556b54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:36.758047 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2546f37b-feb3-46b9-8764-b53cc0556b54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:36.787992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2546f37b-feb3-46b9-8764-b53cc0556b54 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043062 Jun 20 07:25:36.788581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 685/1267] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:36 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:37.799382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c868f4cc-641e-4538-91ea-8c912157bbfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:37.800326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c868f4cc-641e-4538-91ea-8c912157bbfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:37.807393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c868f4cc-641e-4538-91ea-8c912157bbfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:37.807838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c868f4cc-641e-4538-91ea-8c912157bbfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:37.808633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c868f4cc-641e-4538-91ea-8c912157bbfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:37.809084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c868f4cc-641e-4538-91ea-8c912157bbfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:37.836767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c868f4cc-641e-4538-91ea-8c912157bbfd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041345 Jun 20 07:25:37.837298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 583/1268] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:37 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:38.847745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-73b3b48b-ebce-46a9-b419-d9c7fc93b996 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:38.848727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-73b3b48b-ebce-46a9-b419-d9c7fc93b996 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:38.855024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73b3b48b-ebce-46a9-b419-d9c7fc93b996 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:38.855467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73b3b48b-ebce-46a9-b419-d9c7fc93b996 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:38.856245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73b3b48b-ebce-46a9-b419-d9c7fc93b996 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:38.856679 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73b3b48b-ebce-46a9-b419-d9c7fc93b996 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:38.885894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-73b3b48b-ebce-46a9-b419-d9c7fc93b996 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042008 Jun 20 07:25:38.886429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 686/1269] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:38 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:39.897055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-19e0f26d-31f5-4941-b6a2-0fef7b7ec112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:39.897968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-19e0f26d-31f5-4941-b6a2-0fef7b7ec112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:39.900365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=30 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:25:39.905437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19e0f26d-31f5-4941-b6a2-0fef7b7ec112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:39.905885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19e0f26d-31f5-4941-b6a2-0fef7b7ec112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:39.906635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19e0f26d-31f5-4941-b6a2-0fef7b7ec112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:39.907061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19e0f26d-31f5-4941-b6a2-0fef7b7ec112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:39.935145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-19e0f26d-31f5-4941-b6a2-0fef7b7ec112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042503 Jun 20 07:25:39.935676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 584/1270] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:39 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:40.947014 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3938a6b9-0d64-4fcb-ae7d-16fc508af5c2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:40.947936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3938a6b9-0d64-4fcb-ae7d-16fc508af5c2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:40.950369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=30 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:25:40.955753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3938a6b9-0d64-4fcb-ae7d-16fc508af5c2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:40.956231 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3938a6b9-0d64-4fcb-ae7d-16fc508af5c2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:40.957004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3938a6b9-0d64-4fcb-ae7d-16fc508af5c2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:40.957442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3938a6b9-0d64-4fcb-ae7d-16fc508af5c2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:40.986278 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3938a6b9-0d64-4fcb-ae7d-16fc508af5c2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Jun 20 07:25:40.986757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 687/1271] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:40 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:41.996843 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-92c0967a-c879-4151-8736-97a122d3717d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:41.997793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-92c0967a-c879-4151-8736-97a122d3717d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:42.004260 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92c0967a-c879-4151-8736-97a122d3717d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:42.004710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92c0967a-c879-4151-8736-97a122d3717d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:42.005466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92c0967a-c879-4151-8736-97a122d3717d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:42.005901 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92c0967a-c879-4151-8736-97a122d3717d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:42.034153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-92c0967a-c879-4151-8736-97a122d3717d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 Jun 20 07:25:42.034681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 585/1272] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:43.045972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-07dc27e7-5e47-4d8b-93c1-46fb055c2d3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:43.046908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-07dc27e7-5e47-4d8b-93c1-46fb055c2d3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:43.053191 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07dc27e7-5e47-4d8b-93c1-46fb055c2d3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:43.053628 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07dc27e7-5e47-4d8b-93c1-46fb055c2d3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:43.054374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07dc27e7-5e47-4d8b-93c1-46fb055c2d3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:43.054805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07dc27e7-5e47-4d8b-93c1-46fb055c2d3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:43.083914 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-07dc27e7-5e47-4d8b-93c1-46fb055c2d3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041184 Jun 20 07:25:43.084491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 688/1273] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:43 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:44.095248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8e02aaa5-d867-411d-8680-2c023612ce0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:44.096195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8e02aaa5-d867-411d-8680-2c023612ce0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:44.102621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e02aaa5-d867-411d-8680-2c023612ce0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:44.103074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e02aaa5-d867-411d-8680-2c023612ce0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:44.103830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e02aaa5-d867-411d-8680-2c023612ce0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:44.104301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e02aaa5-d867-411d-8680-2c023612ce0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:44.132745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8e02aaa5-d867-411d-8680-2c023612ce0e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041481 Jun 20 07:25:44.133288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 586/1274] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:45.144251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ac42f2ed-1cb7-4887-b2db-a26179be32bc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:45.145216 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ac42f2ed-1cb7-4887-b2db-a26179be32bc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:45.152322 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac42f2ed-1cb7-4887-b2db-a26179be32bc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:45.152775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac42f2ed-1cb7-4887-b2db-a26179be32bc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:45.153567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac42f2ed-1cb7-4887-b2db-a26179be32bc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:45.154003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ac42f2ed-1cb7-4887-b2db-a26179be32bc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:45.182392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ac42f2ed-1cb7-4887-b2db-a26179be32bc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042049 Jun 20 07:25:45.182932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 689/1275] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:45.454165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7def9830-04e6-4b43-b5d6-5f7fb008adff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:45.455224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7def9830-04e6-4b43-b5d6-5f7fb008adff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:45.462361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7def9830-04e6-4b43-b5d6-5f7fb008adff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:45.462817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7def9830-04e6-4b43-b5d6-5f7fb008adff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:45.463581 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7def9830-04e6-4b43-b5d6-5f7fb008adff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:45.464081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7def9830-04e6-4b43-b5d6-5f7fb008adff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:45.488931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7def9830-04e6-4b43-b5d6-5f7fb008adff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:25:45.566465 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7def9830-04e6-4b43-b5d6-5f7fb008adff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 204 len: 0 microversion: 2.20 time: 0.115844 Jun 20 07:25:45.567049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 587/1276] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Jun 20 07:25:45 2022] DELETE /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 07:25:45.576163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f427b6e1-84b7-4519-b7d1-ab2f09eed62c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:45.576780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f427b6e1-84b7-4519-b7d1-ab2f09eed62c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:45.582843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f427b6e1-84b7-4519-b7d1-ab2f09eed62c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:45.583877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f427b6e1-84b7-4519-b7d1-ab2f09eed62c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:45.584651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f427b6e1-84b7-4519-b7d1-ab2f09eed62c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:45.585086 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f427b6e1-84b7-4519-b7d1-ab2f09eed62c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:45.712790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f427b6e1-84b7-4519-b7d1-ab2f09eed62c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:45.721161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f427b6e1-84b7-4519-b7d1-ab2f09eed62c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:45.722674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f427b6e1-84b7-4519-b7d1-ab2f09eed62c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:45.723827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f427b6e1-84b7-4519-b7d1-ab2f09eed62c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151571 Jun 20 07:25:45.724424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 690/1277] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:45 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:46.193796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-be787372-0ad4-4b16-9be5-661ee4e7680f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:46.194817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-be787372-0ad4-4b16-9be5-661ee4e7680f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:46.200750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be787372-0ad4-4b16-9be5-661ee4e7680f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:46.201202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be787372-0ad4-4b16-9be5-661ee4e7680f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:46.201961 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be787372-0ad4-4b16-9be5-661ee4e7680f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:46.202402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be787372-0ad4-4b16-9be5-661ee4e7680f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:46.231143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-be787372-0ad4-4b16-9be5-661ee4e7680f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041618 Jun 20 07:25:46.231674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 588/1278] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:46.742338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-11b10e94-a65b-41c1-8052-c31ec206370c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:46.742939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-11b10e94-a65b-41c1-8052-c31ec206370c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:46.749430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-11b10e94-a65b-41c1-8052-c31ec206370c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:46.749872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-11b10e94-a65b-41c1-8052-c31ec206370c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:46.750619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-11b10e94-a65b-41c1-8052-c31ec206370c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:46.751047 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-11b10e94-a65b-41c1-8052-c31ec206370c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:46.880590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-11b10e94-a65b-41c1-8052-c31ec206370c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:46.889362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-11b10e94-a65b-41c1-8052-c31ec206370c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:46.890900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-11b10e94-a65b-41c1-8052-c31ec206370c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:46.892065 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-11b10e94-a65b-41c1-8052-c31ec206370c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153571 Jun 20 07:25:46.892661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 691/1279] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:46 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:47.242147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d5753371-182a-4ff9-bf13-32172efe4101 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:47.243072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d5753371-182a-4ff9-bf13-32172efe4101 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:47.249536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5753371-182a-4ff9-bf13-32172efe4101 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:47.249992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5753371-182a-4ff9-bf13-32172efe4101 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:47.250752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5753371-182a-4ff9-bf13-32172efe4101 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:47.251192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5753371-182a-4ff9-bf13-32172efe4101 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:47.281026 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d5753371-182a-4ff9-bf13-32172efe4101 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 Jun 20 07:25:47.281563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 589/1280] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:47 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:47.911046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-09a34a76-3eaa-4de5-9478-485fcb396a28 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:47.911652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-09a34a76-3eaa-4de5-9478-485fcb396a28 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:47.918711 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09a34a76-3eaa-4de5-9478-485fcb396a28 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:47.919155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09a34a76-3eaa-4de5-9478-485fcb396a28 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:47.919912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09a34a76-3eaa-4de5-9478-485fcb396a28 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:47.920375 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09a34a76-3eaa-4de5-9478-485fcb396a28 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:48.045317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-09a34a76-3eaa-4de5-9478-485fcb396a28 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:48.053548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-09a34a76-3eaa-4de5-9478-485fcb396a28 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:48.055035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-09a34a76-3eaa-4de5-9478-485fcb396a28 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:48.056214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-09a34a76-3eaa-4de5-9478-485fcb396a28 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149013 Jun 20 07:25:48.056778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 692/1281] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:47 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:48.292542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e8098e16-2d65-4638-8da1-4934da46624b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:48.293483 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e8098e16-2d65-4638-8da1-4934da46624b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:48.299838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8098e16-2d65-4638-8da1-4934da46624b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:48.300324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8098e16-2d65-4638-8da1-4934da46624b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:48.301073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8098e16-2d65-4638-8da1-4934da46624b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:48.301501 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8098e16-2d65-4638-8da1-4934da46624b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:48.329428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e8098e16-2d65-4638-8da1-4934da46624b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040926 Jun 20 07:25:48.329956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 590/1282] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:48 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:49.074314 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-40b3edac-0666-4a33-a213-71f97e70c847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:49.074960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-40b3edac-0666-4a33-a213-71f97e70c847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:49.081501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40b3edac-0666-4a33-a213-71f97e70c847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:49.081951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40b3edac-0666-4a33-a213-71f97e70c847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:49.082714 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40b3edac-0666-4a33-a213-71f97e70c847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:49.083152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40b3edac-0666-4a33-a213-71f97e70c847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:49.225068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-40b3edac-0666-4a33-a213-71f97e70c847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:49.233619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-40b3edac-0666-4a33-a213-71f97e70c847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:49.235105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-40b3edac-0666-4a33-a213-71f97e70c847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:49.236281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-40b3edac-0666-4a33-a213-71f97e70c847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.166007 Jun 20 07:25:49.236831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 693/1283] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:49 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:49.341075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b057af7-9645-4d5d-8951-d9543987aded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:49.341938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4b057af7-9645-4d5d-8951-d9543987aded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:49.348374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b057af7-9645-4d5d-8951-d9543987aded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:49.348830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b057af7-9645-4d5d-8951-d9543987aded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:49.350255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b057af7-9645-4d5d-8951-d9543987aded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:49.350699 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b057af7-9645-4d5d-8951-d9543987aded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:49.378368 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4b057af7-9645-4d5d-8951-d9543987aded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041274 Jun 20 07:25:49.378934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 591/1284] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:50.255573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9f9af06f-2ec0-423a-ab50-e3d29bd3d6f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:50.256788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9f9af06f-2ec0-423a-ab50-e3d29bd3d6f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:50.263385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f9af06f-2ec0-423a-ab50-e3d29bd3d6f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:50.263827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f9af06f-2ec0-423a-ab50-e3d29bd3d6f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:50.264615 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f9af06f-2ec0-423a-ab50-e3d29bd3d6f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:50.265051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9f9af06f-2ec0-423a-ab50-e3d29bd3d6f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:50.390471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-15683083-76a1-4588-bd6c-ef0178a4e946 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:50.391388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9f9af06f-2ec0-423a-ab50-e3d29bd3d6f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:50.391579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-15683083-76a1-4588-bd6c-ef0178a4e946 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:50.397585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15683083-76a1-4588-bd6c-ef0178a4e946 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:50.398033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15683083-76a1-4588-bd6c-ef0178a4e946 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:50.398790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15683083-76a1-4588-bd6c-ef0178a4e946 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:50.399228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15683083-76a1-4588-bd6c-ef0178a4e946 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:50.399939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9f9af06f-2ec0-423a-ab50-e3d29bd3d6f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:50.401539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9f9af06f-2ec0-423a-ab50-e3d29bd3d6f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:50.402683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9f9af06f-2ec0-423a-ab50-e3d29bd3d6f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151073 Jun 20 07:25:50.403327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 694/1285] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:50 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:50.428087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-15683083-76a1-4588-bd6c-ef0178a4e946 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041295 Jun 20 07:25:50.428656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 592/1286] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:25:51.420944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0bd8ba4b-c0e2-4c03-bae2-df855edbc2b6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:51.421560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0bd8ba4b-c0e2-4c03-bae2-df855edbc2b6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:51.428196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0bd8ba4b-c0e2-4c03-bae2-df855edbc2b6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:51.428648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0bd8ba4b-c0e2-4c03-bae2-df855edbc2b6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:51.429409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0bd8ba4b-c0e2-4c03-bae2-df855edbc2b6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:51.429846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0bd8ba4b-c0e2-4c03-bae2-df855edbc2b6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:51.438587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5ce00371-31a0-41e2-b005-929b47c43381 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:51.439517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5ce00371-31a0-41e2-b005-929b47c43381 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:51.446540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ce00371-31a0-41e2-b005-929b47c43381 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:51.446998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ce00371-31a0-41e2-b005-929b47c43381 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:51.447771 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ce00371-31a0-41e2-b005-929b47c43381 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:51.448241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ce00371-31a0-41e2-b005-929b47c43381 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:51.477873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5ce00371-31a0-41e2-b005-929b47c43381 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043051 Jun 20 07:25:51.478444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 593/1287] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:25:51.557451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0bd8ba4b-c0e2-4c03-bae2-df855edbc2b6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:51.565784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0bd8ba4b-c0e2-4c03-bae2-df855edbc2b6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:51.567267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0bd8ba4b-c0e2-4c03-bae2-df855edbc2b6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:51.568985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0bd8ba4b-c0e2-4c03-bae2-df855edbc2b6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151300 Jun 20 07:25:51.569536 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 695/1288] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:51 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:52.489316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-579558ad-0366-4e8e-b901-434cde87457b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:52.490195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-579558ad-0366-4e8e-b901-434cde87457b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:52.496782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-579558ad-0366-4e8e-b901-434cde87457b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:52.497234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-579558ad-0366-4e8e-b901-434cde87457b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:52.497991 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-579558ad-0366-4e8e-b901-434cde87457b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:52.498425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-579558ad-0366-4e8e-b901-434cde87457b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:52.526725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-579558ad-0366-4e8e-b901-434cde87457b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041422 Jun 20 07:25:52.527258 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 594/1289] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:52.587823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7888ca8a-8a31-41cb-ba7a-0ddf1e815e65 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:52.588485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7888ca8a-8a31-41cb-ba7a-0ddf1e815e65 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:52.596076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7888ca8a-8a31-41cb-ba7a-0ddf1e815e65 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:52.596587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7888ca8a-8a31-41cb-ba7a-0ddf1e815e65 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:52.597364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7888ca8a-8a31-41cb-ba7a-0ddf1e815e65 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:52.597803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7888ca8a-8a31-41cb-ba7a-0ddf1e815e65 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:52.732034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7888ca8a-8a31-41cb-ba7a-0ddf1e815e65 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:52.741073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7888ca8a-8a31-41cb-ba7a-0ddf1e815e65 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:52.742589 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7888ca8a-8a31-41cb-ba7a-0ddf1e815e65 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:52.743839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7888ca8a-8a31-41cb-ba7a-0ddf1e815e65 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.161059 Jun 20 07:25:52.744434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 696/1290] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:52 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:53.537476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ffd2d7e3-f186-4f71-8640-34625fe28f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:53.538394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ffd2d7e3-f186-4f71-8640-34625fe28f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:53.544761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffd2d7e3-f186-4f71-8640-34625fe28f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:53.545212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffd2d7e3-f186-4f71-8640-34625fe28f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:53.545968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffd2d7e3-f186-4f71-8640-34625fe28f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:53.546407 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffd2d7e3-f186-4f71-8640-34625fe28f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:53.574474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ffd2d7e3-f186-4f71-8640-34625fe28f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040942 Jun 20 07:25:53.575012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 595/1291] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:53.762784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d0f3a31b-b0c0-4d32-9ee2-a5fdaf52f9f7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:53.763401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d0f3a31b-b0c0-4d32-9ee2-a5fdaf52f9f7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:53.769885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0f3a31b-b0c0-4d32-9ee2-a5fdaf52f9f7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:53.770335 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0f3a31b-b0c0-4d32-9ee2-a5fdaf52f9f7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:53.771094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0f3a31b-b0c0-4d32-9ee2-a5fdaf52f9f7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:53.772060 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0f3a31b-b0c0-4d32-9ee2-a5fdaf52f9f7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:53.901499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d0f3a31b-b0c0-4d32-9ee2-a5fdaf52f9f7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:53.909779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d0f3a31b-b0c0-4d32-9ee2-a5fdaf52f9f7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:53.911471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d0f3a31b-b0c0-4d32-9ee2-a5fdaf52f9f7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:53.912435 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d0f3a31b-b0c0-4d32-9ee2-a5fdaf52f9f7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153789 Jun 20 07:25:53.912990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 697/1292] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:53 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:54.152940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:25:54.153128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:25:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:25:54.586240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6f7762d5-0cf1-4c84-b256-f773dce35307 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:54.587196 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6f7762d5-0cf1-4c84-b256-f773dce35307 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:54.593608 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f7762d5-0cf1-4c84-b256-f773dce35307 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:54.594055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f7762d5-0cf1-4c84-b256-f773dce35307 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:54.594815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f7762d5-0cf1-4c84-b256-f773dce35307 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:54.595257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f7762d5-0cf1-4c84-b256-f773dce35307 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:54.597687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:25:54.626498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6f7762d5-0cf1-4c84-b256-f773dce35307 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044642 Jun 20 07:25:54.627053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 596/1293] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:54 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:54.930558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0151cfcc-a9b1-469a-bb66-0d5a1393a9d1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:54.931168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0151cfcc-a9b1-469a-bb66-0d5a1393a9d1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:54.937293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0151cfcc-a9b1-469a-bb66-0d5a1393a9d1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:54.937736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0151cfcc-a9b1-469a-bb66-0d5a1393a9d1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:54.938488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0151cfcc-a9b1-469a-bb66-0d5a1393a9d1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:54.938923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0151cfcc-a9b1-469a-bb66-0d5a1393a9d1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:55.067911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0151cfcc-a9b1-469a-bb66-0d5a1393a9d1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:55.076846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0151cfcc-a9b1-469a-bb66-0d5a1393a9d1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:55.078350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0151cfcc-a9b1-469a-bb66-0d5a1393a9d1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:55.079514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0151cfcc-a9b1-469a-bb66-0d5a1393a9d1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152767 Jun 20 07:25:55.080070 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 698/1294] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:54 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:55.638109 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3733b134-be56-4104-951c-3a338c7e0146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:55.639022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3733b134-be56-4104-951c-3a338c7e0146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:55.645460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3733b134-be56-4104-951c-3a338c7e0146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:55.645903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3733b134-be56-4104-951c-3a338c7e0146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:55.646681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3733b134-be56-4104-951c-3a338c7e0146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:55.647117 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3733b134-be56-4104-951c-3a338c7e0146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:55.675035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3733b134-be56-4104-951c-3a338c7e0146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040811 Jun 20 07:25:55.675584 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 597/1295] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:55 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:56.098512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-22e6dc90-4fb8-4969-be2e-be5e7ca51973 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:56.099153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-22e6dc90-4fb8-4969-be2e-be5e7ca51973 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:56.106279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22e6dc90-4fb8-4969-be2e-be5e7ca51973 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:56.106730 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22e6dc90-4fb8-4969-be2e-be5e7ca51973 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:56.107489 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22e6dc90-4fb8-4969-be2e-be5e7ca51973 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:56.107944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22e6dc90-4fb8-4969-be2e-be5e7ca51973 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:56.232561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-22e6dc90-4fb8-4969-be2e-be5e7ca51973 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:56.240890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-22e6dc90-4fb8-4969-be2e-be5e7ca51973 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:56.242388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-22e6dc90-4fb8-4969-be2e-be5e7ca51973 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:56.243544 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-22e6dc90-4fb8-4969-be2e-be5e7ca51973 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.148936 Jun 20 07:25:56.244096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 699/1296] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:56 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:56.686824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ab5b8c4-34ce-4f1a-a53d-046302f91b43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:56.687752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1ab5b8c4-34ce-4f1a-a53d-046302f91b43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:56.694281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ab5b8c4-34ce-4f1a-a53d-046302f91b43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:56.694762 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ab5b8c4-34ce-4f1a-a53d-046302f91b43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:56.695541 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ab5b8c4-34ce-4f1a-a53d-046302f91b43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:56.695985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ab5b8c4-34ce-4f1a-a53d-046302f91b43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:56.724732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1ab5b8c4-34ce-4f1a-a53d-046302f91b43 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041315 Jun 20 07:25:56.725283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 598/1297] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:57.264906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7954c29e-c5e5-4f20-b2b1-a675529a120f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:57.265516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7954c29e-c5e5-4f20-b2b1-a675529a120f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:57.271597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7954c29e-c5e5-4f20-b2b1-a675529a120f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:57.272317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7954c29e-c5e5-4f20-b2b1-a675529a120f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:57.273691 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7954c29e-c5e5-4f20-b2b1-a675529a120f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:57.274267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7954c29e-c5e5-4f20-b2b1-a675529a120f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:57.407552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7954c29e-c5e5-4f20-b2b1-a675529a120f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:57.409778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:25:57.417728 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7954c29e-c5e5-4f20-b2b1-a675529a120f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:57.419206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7954c29e-c5e5-4f20-b2b1-a675529a120f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:57.420379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7954c29e-c5e5-4f20-b2b1-a675529a120f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.159926 Jun 20 07:25:57.420943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 700/1298] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:57 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:57.735950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11752268-63c8-4d7d-8710-46ae09590979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:57.736905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-11752268-63c8-4d7d-8710-46ae09590979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:57.743304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11752268-63c8-4d7d-8710-46ae09590979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:57.743758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11752268-63c8-4d7d-8710-46ae09590979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:57.744572 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11752268-63c8-4d7d-8710-46ae09590979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:57.745010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11752268-63c8-4d7d-8710-46ae09590979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:57.773508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-11752268-63c8-4d7d-8710-46ae09590979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041525 Jun 20 07:25:57.774046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 599/1299] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:57 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:58.438933 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5efad3c3-d79e-415b-bb82-1aaab211cd35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:58.439540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5efad3c3-d79e-415b-bb82-1aaab211cd35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:58.446672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5efad3c3-d79e-415b-bb82-1aaab211cd35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:58.447109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5efad3c3-d79e-415b-bb82-1aaab211cd35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:58.447865 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5efad3c3-d79e-415b-bb82-1aaab211cd35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:58.448339 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5efad3c3-d79e-415b-bb82-1aaab211cd35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:58.573630 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5efad3c3-d79e-415b-bb82-1aaab211cd35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:58.582754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5efad3c3-d79e-415b-bb82-1aaab211cd35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:58.583518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5efad3c3-d79e-415b-bb82-1aaab211cd35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:58.585317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5efad3c3-d79e-415b-bb82-1aaab211cd35 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149949 Jun 20 07:25:58.586408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 701/1300] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:58 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:58.784844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-60c7725b-2e15-4135-be0a-4f0aa36dd0d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:58.785762 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-60c7725b-2e15-4135-be0a-4f0aa36dd0d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:58.792670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60c7725b-2e15-4135-be0a-4f0aa36dd0d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:58.793121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60c7725b-2e15-4135-be0a-4f0aa36dd0d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:58.793881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60c7725b-2e15-4135-be0a-4f0aa36dd0d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:58.794321 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60c7725b-2e15-4135-be0a-4f0aa36dd0d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:58.822568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-60c7725b-2e15-4135-be0a-4f0aa36dd0d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041636 Jun 20 07:25:58.823115 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 600/1301] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:25:59.606437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-37e12872-d950-41d0-b83d-0317fb397810 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:59.607053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-37e12872-d950-41d0-b83d-0317fb397810 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:59.613562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37e12872-d950-41d0-b83d-0317fb397810 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:59.614006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37e12872-d950-41d0-b83d-0317fb397810 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:59.615387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37e12872-d950-41d0-b83d-0317fb397810 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:59.615822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37e12872-d950-41d0-b83d-0317fb397810 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:59.741089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-37e12872-d950-41d0-b83d-0317fb397810 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:59.749435 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-37e12872-d950-41d0-b83d-0317fb397810 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:59.750934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-37e12872-d950-41d0-b83d-0317fb397810 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:25:59.752094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-37e12872-d950-41d0-b83d-0317fb397810 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149617 Jun 20 07:25:59.752672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 702/1302] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:25:59 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:25:59.834524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f48f017-206e-4d8c-9434-b6c145fe8105 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:25:59.835524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8f48f017-206e-4d8c-9434-b6c145fe8105 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:25:59.841908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f48f017-206e-4d8c-9434-b6c145fe8105 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:59.842357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f48f017-206e-4d8c-9434-b6c145fe8105 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:59.843141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f48f017-206e-4d8c-9434-b6c145fe8105 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:25:59.843579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f48f017-206e-4d8c-9434-b6c145fe8105 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:25:59.872546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8f48f017-206e-4d8c-9434-b6c145fe8105 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042531 Jun 20 07:25:59.873028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 601/1303] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:25:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:00.770799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-310cf319-fa17-418b-aebc-6e4f8dee7b0e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:00.771443 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-310cf319-fa17-418b-aebc-6e4f8dee7b0e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:00.777955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-310cf319-fa17-418b-aebc-6e4f8dee7b0e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:00.778401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-310cf319-fa17-418b-aebc-6e4f8dee7b0e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:00.779636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-310cf319-fa17-418b-aebc-6e4f8dee7b0e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:00.779636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-310cf319-fa17-418b-aebc-6e4f8dee7b0e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:00.884733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-97937dc6-c824-4955-a509-b9121a4f5f16 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:00.885660 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-97937dc6-c824-4955-a509-b9121a4f5f16 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:00.891945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97937dc6-c824-4955-a509-b9121a4f5f16 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:00.892428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97937dc6-c824-4955-a509-b9121a4f5f16 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:00.893191 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97937dc6-c824-4955-a509-b9121a4f5f16 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:00.893630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97937dc6-c824-4955-a509-b9121a4f5f16 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:00.909813 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-310cf319-fa17-418b-aebc-6e4f8dee7b0e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:00.918827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-310cf319-fa17-418b-aebc-6e4f8dee7b0e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:00.920369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-310cf319-fa17-418b-aebc-6e4f8dee7b0e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:00.921520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-310cf319-fa17-418b-aebc-6e4f8dee7b0e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154605 Jun 20 07:26:00.922071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 703/1304] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:00 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:00.922218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-97937dc6-c824-4955-a509-b9121a4f5f16 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042217 Jun 20 07:26:00.922684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 602/1305] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:00 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:26:01.933946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-17e2ec9c-9bea-4403-9fdc-11a5e0c2be32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:01.934995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-17e2ec9c-9bea-4403-9fdc-11a5e0c2be32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:01.939687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-592be2e7-65a7-483a-8388-0f68a4de4267 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:01.940361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-592be2e7-65a7-483a-8388-0f68a4de4267 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:01.941558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17e2ec9c-9bea-4403-9fdc-11a5e0c2be32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:01.942001 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17e2ec9c-9bea-4403-9fdc-11a5e0c2be32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:01.942756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17e2ec9c-9bea-4403-9fdc-11a5e0c2be32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:01.943180 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-17e2ec9c-9bea-4403-9fdc-11a5e0c2be32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:01.946792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-592be2e7-65a7-483a-8388-0f68a4de4267 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:01.947239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-592be2e7-65a7-483a-8388-0f68a4de4267 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:01.948002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-592be2e7-65a7-483a-8388-0f68a4de4267 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:01.948462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-592be2e7-65a7-483a-8388-0f68a4de4267 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:01.971239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-17e2ec9c-9bea-4403-9fdc-11a5e0c2be32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041040 Jun 20 07:26:01.971727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 704/1306] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:01 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:02.074419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-592be2e7-65a7-483a-8388-0f68a4de4267 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:02.082687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-592be2e7-65a7-483a-8388-0f68a4de4267 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:02.084207 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-592be2e7-65a7-483a-8388-0f68a4de4267 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:02.085854 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-592be2e7-65a7-483a-8388-0f68a4de4267 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150000 Jun 20 07:26:02.086405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 603/1307] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:01 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:26:02.982570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-46ad047c-d249-4dc8-bbb1-fb5d1a983665 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:02.983449 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-46ad047c-d249-4dc8-bbb1-fb5d1a983665 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:02.989906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46ad047c-d249-4dc8-bbb1-fb5d1a983665 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:02.990349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46ad047c-d249-4dc8-bbb1-fb5d1a983665 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:02.991641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46ad047c-d249-4dc8-bbb1-fb5d1a983665 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:02.992071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46ad047c-d249-4dc8-bbb1-fb5d1a983665 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:03.020428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-46ad047c-d249-4dc8-bbb1-fb5d1a983665 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041766 Jun 20 07:26:03.020972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 705/1308] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:03.104117 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2c2952ce-c58e-41b8-8b48-14c13fdeb864 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:03.104742 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2c2952ce-c58e-41b8-8b48-14c13fdeb864 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:03.111212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c2952ce-c58e-41b8-8b48-14c13fdeb864 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:03.111656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c2952ce-c58e-41b8-8b48-14c13fdeb864 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:03.112443 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c2952ce-c58e-41b8-8b48-14c13fdeb864 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:03.112873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c2952ce-c58e-41b8-8b48-14c13fdeb864 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:03.241253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2c2952ce-c58e-41b8-8b48-14c13fdeb864 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:03.249423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2c2952ce-c58e-41b8-8b48-14c13fdeb864 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:03.250940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2c2952ce-c58e-41b8-8b48-14c13fdeb864 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:03.252068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2c2952ce-c58e-41b8-8b48-14c13fdeb864 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151866 Jun 20 07:26:03.252649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 604/1309] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:03 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:04.032362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-756668c6-66bb-4b64-9599-3433755bd65e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:04.033281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-756668c6-66bb-4b64-9599-3433755bd65e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:04.040433 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-756668c6-66bb-4b64-9599-3433755bd65e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:04.040876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-756668c6-66bb-4b64-9599-3433755bd65e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:04.041623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-756668c6-66bb-4b64-9599-3433755bd65e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:04.042051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-756668c6-66bb-4b64-9599-3433755bd65e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:04.070250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-756668c6-66bb-4b64-9599-3433755bd65e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042271 Jun 20 07:26:04.070787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 706/1310] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:04 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:04.270692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-749d8fa2-3a1a-48ba-a39a-c01fc6fe0a23 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:04.271310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-749d8fa2-3a1a-48ba-a39a-c01fc6fe0a23 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:04.278429 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-749d8fa2-3a1a-48ba-a39a-c01fc6fe0a23 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:04.278871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-749d8fa2-3a1a-48ba-a39a-c01fc6fe0a23 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:04.279640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-749d8fa2-3a1a-48ba-a39a-c01fc6fe0a23 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:04.280070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-749d8fa2-3a1a-48ba-a39a-c01fc6fe0a23 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:04.408526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-749d8fa2-3a1a-48ba-a39a-c01fc6fe0a23 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:04.419008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-749d8fa2-3a1a-48ba-a39a-c01fc6fe0a23 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:04.420553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-749d8fa2-3a1a-48ba-a39a-c01fc6fe0a23 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:04.421714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-749d8fa2-3a1a-48ba-a39a-c01fc6fe0a23 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154991 Jun 20 07:26:04.422266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 605/1311] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:04 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:05.080946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-caeb6a6a-301b-4d7b-b6b3-9030c16e4430 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:05.081927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-caeb6a6a-301b-4d7b-b6b3-9030c16e4430 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:05.088863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caeb6a6a-301b-4d7b-b6b3-9030c16e4430 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:05.089313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caeb6a6a-301b-4d7b-b6b3-9030c16e4430 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:05.090072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caeb6a6a-301b-4d7b-b6b3-9030c16e4430 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:05.090506 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caeb6a6a-301b-4d7b-b6b3-9030c16e4430 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:05.118835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-caeb6a6a-301b-4d7b-b6b3-9030c16e4430 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041804 Jun 20 07:26:05.119372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 707/1312] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:05 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:05.440729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c5d3cc1e-a52a-43ac-bf21-80878c2a9dcf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:05.441337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c5d3cc1e-a52a-43ac-bf21-80878c2a9dcf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:05.448264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5d3cc1e-a52a-43ac-bf21-80878c2a9dcf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:05.448690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5d3cc1e-a52a-43ac-bf21-80878c2a9dcf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:05.449447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5d3cc1e-a52a-43ac-bf21-80878c2a9dcf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:05.449879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5d3cc1e-a52a-43ac-bf21-80878c2a9dcf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:05.575114 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5d3cc1e-a52a-43ac-bf21-80878c2a9dcf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:05.583364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5d3cc1e-a52a-43ac-bf21-80878c2a9dcf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:05.585580 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5d3cc1e-a52a-43ac-bf21-80878c2a9dcf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:05.586738 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c5d3cc1e-a52a-43ac-bf21-80878c2a9dcf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149837 Jun 20 07:26:05.587292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 606/1313] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:05 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:06.130303 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-de12b5e6-1ad5-4b6e-aaa4-c00fa580fc2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:06.131226 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-de12b5e6-1ad5-4b6e-aaa4-c00fa580fc2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:06.138058 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de12b5e6-1ad5-4b6e-aaa4-c00fa580fc2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:06.138512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de12b5e6-1ad5-4b6e-aaa4-c00fa580fc2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:06.139285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de12b5e6-1ad5-4b6e-aaa4-c00fa580fc2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:06.139727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de12b5e6-1ad5-4b6e-aaa4-c00fa580fc2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:06.168770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-de12b5e6-1ad5-4b6e-aaa4-c00fa580fc2b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042388 Jun 20 07:26:06.169318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 708/1314] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:06 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:06.604363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8d64fa69-dff7-4d99-8bcd-9b9dd19d2554 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:06.604985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8d64fa69-dff7-4d99-8bcd-9b9dd19d2554 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:06.611415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d64fa69-dff7-4d99-8bcd-9b9dd19d2554 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:06.611871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d64fa69-dff7-4d99-8bcd-9b9dd19d2554 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:06.612668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d64fa69-dff7-4d99-8bcd-9b9dd19d2554 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:06.613110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d64fa69-dff7-4d99-8bcd-9b9dd19d2554 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:06.744374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d64fa69-dff7-4d99-8bcd-9b9dd19d2554 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:06.752735 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d64fa69-dff7-4d99-8bcd-9b9dd19d2554 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:06.754238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d64fa69-dff7-4d99-8bcd-9b9dd19d2554 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:06.755387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8d64fa69-dff7-4d99-8bcd-9b9dd19d2554 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154900 Jun 20 07:26:06.755951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 607/1315] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:06 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:07.180721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a95badc4-fe4c-4c22-8d7d-fed62ff28100 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:07.181668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a95badc4-fe4c-4c22-8d7d-fed62ff28100 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:07.187970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a95badc4-fe4c-4c22-8d7d-fed62ff28100 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:07.188441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a95badc4-fe4c-4c22-8d7d-fed62ff28100 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:07.189191 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a95badc4-fe4c-4c22-8d7d-fed62ff28100 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:07.189619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a95badc4-fe4c-4c22-8d7d-fed62ff28100 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:07.218489 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a95badc4-fe4c-4c22-8d7d-fed62ff28100 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 Jun 20 07:26:07.219024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 709/1316] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:07 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:07.774460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c5919a21-a24f-467d-84b2-ce65b7cf0117 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:07.775075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c5919a21-a24f-467d-84b2-ce65b7cf0117 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:07.781776 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5919a21-a24f-467d-84b2-ce65b7cf0117 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:07.782222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5919a21-a24f-467d-84b2-ce65b7cf0117 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:07.782975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5919a21-a24f-467d-84b2-ce65b7cf0117 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:07.783412 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5919a21-a24f-467d-84b2-ce65b7cf0117 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:07.910087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5919a21-a24f-467d-84b2-ce65b7cf0117 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:07.918926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5919a21-a24f-467d-84b2-ce65b7cf0117 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:07.920466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5919a21-a24f-467d-84b2-ce65b7cf0117 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:07.921641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c5919a21-a24f-467d-84b2-ce65b7cf0117 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151093 Jun 20 07:26:07.922195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 608/1317] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:07 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:08.230364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-85abb7cb-b731-486a-8db4-2049ab1a2dca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:08.231277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-85abb7cb-b731-486a-8db4-2049ab1a2dca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:08.237663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85abb7cb-b731-486a-8db4-2049ab1a2dca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:08.238106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85abb7cb-b731-486a-8db4-2049ab1a2dca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:08.238851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85abb7cb-b731-486a-8db4-2049ab1a2dca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:08.239280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85abb7cb-b731-486a-8db4-2049ab1a2dca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:08.267044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-85abb7cb-b731-486a-8db4-2049ab1a2dca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040591 Jun 20 07:26:08.267585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 710/1318] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:08 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:08.940648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2eb60424-da25-4864-a663-093fc77b4f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:08.941197 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2eb60424-da25-4864-a663-093fc77b4f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:08.947753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eb60424-da25-4864-a663-093fc77b4f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:08.948249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eb60424-da25-4864-a663-093fc77b4f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:08.949018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eb60424-da25-4864-a663-093fc77b4f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:08.949460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eb60424-da25-4864-a663-093fc77b4f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:09.078167 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2eb60424-da25-4864-a663-093fc77b4f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:09.086984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2eb60424-da25-4864-a663-093fc77b4f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:09.088504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2eb60424-da25-4864-a663-093fc77b4f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:09.089665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2eb60424-da25-4864-a663-093fc77b4f77 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152996 Jun 20 07:26:09.090225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 609/1319] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:08 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:09.280772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-de039eea-debc-4a7b-bb06-f8eb909b7607 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:09.281683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-de039eea-debc-4a7b-bb06-f8eb909b7607 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:09.288293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de039eea-debc-4a7b-bb06-f8eb909b7607 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:09.288614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de039eea-debc-4a7b-bb06-f8eb909b7607 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:09.289370 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de039eea-debc-4a7b-bb06-f8eb909b7607 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:09.289798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de039eea-debc-4a7b-bb06-f8eb909b7607 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:09.317384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-de039eea-debc-4a7b-bb06-f8eb909b7607 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040696 Jun 20 07:26:09.317923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 711/1320] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:09 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:10.108774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0b5469cb-3b97-43bc-a2b6-ac32fe031b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:10.109312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0b5469cb-3b97-43bc-a2b6-ac32fe031b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:10.111656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:26:10.117633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b5469cb-3b97-43bc-a2b6-ac32fe031b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:10.118075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b5469cb-3b97-43bc-a2b6-ac32fe031b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:10.118823 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b5469cb-3b97-43bc-a2b6-ac32fe031b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:10.119255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b5469cb-3b97-43bc-a2b6-ac32fe031b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:10.246372 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0b5469cb-3b97-43bc-a2b6-ac32fe031b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:10.254789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0b5469cb-3b97-43bc-a2b6-ac32fe031b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:10.256346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0b5469cb-3b97-43bc-a2b6-ac32fe031b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:10.257485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0b5469cb-3b97-43bc-a2b6-ac32fe031b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152666 Jun 20 07:26:10.258033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 610/1321] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:10 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:10.329386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e6593e2-68e2-4c49-8194-ceeb50c289cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:10.330306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e6593e2-68e2-4c49-8194-ceeb50c289cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:10.337622 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e6593e2-68e2-4c49-8194-ceeb50c289cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:10.338065 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e6593e2-68e2-4c49-8194-ceeb50c289cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:10.338880 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e6593e2-68e2-4c49-8194-ceeb50c289cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:10.339312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e6593e2-68e2-4c49-8194-ceeb50c289cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:10.367686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e6593e2-68e2-4c49-8194-ceeb50c289cf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042186 Jun 20 07:26:10.368198 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 712/1322] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:10 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:11.277736 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cd54e36d-a669-4bf1-a681-57f373a05319 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:11.278783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cd54e36d-a669-4bf1-a681-57f373a05319 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:11.286232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd54e36d-a669-4bf1-a681-57f373a05319 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:11.286687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd54e36d-a669-4bf1-a681-57f373a05319 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:11.287470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd54e36d-a669-4bf1-a681-57f373a05319 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:11.288047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd54e36d-a669-4bf1-a681-57f373a05319 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:11.378791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-be069d38-7426-49de-80ce-f0cf85591af2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:11.379749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-be069d38-7426-49de-80ce-f0cf85591af2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:11.382734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=52 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:26:11.388530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be069d38-7426-49de-80ce-f0cf85591af2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:11.388986 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be069d38-7426-49de-80ce-f0cf85591af2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:11.389758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be069d38-7426-49de-80ce-f0cf85591af2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:11.390196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be069d38-7426-49de-80ce-f0cf85591af2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:11.418235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cd54e36d-a669-4bf1-a681-57f373a05319 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:11.420150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-be069d38-7426-49de-80ce-f0cf85591af2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045170 Jun 20 07:26:11.420865 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 713/1323] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:11 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:26:11.426610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cd54e36d-a669-4bf1-a681-57f373a05319 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:11.428779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cd54e36d-a669-4bf1-a681-57f373a05319 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:11.429943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cd54e36d-a669-4bf1-a681-57f373a05319 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157967 Jun 20 07:26:11.430495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 611/1324] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:11 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:12.433288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-02c757a1-ab95-4888-9b46-1a1616c5be27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:12.434211 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-02c757a1-ab95-4888-9b46-1a1616c5be27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:12.440767 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02c757a1-ab95-4888-9b46-1a1616c5be27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:12.441215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02c757a1-ab95-4888-9b46-1a1616c5be27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:12.441972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02c757a1-ab95-4888-9b46-1a1616c5be27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:12.442406 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02c757a1-ab95-4888-9b46-1a1616c5be27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:12.448069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7ed96c14-530e-4470-b884-240e0bdecae8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:12.448711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7ed96c14-530e-4470-b884-240e0bdecae8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:12.455106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ed96c14-530e-4470-b884-240e0bdecae8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:12.455547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ed96c14-530e-4470-b884-240e0bdecae8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:12.456327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ed96c14-530e-4470-b884-240e0bdecae8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:12.456757 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ed96c14-530e-4470-b884-240e0bdecae8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:12.470770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-02c757a1-ab95-4888-9b46-1a1616c5be27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041389 Jun 20 07:26:12.471266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 714/1325] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:12 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:12.582070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7ed96c14-530e-4470-b884-240e0bdecae8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:12.585050 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:26:12.594226 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7ed96c14-530e-4470-b884-240e0bdecae8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:12.595726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7ed96c14-530e-4470-b884-240e0bdecae8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:12.596909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7ed96c14-530e-4470-b884-240e0bdecae8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152703 Jun 20 07:26:12.597462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 612/1326] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:12 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:26:13.482179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7ca366b3-0251-4f85-80f2-fc4d4fbaef33 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:13.483105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7ca366b3-0251-4f85-80f2-fc4d4fbaef33 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:13.489557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ca366b3-0251-4f85-80f2-fc4d4fbaef33 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:13.490019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ca366b3-0251-4f85-80f2-fc4d4fbaef33 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:13.490774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ca366b3-0251-4f85-80f2-fc4d4fbaef33 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:13.491211 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ca366b3-0251-4f85-80f2-fc4d4fbaef33 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:13.519051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7ca366b3-0251-4f85-80f2-fc4d4fbaef33 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040817 Jun 20 07:26:13.519594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 715/1327] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:13 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:13.615731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab2c11e9-574c-42c9-8cd8-c4a9db33c969 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:13.616309 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab2c11e9-574c-42c9-8cd8-c4a9db33c969 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:13.622781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab2c11e9-574c-42c9-8cd8-c4a9db33c969 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:13.623236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab2c11e9-574c-42c9-8cd8-c4a9db33c969 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:13.624000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab2c11e9-574c-42c9-8cd8-c4a9db33c969 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:13.624474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab2c11e9-574c-42c9-8cd8-c4a9db33c969 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:13.755232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab2c11e9-574c-42c9-8cd8-c4a9db33c969 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:13.764323 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab2c11e9-574c-42c9-8cd8-c4a9db33c969 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:13.765812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab2c11e9-574c-42c9-8cd8-c4a9db33c969 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:13.766963 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab2c11e9-574c-42c9-8cd8-c4a9db33c969 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155483 Jun 20 07:26:13.767514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 613/1328] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:13 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:14.530877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c0267d76-ee09-4a71-afff-cb1849c57987 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:14.531788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c0267d76-ee09-4a71-afff-cb1849c57987 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:14.538231 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0267d76-ee09-4a71-afff-cb1849c57987 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:14.538674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0267d76-ee09-4a71-afff-cb1849c57987 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:14.539421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0267d76-ee09-4a71-afff-cb1849c57987 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:14.539850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c0267d76-ee09-4a71-afff-cb1849c57987 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:14.567245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c0267d76-ee09-4a71-afff-cb1849c57987 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040285 Jun 20 07:26:14.567782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 716/1329] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:14 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:14.786976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8ee7df90-833b-4595-8701-eb9d9991905e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:14.787530 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8ee7df90-833b-4595-8701-eb9d9991905e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:14.794065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ee7df90-833b-4595-8701-eb9d9991905e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:14.794518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ee7df90-833b-4595-8701-eb9d9991905e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:14.795281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ee7df90-833b-4595-8701-eb9d9991905e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:14.795721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ee7df90-833b-4595-8701-eb9d9991905e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:14.929230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8ee7df90-833b-4595-8701-eb9d9991905e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:14.937643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8ee7df90-833b-4595-8701-eb9d9991905e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:14.939220 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8ee7df90-833b-4595-8701-eb9d9991905e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:14.940421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8ee7df90-833b-4595-8701-eb9d9991905e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.158336 Jun 20 07:26:14.945108 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 614/1330] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:14 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:15.579082 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d787d636-c9eb-43a5-9345-0d1a804fa553 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:15.580007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d787d636-c9eb-43a5-9345-0d1a804fa553 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:15.586980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d787d636-c9eb-43a5-9345-0d1a804fa553 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:15.587432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d787d636-c9eb-43a5-9345-0d1a804fa553 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:15.588232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d787d636-c9eb-43a5-9345-0d1a804fa553 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:15.588668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d787d636-c9eb-43a5-9345-0d1a804fa553 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:15.604862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:26:15.620956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d787d636-c9eb-43a5-9345-0d1a804fa553 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045808 Jun 20 07:26:15.621512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 717/1331] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:15 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:15.963999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2810c930-c8e7-48ce-8b02-7f10c2f87afc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:15.964578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2810c930-c8e7-48ce-8b02-7f10c2f87afc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:15.970911 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2810c930-c8e7-48ce-8b02-7f10c2f87afc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:15.971357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2810c930-c8e7-48ce-8b02-7f10c2f87afc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:15.972127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2810c930-c8e7-48ce-8b02-7f10c2f87afc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:15.972569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2810c930-c8e7-48ce-8b02-7f10c2f87afc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:16.097703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2810c930-c8e7-48ce-8b02-7f10c2f87afc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:16.105994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2810c930-c8e7-48ce-8b02-7f10c2f87afc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:16.107481 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2810c930-c8e7-48ce-8b02-7f10c2f87afc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:16.108657 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2810c930-c8e7-48ce-8b02-7f10c2f87afc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.148529 Jun 20 07:26:16.109202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 615/1332] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:15 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:16.633587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e37f4b1e-a5d8-498d-8fd0-3673e16c954c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:16.634513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e37f4b1e-a5d8-498d-8fd0-3673e16c954c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:16.641083 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e37f4b1e-a5d8-498d-8fd0-3673e16c954c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:16.641538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e37f4b1e-a5d8-498d-8fd0-3673e16c954c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:16.642309 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e37f4b1e-a5d8-498d-8fd0-3673e16c954c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:16.642744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e37f4b1e-a5d8-498d-8fd0-3673e16c954c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:16.672844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e37f4b1e-a5d8-498d-8fd0-3673e16c954c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044060 Jun 20 07:26:16.673433 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 718/1333] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:16 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:17.126977 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad35ad03-0a4c-4fe9-9a43-be5ce20487ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:17.127628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ad35ad03-0a4c-4fe9-9a43-be5ce20487ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:17.134547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad35ad03-0a4c-4fe9-9a43-be5ce20487ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:17.134992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad35ad03-0a4c-4fe9-9a43-be5ce20487ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:17.135755 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad35ad03-0a4c-4fe9-9a43-be5ce20487ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:17.136231 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad35ad03-0a4c-4fe9-9a43-be5ce20487ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:17.268173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad35ad03-0a4c-4fe9-9a43-be5ce20487ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:17.276968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad35ad03-0a4c-4fe9-9a43-be5ce20487ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:17.278506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad35ad03-0a4c-4fe9-9a43-be5ce20487ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:17.279609 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ad35ad03-0a4c-4fe9-9a43-be5ce20487ca tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.156554 Jun 20 07:26:17.280264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 616/1334] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:17 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:17.684354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3002d99c-3898-4dd5-b44e-9d6a197ec9b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:17.685321 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3002d99c-3898-4dd5-b44e-9d6a197ec9b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:17.691758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3002d99c-3898-4dd5-b44e-9d6a197ec9b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:17.692247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3002d99c-3898-4dd5-b44e-9d6a197ec9b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:17.693014 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3002d99c-3898-4dd5-b44e-9d6a197ec9b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:17.694037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3002d99c-3898-4dd5-b44e-9d6a197ec9b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:17.723342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3002d99c-3898-4dd5-b44e-9d6a197ec9b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043000 Jun 20 07:26:17.723896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 719/1335] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:17 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:18.299655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a64f631a-1554-4885-a73f-9879270fdc67 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:18.300305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a64f631a-1554-4885-a73f-9879270fdc67 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:18.306722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a64f631a-1554-4885-a73f-9879270fdc67 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:18.307173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a64f631a-1554-4885-a73f-9879270fdc67 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:18.307928 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a64f631a-1554-4885-a73f-9879270fdc67 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:18.308396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a64f631a-1554-4885-a73f-9879270fdc67 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:18.434216 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a64f631a-1554-4885-a73f-9879270fdc67 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:18.442523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a64f631a-1554-4885-a73f-9879270fdc67 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:18.444555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a64f631a-1554-4885-a73f-9879270fdc67 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:18.445701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a64f631a-1554-4885-a73f-9879270fdc67 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149882 Jun 20 07:26:18.446257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 617/1336] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:18 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:18.734836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a16fb65a-e484-4f73-9842-bdf6f6ad6e70 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:18.735747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a16fb65a-e484-4f73-9842-bdf6f6ad6e70 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:18.742737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a16fb65a-e484-4f73-9842-bdf6f6ad6e70 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:18.743180 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a16fb65a-e484-4f73-9842-bdf6f6ad6e70 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:18.743935 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a16fb65a-e484-4f73-9842-bdf6f6ad6e70 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:18.744420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a16fb65a-e484-4f73-9842-bdf6f6ad6e70 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:18.773886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a16fb65a-e484-4f73-9842-bdf6f6ad6e70 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042973 Jun 20 07:26:18.774442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 720/1337] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:18 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:19.464703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-87c6925c-c9c5-43f1-9bc0-fd970dd4b1a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:19.465326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-87c6925c-c9c5-43f1-9bc0-fd970dd4b1a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:19.471497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87c6925c-c9c5-43f1-9bc0-fd970dd4b1a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:19.471949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87c6925c-c9c5-43f1-9bc0-fd970dd4b1a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:19.472747 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87c6925c-c9c5-43f1-9bc0-fd970dd4b1a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:19.473211 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87c6925c-c9c5-43f1-9bc0-fd970dd4b1a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:19.601920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87c6925c-c9c5-43f1-9bc0-fd970dd4b1a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:19.610271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87c6925c-c9c5-43f1-9bc0-fd970dd4b1a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:19.611758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87c6925c-c9c5-43f1-9bc0-fd970dd4b1a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:19.612946 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-87c6925c-c9c5-43f1-9bc0-fd970dd4b1a0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152294 Jun 20 07:26:19.613499 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 618/1338] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:19 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:19.785505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6cd2f2ca-79c2-409f-882f-fd5998536530 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:19.786444 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6cd2f2ca-79c2-409f-882f-fd5998536530 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:19.792889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6cd2f2ca-79c2-409f-882f-fd5998536530 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:19.793334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6cd2f2ca-79c2-409f-882f-fd5998536530 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:19.794082 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6cd2f2ca-79c2-409f-882f-fd5998536530 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:19.794514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6cd2f2ca-79c2-409f-882f-fd5998536530 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:19.822533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6cd2f2ca-79c2-409f-882f-fd5998536530 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041013 Jun 20 07:26:19.823065 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 721/1339] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:19 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:20.630697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5585c641-df43-4cd7-b3f1-bf85082a270b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:20.631319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5585c641-df43-4cd7-b3f1-bf85082a270b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:20.638209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5585c641-df43-4cd7-b3f1-bf85082a270b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:20.638611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5585c641-df43-4cd7-b3f1-bf85082a270b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:20.639375 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5585c641-df43-4cd7-b3f1-bf85082a270b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:20.639812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5585c641-df43-4cd7-b3f1-bf85082a270b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:20.770325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5585c641-df43-4cd7-b3f1-bf85082a270b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:20.779342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5585c641-df43-4cd7-b3f1-bf85082a270b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:20.780895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5585c641-df43-4cd7-b3f1-bf85082a270b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:20.782075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5585c641-df43-4cd7-b3f1-bf85082a270b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155295 Jun 20 07:26:20.782624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 619/1340] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:20 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:20.833893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ca5d8d5b-eff7-4df1-8b4d-038cf5689a95 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:20.834808 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ca5d8d5b-eff7-4df1-8b4d-038cf5689a95 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:20.842496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca5d8d5b-eff7-4df1-8b4d-038cf5689a95 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:20.842946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca5d8d5b-eff7-4df1-8b4d-038cf5689a95 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:20.843703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca5d8d5b-eff7-4df1-8b4d-038cf5689a95 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:20.844163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca5d8d5b-eff7-4df1-8b4d-038cf5689a95 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:20.872549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ca5d8d5b-eff7-4df1-8b4d-038cf5689a95 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042599 Jun 20 07:26:20.873091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 722/1341] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:20 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:21.800457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-40cb87f2-3f5d-4f48-b698-8b7f954336ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:21.801188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-40cb87f2-3f5d-4f48-b698-8b7f954336ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:21.807609 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40cb87f2-3f5d-4f48-b698-8b7f954336ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:21.808060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40cb87f2-3f5d-4f48-b698-8b7f954336ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:21.808858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40cb87f2-3f5d-4f48-b698-8b7f954336ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:21.809328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40cb87f2-3f5d-4f48-b698-8b7f954336ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:21.884673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f50e3595-5383-4c80-96b4-6cd36653e369 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:21.885598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f50e3595-5383-4c80-96b4-6cd36653e369 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:21.892087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f50e3595-5383-4c80-96b4-6cd36653e369 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:21.892569 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f50e3595-5383-4c80-96b4-6cd36653e369 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:21.893329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f50e3595-5383-4c80-96b4-6cd36653e369 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:21.893761 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f50e3595-5383-4c80-96b4-6cd36653e369 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:21.923796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f50e3595-5383-4c80-96b4-6cd36653e369 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043592 Jun 20 07:26:21.924401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 723/1342] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:21 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:26:21.935964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-40cb87f2-3f5d-4f48-b698-8b7f954336ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:21.944859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-40cb87f2-3f5d-4f48-b698-8b7f954336ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:21.946365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-40cb87f2-3f5d-4f48-b698-8b7f954336ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:21.947521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-40cb87f2-3f5d-4f48-b698-8b7f954336ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151068 Jun 20 07:26:21.948068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 620/1343] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:21 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:22.935172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b82de005-feaa-46fc-8901-298ec34061d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:22.936088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b82de005-feaa-46fc-8901-298ec34061d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:22.942637 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b82de005-feaa-46fc-8901-298ec34061d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:22.943080 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b82de005-feaa-46fc-8901-298ec34061d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:22.943829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b82de005-feaa-46fc-8901-298ec34061d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:22.944298 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b82de005-feaa-46fc-8901-298ec34061d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:22.966603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2290b699-168f-4287-b3ed-c7804621872c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:22.967278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2290b699-168f-4287-b3ed-c7804621872c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:22.972518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b82de005-feaa-46fc-8901-298ec34061d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041215 Jun 20 07:26:22.973077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 724/1344] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:22 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:22.973679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2290b699-168f-4287-b3ed-c7804621872c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:22.974737 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2290b699-168f-4287-b3ed-c7804621872c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:22.975507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2290b699-168f-4287-b3ed-c7804621872c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:22.975950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2290b699-168f-4287-b3ed-c7804621872c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:23.123217 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2290b699-168f-4287-b3ed-c7804621872c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:23.131569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2290b699-168f-4287-b3ed-c7804621872c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:23.133346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2290b699-168f-4287-b3ed-c7804621872c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:23.134559 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2290b699-168f-4287-b3ed-c7804621872c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.171851 Jun 20 07:26:23.135116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 621/1345] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:26:23.984757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-82027284-cc19-4549-a6df-0642b90f1414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:23.985612 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-82027284-cc19-4549-a6df-0642b90f1414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:23.992166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82027284-cc19-4549-a6df-0642b90f1414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:23.992619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82027284-cc19-4549-a6df-0642b90f1414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:23.993387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82027284-cc19-4549-a6df-0642b90f1414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:23.993828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82027284-cc19-4549-a6df-0642b90f1414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:24.022446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-82027284-cc19-4549-a6df-0642b90f1414 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 Jun 20 07:26:24.022986 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 725/1346] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:23 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:24.152903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a60de5f3-0ce9-4dad-adc5-27130c7c5295 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:24.153515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a60de5f3-0ce9-4dad-adc5-27130c7c5295 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:24.160068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a60de5f3-0ce9-4dad-adc5-27130c7c5295 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:24.160563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a60de5f3-0ce9-4dad-adc5-27130c7c5295 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:24.161300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a60de5f3-0ce9-4dad-adc5-27130c7c5295 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:24.162343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a60de5f3-0ce9-4dad-adc5-27130c7c5295 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:24.287007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a60de5f3-0ce9-4dad-adc5-27130c7c5295 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:24.295263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a60de5f3-0ce9-4dad-adc5-27130c7c5295 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:24.296779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a60de5f3-0ce9-4dad-adc5-27130c7c5295 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:24.297929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a60de5f3-0ce9-4dad-adc5-27130c7c5295 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.148884 Jun 20 07:26:24.298484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 622/1347] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:24 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:25.033168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0a601fe0-3613-4682-8bb6-bbc377fa55ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:25.034147 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0a601fe0-3613-4682-8bb6-bbc377fa55ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:25.040630 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a601fe0-3613-4682-8bb6-bbc377fa55ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:25.041081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a601fe0-3613-4682-8bb6-bbc377fa55ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:25.041849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a601fe0-3613-4682-8bb6-bbc377fa55ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:25.042288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a601fe0-3613-4682-8bb6-bbc377fa55ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:25.070591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0a601fe0-3613-4682-8bb6-bbc377fa55ff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041390 Jun 20 07:26:25.071132 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 726/1348] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:25 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:25.316343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6004f98-88e4-4961-856c-78a058937b8f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:25.316983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e6004f98-88e4-4961-856c-78a058937b8f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:25.325690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6004f98-88e4-4961-856c-78a058937b8f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:25.326141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6004f98-88e4-4961-856c-78a058937b8f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:25.326939 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6004f98-88e4-4961-856c-78a058937b8f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:25.327377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6004f98-88e4-4961-856c-78a058937b8f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:25.458532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6004f98-88e4-4961-856c-78a058937b8f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:25.468141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6004f98-88e4-4961-856c-78a058937b8f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:25.469646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6004f98-88e4-4961-856c-78a058937b8f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:25.470811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e6004f98-88e4-4961-856c-78a058937b8f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.158450 Jun 20 07:26:25.471366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 623/1349] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:25 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:26.081503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-27f77f80-b400-483d-b5d7-af222974793e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:26.082425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-27f77f80-b400-483d-b5d7-af222974793e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:26.089326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27f77f80-b400-483d-b5d7-af222974793e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:26.089771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27f77f80-b400-483d-b5d7-af222974793e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:26.090519 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27f77f80-b400-483d-b5d7-af222974793e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:26.090955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27f77f80-b400-483d-b5d7-af222974793e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:26.119253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-27f77f80-b400-483d-b5d7-af222974793e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041723 Jun 20 07:26:26.119790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 727/1350] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:26 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:26.489146 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9120e255-d430-42d2-ae77-6852b69b4231 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:26.490308 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9120e255-d430-42d2-ae77-6852b69b4231 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:26.496897 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9120e255-d430-42d2-ae77-6852b69b4231 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:26.497591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9120e255-d430-42d2-ae77-6852b69b4231 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:26.498584 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9120e255-d430-42d2-ae77-6852b69b4231 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:26.499017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9120e255-d430-42d2-ae77-6852b69b4231 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:26.623858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9120e255-d430-42d2-ae77-6852b69b4231 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:26.632562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9120e255-d430-42d2-ae77-6852b69b4231 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:26.634313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9120e255-d430-42d2-ae77-6852b69b4231 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:26.635459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9120e255-d430-42d2-ae77-6852b69b4231 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150299 Jun 20 07:26:26.636005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 624/1351] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:26 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:27.130657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-60b62abc-50ae-4b4b-9641-51013fd5b4c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:27.131518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-60b62abc-50ae-4b4b-9641-51013fd5b4c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:27.138215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60b62abc-50ae-4b4b-9641-51013fd5b4c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:27.138674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60b62abc-50ae-4b4b-9641-51013fd5b4c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:27.139438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60b62abc-50ae-4b4b-9641-51013fd5b4c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:27.139871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60b62abc-50ae-4b4b-9641-51013fd5b4c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:27.168601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-60b62abc-50ae-4b4b-9641-51013fd5b4c6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041908 Jun 20 07:26:27.169146 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 728/1352] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:27 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:27.654271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2550feaf-456f-4522-ac15-ffa9dac9e996 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:27.654921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2550feaf-456f-4522-ac15-ffa9dac9e996 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:27.661490 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2550feaf-456f-4522-ac15-ffa9dac9e996 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:27.661943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2550feaf-456f-4522-ac15-ffa9dac9e996 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:27.662733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2550feaf-456f-4522-ac15-ffa9dac9e996 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:27.663174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2550feaf-456f-4522-ac15-ffa9dac9e996 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:27.799102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2550feaf-456f-4522-ac15-ffa9dac9e996 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:27.808235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2550feaf-456f-4522-ac15-ffa9dac9e996 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:27.809736 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2550feaf-456f-4522-ac15-ffa9dac9e996 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:27.810897 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2550feaf-456f-4522-ac15-ffa9dac9e996 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.160498 Jun 20 07:26:27.811463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 625/1353] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:27 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:28.180669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-734155b9-1cc8-4355-a4c8-d0f2b6c54ba0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:28.181587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-734155b9-1cc8-4355-a4c8-d0f2b6c54ba0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:28.187955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-734155b9-1cc8-4355-a4c8-d0f2b6c54ba0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:28.188432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-734155b9-1cc8-4355-a4c8-d0f2b6c54ba0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:28.189187 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-734155b9-1cc8-4355-a4c8-d0f2b6c54ba0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:28.189617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-734155b9-1cc8-4355-a4c8-d0f2b6c54ba0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:28.216908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-734155b9-1cc8-4355-a4c8-d0f2b6c54ba0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040895 Jun 20 07:26:28.217443 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 729/1354] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:28 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:28.829622 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b44c4981-a71a-4634-93be-111954bf21bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:28.830267 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b44c4981-a71a-4634-93be-111954bf21bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:28.837269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b44c4981-a71a-4634-93be-111954bf21bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:28.837744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b44c4981-a71a-4634-93be-111954bf21bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:28.838506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b44c4981-a71a-4634-93be-111954bf21bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:28.838941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b44c4981-a71a-4634-93be-111954bf21bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:28.969164 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b44c4981-a71a-4634-93be-111954bf21bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:28.977484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b44c4981-a71a-4634-93be-111954bf21bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:28.979000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b44c4981-a71a-4634-93be-111954bf21bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:28.980187 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b44c4981-a71a-4634-93be-111954bf21bc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154534 Jun 20 07:26:28.980753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 626/1355] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:28 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:29.228557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b45c3f52-2371-4459-b162-b5e432e04abb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:29.229472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b45c3f52-2371-4459-b162-b5e432e04abb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:29.235867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b45c3f52-2371-4459-b162-b5e432e04abb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:29.236342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b45c3f52-2371-4459-b162-b5e432e04abb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:29.237091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b45c3f52-2371-4459-b162-b5e432e04abb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:29.237518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b45c3f52-2371-4459-b162-b5e432e04abb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:29.266409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b45c3f52-2371-4459-b162-b5e432e04abb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041859 Jun 20 07:26:29.266956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 730/1356] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:29 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:29.998152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8d04b22-ff8e-4e71-b915-c0d08b2d0804 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:29.998764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8d04b22-ff8e-4e71-b915-c0d08b2d0804 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:30.005192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8d04b22-ff8e-4e71-b915-c0d08b2d0804 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:30.005636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8d04b22-ff8e-4e71-b915-c0d08b2d0804 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:30.006442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8d04b22-ff8e-4e71-b915-c0d08b2d0804 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:30.006879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8d04b22-ff8e-4e71-b915-c0d08b2d0804 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:30.134435 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8d04b22-ff8e-4e71-b915-c0d08b2d0804 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:30.142970 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8d04b22-ff8e-4e71-b915-c0d08b2d0804 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:30.144504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8d04b22-ff8e-4e71-b915-c0d08b2d0804 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:30.145670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8d04b22-ff8e-4e71-b915-c0d08b2d0804 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151393 Jun 20 07:26:30.146328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 627/1357] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:29 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:30.278371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a8dd4402-9f6f-4603-9406-980016abbf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:30.279297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a8dd4402-9f6f-4603-9406-980016abbf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:30.285686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8dd4402-9f6f-4603-9406-980016abbf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:30.286136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8dd4402-9f6f-4603-9406-980016abbf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:30.286907 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8dd4402-9f6f-4603-9406-980016abbf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:30.287341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8dd4402-9f6f-4603-9406-980016abbf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:30.316558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a8dd4402-9f6f-4603-9406-980016abbf0b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042027 Jun 20 07:26:30.317118 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 731/1358] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:30 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:31.165202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e440eea9-8ff1-47d9-b503-55b9b8a1aa7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:31.165814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e440eea9-8ff1-47d9-b503-55b9b8a1aa7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:31.172610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e440eea9-8ff1-47d9-b503-55b9b8a1aa7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:31.173079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e440eea9-8ff1-47d9-b503-55b9b8a1aa7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:31.173844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e440eea9-8ff1-47d9-b503-55b9b8a1aa7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:31.174280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e440eea9-8ff1-47d9-b503-55b9b8a1aa7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:31.308307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e440eea9-8ff1-47d9-b503-55b9b8a1aa7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:31.316576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e440eea9-8ff1-47d9-b503-55b9b8a1aa7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:31.318087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e440eea9-8ff1-47d9-b503-55b9b8a1aa7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:31.319232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e440eea9-8ff1-47d9-b503-55b9b8a1aa7e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.158457 Jun 20 07:26:31.319825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 628/1359] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:31 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:31.328645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7fac26f3-fb2e-4344-a9ab-b46d7a530175 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:31.329638 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7fac26f3-fb2e-4344-a9ab-b46d7a530175 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:31.337689 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fac26f3-fb2e-4344-a9ab-b46d7a530175 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:31.338152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fac26f3-fb2e-4344-a9ab-b46d7a530175 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:31.339092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fac26f3-fb2e-4344-a9ab-b46d7a530175 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:31.339672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fac26f3-fb2e-4344-a9ab-b46d7a530175 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:31.370236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7fac26f3-fb2e-4344-a9ab-b46d7a530175 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045748 Jun 20 07:26:31.370811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 732/1360] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:31 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:32.337514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-771cf746-4f1a-4e83-9240-e9b32f9ee3b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:32.338137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-771cf746-4f1a-4e83-9240-e9b32f9ee3b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:32.344614 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-771cf746-4f1a-4e83-9240-e9b32f9ee3b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:32.345067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-771cf746-4f1a-4e83-9240-e9b32f9ee3b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:32.345836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-771cf746-4f1a-4e83-9240-e9b32f9ee3b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:32.346277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-771cf746-4f1a-4e83-9240-e9b32f9ee3b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:32.360750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:26:32.382206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-179fb032-1f43-49f4-8c86-dd11c57fc4ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:32.383472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-179fb032-1f43-49f4-8c86-dd11c57fc4ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:32.390308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-179fb032-1f43-49f4-8c86-dd11c57fc4ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:32.390758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-179fb032-1f43-49f4-8c86-dd11c57fc4ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:32.391527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-179fb032-1f43-49f4-8c86-dd11c57fc4ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:32.391961 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-179fb032-1f43-49f4-8c86-dd11c57fc4ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:32.420886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-179fb032-1f43-49f4-8c86-dd11c57fc4ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043133 Jun 20 07:26:32.421447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 733/1361] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:32 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:26:32.473623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-771cf746-4f1a-4e83-9240-e9b32f9ee3b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:32.482350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-771cf746-4f1a-4e83-9240-e9b32f9ee3b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:32.483830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-771cf746-4f1a-4e83-9240-e9b32f9ee3b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:32.485014 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-771cf746-4f1a-4e83-9240-e9b32f9ee3b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151384 Jun 20 07:26:32.485570 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 629/1362] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:32 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:33.432338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-349a621f-d25d-4672-85c4-adcc059a45a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:33.433266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-349a621f-d25d-4672-85c4-adcc059a45a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:33.439743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-349a621f-d25d-4672-85c4-adcc059a45a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:33.440233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-349a621f-d25d-4672-85c4-adcc059a45a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:33.440994 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-349a621f-d25d-4672-85c4-adcc059a45a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:33.441431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-349a621f-d25d-4672-85c4-adcc059a45a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:33.444238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:26:33.471186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-349a621f-d25d-4672-85c4-adcc059a45a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 Jun 20 07:26:33.471740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 734/1363] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:33 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:33.503917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cfe2455c-f1e2-4ffa-b7e8-a01512a876bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:33.504561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cfe2455c-f1e2-4ffa-b7e8-a01512a876bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:33.511705 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfe2455c-f1e2-4ffa-b7e8-a01512a876bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:33.512176 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfe2455c-f1e2-4ffa-b7e8-a01512a876bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:33.512940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfe2455c-f1e2-4ffa-b7e8-a01512a876bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:33.513379 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfe2455c-f1e2-4ffa-b7e8-a01512a876bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:33.642059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cfe2455c-f1e2-4ffa-b7e8-a01512a876bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:33.650409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cfe2455c-f1e2-4ffa-b7e8-a01512a876bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:33.651897 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cfe2455c-f1e2-4ffa-b7e8-a01512a876bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:33.653071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cfe2455c-f1e2-4ffa-b7e8-a01512a876bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153028 Jun 20 07:26:33.653623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 630/1364] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:33 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:34.482946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b212f06a-cd8d-47a5-9c0d-bde9725ebf05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:34.483794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b212f06a-cd8d-47a5-9c0d-bde9725ebf05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:34.489794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b212f06a-cd8d-47a5-9c0d-bde9725ebf05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:34.490242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b212f06a-cd8d-47a5-9c0d-bde9725ebf05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:34.490997 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b212f06a-cd8d-47a5-9c0d-bde9725ebf05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:34.491437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b212f06a-cd8d-47a5-9c0d-bde9725ebf05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:34.519268 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b212f06a-cd8d-47a5-9c0d-bde9725ebf05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040551 Jun 20 07:26:34.519802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 735/1365] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:34.671312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-df932e57-37c3-4a05-8200-7f32629ab178 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:34.671927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-df932e57-37c3-4a05-8200-7f32629ab178 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:34.678458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df932e57-37c3-4a05-8200-7f32629ab178 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:34.678903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df932e57-37c3-4a05-8200-7f32629ab178 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:34.679656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df932e57-37c3-4a05-8200-7f32629ab178 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:34.680092 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df932e57-37c3-4a05-8200-7f32629ab178 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:34.805099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-df932e57-37c3-4a05-8200-7f32629ab178 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:34.813393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-df932e57-37c3-4a05-8200-7f32629ab178 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:34.814876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-df932e57-37c3-4a05-8200-7f32629ab178 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:34.816027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-df932e57-37c3-4a05-8200-7f32629ab178 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.148565 Jun 20 07:26:34.816618 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 631/1366] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:34 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:35.530466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1443db84-acc5-4090-bb97-d636dea5ea3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:35.531383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1443db84-acc5-4090-bb97-d636dea5ea3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:35.538331 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1443db84-acc5-4090-bb97-d636dea5ea3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:35.538782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1443db84-acc5-4090-bb97-d636dea5ea3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:35.539577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1443db84-acc5-4090-bb97-d636dea5ea3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:35.540015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1443db84-acc5-4090-bb97-d636dea5ea3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:35.568663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1443db84-acc5-4090-bb97-d636dea5ea3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042106 Jun 20 07:26:35.569203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 736/1367] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:35 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:35.835672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ac7344af-6a7e-4adf-9b55-09297322a573 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:35.836324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ac7344af-6a7e-4adf-9b55-09297322a573 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:35.842844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac7344af-6a7e-4adf-9b55-09297322a573 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:35.843297 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac7344af-6a7e-4adf-9b55-09297322a573 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:35.844087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac7344af-6a7e-4adf-9b55-09297322a573 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:35.844549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac7344af-6a7e-4adf-9b55-09297322a573 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:35.970727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ac7344af-6a7e-4adf-9b55-09297322a573 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:35.979875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ac7344af-6a7e-4adf-9b55-09297322a573 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:35.981152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ac7344af-6a7e-4adf-9b55-09297322a573 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:35.982323 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ac7344af-6a7e-4adf-9b55-09297322a573 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151058 Jun 20 07:26:35.982884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 632/1368] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:35 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:36.580218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-349d0419-d684-4fbd-9784-94815baa676e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:36.581145 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-349d0419-d684-4fbd-9784-94815baa676e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:36.587530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-349d0419-d684-4fbd-9784-94815baa676e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:36.587982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-349d0419-d684-4fbd-9784-94815baa676e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:36.588777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-349d0419-d684-4fbd-9784-94815baa676e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:36.589215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-349d0419-d684-4fbd-9784-94815baa676e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:36.617505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-349d0419-d684-4fbd-9784-94815baa676e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041281 Jun 20 07:26:36.618048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 737/1369] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:36 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:37.000738 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-946b0362-eccf-4867-b52f-4428898560e0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:37.001349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-946b0362-eccf-4867-b52f-4428898560e0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:37.009803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-946b0362-eccf-4867-b52f-4428898560e0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:37.010256 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-946b0362-eccf-4867-b52f-4428898560e0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:37.011024 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-946b0362-eccf-4867-b52f-4428898560e0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:37.011460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-946b0362-eccf-4867-b52f-4428898560e0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:37.140721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-946b0362-eccf-4867-b52f-4428898560e0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:37.150652 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-946b0362-eccf-4867-b52f-4428898560e0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:37.152181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-946b0362-eccf-4867-b52f-4428898560e0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:37.153333 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-946b0362-eccf-4867-b52f-4428898560e0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.156527 Jun 20 07:26:37.153888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 633/1370] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:36 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:37.629136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fe0f39bd-82e1-45de-a5eb-0ea7c12be4c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:37.630095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fe0f39bd-82e1-45de-a5eb-0ea7c12be4c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:37.637481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe0f39bd-82e1-45de-a5eb-0ea7c12be4c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:37.637941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe0f39bd-82e1-45de-a5eb-0ea7c12be4c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:37.638727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe0f39bd-82e1-45de-a5eb-0ea7c12be4c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:37.639166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fe0f39bd-82e1-45de-a5eb-0ea7c12be4c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:37.667729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fe0f39bd-82e1-45de-a5eb-0ea7c12be4c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042597 Jun 20 07:26:37.668305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 738/1371] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:37 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:38.172041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d41d6ae3-45b1-43c0-990e-7e9a0dfb1a88 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:38.172681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d41d6ae3-45b1-43c0-990e-7e9a0dfb1a88 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:38.179078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d41d6ae3-45b1-43c0-990e-7e9a0dfb1a88 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:38.179521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d41d6ae3-45b1-43c0-990e-7e9a0dfb1a88 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:38.180309 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d41d6ae3-45b1-43c0-990e-7e9a0dfb1a88 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:38.180745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d41d6ae3-45b1-43c0-990e-7e9a0dfb1a88 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:38.313098 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d41d6ae3-45b1-43c0-990e-7e9a0dfb1a88 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:38.321442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d41d6ae3-45b1-43c0-990e-7e9a0dfb1a88 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:38.322931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d41d6ae3-45b1-43c0-990e-7e9a0dfb1a88 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:38.324085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d41d6ae3-45b1-43c0-990e-7e9a0dfb1a88 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155942 Jun 20 07:26:38.324668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 634/1372] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:38 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:38.678846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dfc16a1c-fd34-4eb6-9270-2c9e9d8b2f3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:38.679762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dfc16a1c-fd34-4eb6-9270-2c9e9d8b2f3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:38.686228 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfc16a1c-fd34-4eb6-9270-2c9e9d8b2f3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:38.686671 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfc16a1c-fd34-4eb6-9270-2c9e9d8b2f3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:38.687422 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfc16a1c-fd34-4eb6-9270-2c9e9d8b2f3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:38.687854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfc16a1c-fd34-4eb6-9270-2c9e9d8b2f3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:38.721132 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dfc16a1c-fd34-4eb6-9270-2c9e9d8b2f3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046154 Jun 20 07:26:38.721701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 739/1373] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:38 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:39.343759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7eb95c68-c383-4c54-84c1-d9def449fa42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:39.344395 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7eb95c68-c383-4c54-84c1-d9def449fa42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:39.350793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7eb95c68-c383-4c54-84c1-d9def449fa42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:39.351240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7eb95c68-c383-4c54-84c1-d9def449fa42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:39.351994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7eb95c68-c383-4c54-84c1-d9def449fa42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:39.352459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7eb95c68-c383-4c54-84c1-d9def449fa42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:39.486298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7eb95c68-c383-4c54-84c1-d9def449fa42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:39.494581 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7eb95c68-c383-4c54-84c1-d9def449fa42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:39.496381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7eb95c68-c383-4c54-84c1-d9def449fa42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:39.497541 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7eb95c68-c383-4c54-84c1-d9def449fa42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157614 Jun 20 07:26:39.498101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 635/1374] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:39 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:39.732614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0d817373-32ec-4862-8afc-86d884064ff5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:39.733535 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0d817373-32ec-4862-8afc-86d884064ff5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:39.739936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d817373-32ec-4862-8afc-86d884064ff5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:39.740949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d817373-32ec-4862-8afc-86d884064ff5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:39.741705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d817373-32ec-4862-8afc-86d884064ff5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:39.742140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d817373-32ec-4862-8afc-86d884064ff5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:39.770857 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0d817373-32ec-4862-8afc-86d884064ff5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 Jun 20 07:26:39.771431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 740/1375] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:39 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:40.517048 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dccb9cee-2fe8-41bd-8202-7cb28c27cb97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:40.517690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dccb9cee-2fe8-41bd-8202-7cb28c27cb97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:40.519946 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:26:40.525377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dccb9cee-2fe8-41bd-8202-7cb28c27cb97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:40.525820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dccb9cee-2fe8-41bd-8202-7cb28c27cb97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:40.526570 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dccb9cee-2fe8-41bd-8202-7cb28c27cb97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:40.526999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dccb9cee-2fe8-41bd-8202-7cb28c27cb97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:40.654834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dccb9cee-2fe8-41bd-8202-7cb28c27cb97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:40.663692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dccb9cee-2fe8-41bd-8202-7cb28c27cb97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:40.665223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dccb9cee-2fe8-41bd-8202-7cb28c27cb97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:40.666413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dccb9cee-2fe8-41bd-8202-7cb28c27cb97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153217 Jun 20 07:26:40.666971 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 636/1376] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:40 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:40.782253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cb8c43f2-88b2-404b-b9e3-9e45a3870c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:40.783172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cb8c43f2-88b2-404b-b9e3-9e45a3870c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:40.790089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb8c43f2-88b2-404b-b9e3-9e45a3870c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:40.790528 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb8c43f2-88b2-404b-b9e3-9e45a3870c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:40.791281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb8c43f2-88b2-404b-b9e3-9e45a3870c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:40.791707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cb8c43f2-88b2-404b-b9e3-9e45a3870c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:40.819742 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cb8c43f2-88b2-404b-b9e3-9e45a3870c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041486 Jun 20 07:26:40.820309 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 741/1377] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:40 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:41.684434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9a8a0d3a-6788-4207-8c64-79d8620a33da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:41.685133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9a8a0d3a-6788-4207-8c64-79d8620a33da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:41.701169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a8a0d3a-6788-4207-8c64-79d8620a33da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:41.701727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a8a0d3a-6788-4207-8c64-79d8620a33da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:41.702534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a8a0d3a-6788-4207-8c64-79d8620a33da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:41.702975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a8a0d3a-6788-4207-8c64-79d8620a33da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:41.828985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a8a0d3a-6788-4207-8c64-79d8620a33da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:41.830917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e29cbef-75ec-4fc6-838e-e6e1743b094b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:41.831995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e29cbef-75ec-4fc6-838e-e6e1743b094b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:41.834333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=58 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:26:41.837477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a8a0d3a-6788-4207-8c64-79d8620a33da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:41.838965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a8a0d3a-6788-4207-8c64-79d8620a33da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:41.839728 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e29cbef-75ec-4fc6-838e-e6e1743b094b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:41.840145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9a8a0d3a-6788-4207-8c64-79d8620a33da tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.159525 Jun 20 07:26:41.840264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e29cbef-75ec-4fc6-838e-e6e1743b094b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:41.840702 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 637/1378] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:41 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:41.840937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e29cbef-75ec-4fc6-838e-e6e1743b094b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:41.841364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e29cbef-75ec-4fc6-838e-e6e1743b094b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:41.869908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e29cbef-75ec-4fc6-838e-e6e1743b094b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042958 Jun 20 07:26:41.870441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 742/1379] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:26:42.858343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5e928a7e-7bb7-4c4b-b97b-dbf74e785b7a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:42.858960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5e928a7e-7bb7-4c4b-b97b-dbf74e785b7a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:42.865503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e928a7e-7bb7-4c4b-b97b-dbf74e785b7a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:42.865952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e928a7e-7bb7-4c4b-b97b-dbf74e785b7a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:42.866706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e928a7e-7bb7-4c4b-b97b-dbf74e785b7a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:42.867141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e928a7e-7bb7-4c4b-b97b-dbf74e785b7a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:42.881663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b3233059-f846-4795-a510-0cb932c47584 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:42.882618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b3233059-f846-4795-a510-0cb932c47584 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:42.889324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3233059-f846-4795-a510-0cb932c47584 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:42.889769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3233059-f846-4795-a510-0cb932c47584 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:42.890529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3233059-f846-4795-a510-0cb932c47584 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:42.890960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3233059-f846-4795-a510-0cb932c47584 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:42.920303 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b3233059-f846-4795-a510-0cb932c47584 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042930 Jun 20 07:26:42.920862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 743/1380] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:42 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:26:42.997403 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5e928a7e-7bb7-4c4b-b97b-dbf74e785b7a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:43.006269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5e928a7e-7bb7-4c4b-b97b-dbf74e785b7a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:43.008022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5e928a7e-7bb7-4c4b-b97b-dbf74e785b7a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:43.009210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5e928a7e-7bb7-4c4b-b97b-dbf74e785b7a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154712 Jun 20 07:26:43.009767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 638/1381] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:43.931800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c713616c-1da4-4f8c-80d8-a91688a04dc4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:43.932692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c713616c-1da4-4f8c-80d8-a91688a04dc4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:43.939193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c713616c-1da4-4f8c-80d8-a91688a04dc4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:43.939648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c713616c-1da4-4f8c-80d8-a91688a04dc4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:43.940437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c713616c-1da4-4f8c-80d8-a91688a04dc4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:43.940877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c713616c-1da4-4f8c-80d8-a91688a04dc4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:43.970517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c713616c-1da4-4f8c-80d8-a91688a04dc4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Jun 20 07:26:43.971068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 744/1382] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:43 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:44.028810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-444f4f76-0627-4360-8d45-2d74513e7d6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:44.029437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-444f4f76-0627-4360-8d45-2d74513e7d6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:44.038063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-444f4f76-0627-4360-8d45-2d74513e7d6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:44.038940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-444f4f76-0627-4360-8d45-2d74513e7d6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:44.039771 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-444f4f76-0627-4360-8d45-2d74513e7d6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:44.040275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-444f4f76-0627-4360-8d45-2d74513e7d6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:44.166555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-444f4f76-0627-4360-8d45-2d74513e7d6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:44.175130 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-444f4f76-0627-4360-8d45-2d74513e7d6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:44.176695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-444f4f76-0627-4360-8d45-2d74513e7d6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:44.178471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-444f4f76-0627-4360-8d45-2d74513e7d6d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154087 Jun 20 07:26:44.179023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 639/1383] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:44 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:44.982001 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f754bbcb-0206-47ea-a82b-4f56f875263c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:44.982919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f754bbcb-0206-47ea-a82b-4f56f875263c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:44.989343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f754bbcb-0206-47ea-a82b-4f56f875263c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:44.989790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f754bbcb-0206-47ea-a82b-4f56f875263c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:44.990548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f754bbcb-0206-47ea-a82b-4f56f875263c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:44.990979 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f754bbcb-0206-47ea-a82b-4f56f875263c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:45.018963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f754bbcb-0206-47ea-a82b-4f56f875263c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040943 Jun 20 07:26:45.019500 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 745/1384] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:45.196800 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-03ef93b7-e02e-4019-b6e9-80a3365faa47 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:45.197352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-03ef93b7-e02e-4019-b6e9-80a3365faa47 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:45.203779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03ef93b7-e02e-4019-b6e9-80a3365faa47 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:45.204250 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03ef93b7-e02e-4019-b6e9-80a3365faa47 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:45.205002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03ef93b7-e02e-4019-b6e9-80a3365faa47 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:45.205436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03ef93b7-e02e-4019-b6e9-80a3365faa47 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:45.334968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-03ef93b7-e02e-4019-b6e9-80a3365faa47 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:45.343155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-03ef93b7-e02e-4019-b6e9-80a3365faa47 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:45.344731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-03ef93b7-e02e-4019-b6e9-80a3365faa47 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:45.345870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-03ef93b7-e02e-4019-b6e9-80a3365faa47 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153608 Jun 20 07:26:45.346420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 640/1385] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:45 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:46.030135 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-525ab7b5-f31e-4ff2-a7ef-cd348b05a9f3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:46.031066 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-525ab7b5-f31e-4ff2-a7ef-cd348b05a9f3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:46.038098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-525ab7b5-f31e-4ff2-a7ef-cd348b05a9f3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:46.038557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-525ab7b5-f31e-4ff2-a7ef-cd348b05a9f3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:46.039318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-525ab7b5-f31e-4ff2-a7ef-cd348b05a9f3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:46.039758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-525ab7b5-f31e-4ff2-a7ef-cd348b05a9f3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:46.068336 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-525ab7b5-f31e-4ff2-a7ef-cd348b05a9f3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042122 Jun 20 07:26:46.068878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 746/1386] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:46.364141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fcf4ea07-dd7f-4840-8321-cb0257d22abd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:46.364684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fcf4ea07-dd7f-4840-8321-cb0257d22abd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:46.371059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fcf4ea07-dd7f-4840-8321-cb0257d22abd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:46.371500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fcf4ea07-dd7f-4840-8321-cb0257d22abd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:46.372283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fcf4ea07-dd7f-4840-8321-cb0257d22abd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:46.372717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fcf4ea07-dd7f-4840-8321-cb0257d22abd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:46.501447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fcf4ea07-dd7f-4840-8321-cb0257d22abd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:46.517921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fcf4ea07-dd7f-4840-8321-cb0257d22abd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:46.519432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fcf4ea07-dd7f-4840-8321-cb0257d22abd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:46.520637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fcf4ea07-dd7f-4840-8321-cb0257d22abd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.160482 Jun 20 07:26:46.521200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 641/1387] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:46 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:47.078845 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f8e26f9f-7c93-43bf-a486-9c3323ac7df7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:47.079773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f8e26f9f-7c93-43bf-a486-9c3323ac7df7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:47.086277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8e26f9f-7c93-43bf-a486-9c3323ac7df7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:47.086733 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8e26f9f-7c93-43bf-a486-9c3323ac7df7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:47.087501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8e26f9f-7c93-43bf-a486-9c3323ac7df7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:47.087941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8e26f9f-7c93-43bf-a486-9c3323ac7df7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:47.116152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f8e26f9f-7c93-43bf-a486-9c3323ac7df7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040753 Jun 20 07:26:47.116697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 747/1388] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:47 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:47.539204 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-12a45b1c-3a42-41db-b9c7-e752a6e0fcbd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:47.540951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-12a45b1c-3a42-41db-b9c7-e752a6e0fcbd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:47.547866 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12a45b1c-3a42-41db-b9c7-e752a6e0fcbd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:47.548355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12a45b1c-3a42-41db-b9c7-e752a6e0fcbd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:47.549135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12a45b1c-3a42-41db-b9c7-e752a6e0fcbd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:47.549653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12a45b1c-3a42-41db-b9c7-e752a6e0fcbd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:47.683701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-12a45b1c-3a42-41db-b9c7-e752a6e0fcbd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:47.692054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-12a45b1c-3a42-41db-b9c7-e752a6e0fcbd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:47.693579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-12a45b1c-3a42-41db-b9c7-e752a6e0fcbd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:47.694755 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-12a45b1c-3a42-41db-b9c7-e752a6e0fcbd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.160029 Jun 20 07:26:47.695314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 642/1389] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:47 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:48.127288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b8882ad-5cb4-4ebf-aefd-f3fb5dcd2e47 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:48.128298 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6b8882ad-5cb4-4ebf-aefd-f3fb5dcd2e47 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:48.135502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b8882ad-5cb4-4ebf-aefd-f3fb5dcd2e47 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:48.135947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b8882ad-5cb4-4ebf-aefd-f3fb5dcd2e47 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:48.136727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b8882ad-5cb4-4ebf-aefd-f3fb5dcd2e47 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:48.137164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b8882ad-5cb4-4ebf-aefd-f3fb5dcd2e47 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:48.165402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6b8882ad-5cb4-4ebf-aefd-f3fb5dcd2e47 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041990 Jun 20 07:26:48.165939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 748/1390] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:48 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:48.713018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-83ab87a7-c599-45ae-8a77-bebff973fa8b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:48.713638 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-83ab87a7-c599-45ae-8a77-bebff973fa8b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:48.720190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83ab87a7-c599-45ae-8a77-bebff973fa8b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:48.720646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83ab87a7-c599-45ae-8a77-bebff973fa8b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:48.721405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83ab87a7-c599-45ae-8a77-bebff973fa8b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:48.721846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-83ab87a7-c599-45ae-8a77-bebff973fa8b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:48.848203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-83ab87a7-c599-45ae-8a77-bebff973fa8b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:48.856460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-83ab87a7-c599-45ae-8a77-bebff973fa8b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:48.857943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-83ab87a7-c599-45ae-8a77-bebff973fa8b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:48.859090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-83ab87a7-c599-45ae-8a77-bebff973fa8b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150010 Jun 20 07:26:48.859640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 643/1391] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:48 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:49.176703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-51d83ac6-8bb8-4f66-986e-290631fd7a78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:49.177562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-51d83ac6-8bb8-4f66-986e-290631fd7a78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:49.184560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51d83ac6-8bb8-4f66-986e-290631fd7a78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:49.185009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51d83ac6-8bb8-4f66-986e-290631fd7a78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:49.185775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51d83ac6-8bb8-4f66-986e-290631fd7a78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:49.186203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51d83ac6-8bb8-4f66-986e-290631fd7a78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:49.213879 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-51d83ac6-8bb8-4f66-986e-290631fd7a78 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041111 Jun 20 07:26:49.214412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 749/1392] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:49.877889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f18f2f41-427b-4ec8-9a08-aac8de600b9e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:49.878514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f18f2f41-427b-4ec8-9a08-aac8de600b9e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:49.885136 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f18f2f41-427b-4ec8-9a08-aac8de600b9e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:49.885533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f18f2f41-427b-4ec8-9a08-aac8de600b9e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:49.886301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f18f2f41-427b-4ec8-9a08-aac8de600b9e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:49.886744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f18f2f41-427b-4ec8-9a08-aac8de600b9e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:50.018126 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f18f2f41-427b-4ec8-9a08-aac8de600b9e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:50.027083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f18f2f41-427b-4ec8-9a08-aac8de600b9e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:50.028623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f18f2f41-427b-4ec8-9a08-aac8de600b9e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:50.029804 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f18f2f41-427b-4ec8-9a08-aac8de600b9e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155847 Jun 20 07:26:50.030355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 644/1393] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:49 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:50.225396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15266c81-c371-4c7d-ab2a-9fe51fae677d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:50.226435 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-15266c81-c371-4c7d-ab2a-9fe51fae677d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:50.233052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15266c81-c371-4c7d-ab2a-9fe51fae677d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:50.233499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15266c81-c371-4c7d-ab2a-9fe51fae677d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:50.234289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15266c81-c371-4c7d-ab2a-9fe51fae677d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:50.234719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15266c81-c371-4c7d-ab2a-9fe51fae677d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:50.260372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:26:50.266340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-15266c81-c371-4c7d-ab2a-9fe51fae677d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045624 Jun 20 07:26:50.266911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 750/1394] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:51.048766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3714508f-4015-4981-b4a6-f042a1974eba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:51.049387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3714508f-4015-4981-b4a6-f042a1974eba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:51.056366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3714508f-4015-4981-b4a6-f042a1974eba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:51.056824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3714508f-4015-4981-b4a6-f042a1974eba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:51.057586 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3714508f-4015-4981-b4a6-f042a1974eba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:51.058030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3714508f-4015-4981-b4a6-f042a1974eba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:51.189744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3714508f-4015-4981-b4a6-f042a1974eba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:51.198155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3714508f-4015-4981-b4a6-f042a1974eba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:51.199651 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3714508f-4015-4981-b4a6-f042a1974eba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:51.200875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3714508f-4015-4981-b4a6-f042a1974eba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.156051 Jun 20 07:26:51.201429 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 645/1395] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:51 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:51.277685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ecb8100b-a985-4854-b826-e9dcd621bd01 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:51.278595 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ecb8100b-a985-4854-b826-e9dcd621bd01 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:51.285200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecb8100b-a985-4854-b826-e9dcd621bd01 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:51.285653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecb8100b-a985-4854-b826-e9dcd621bd01 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:51.286404 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecb8100b-a985-4854-b826-e9dcd621bd01 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:51.286835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ecb8100b-a985-4854-b826-e9dcd621bd01 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:51.316305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ecb8100b-a985-4854-b826-e9dcd621bd01 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042408 Jun 20 07:26:51.316795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 751/1396] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:52.219139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-441d65fe-0535-4f54-8a7e-1fc1b8dc93ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:52.219746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-441d65fe-0535-4f54-8a7e-1fc1b8dc93ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:52.226185 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-441d65fe-0535-4f54-8a7e-1fc1b8dc93ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:52.226627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-441d65fe-0535-4f54-8a7e-1fc1b8dc93ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:52.227372 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-441d65fe-0535-4f54-8a7e-1fc1b8dc93ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:52.227801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-441d65fe-0535-4f54-8a7e-1fc1b8dc93ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:52.230276 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:26:52.327090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f79a7da6-03d6-45e3-89a0-c2848221a797 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:52.328157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f79a7da6-03d6-45e3-89a0-c2848221a797 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:52.334625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f79a7da6-03d6-45e3-89a0-c2848221a797 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:52.335081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f79a7da6-03d6-45e3-89a0-c2848221a797 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:52.335853 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f79a7da6-03d6-45e3-89a0-c2848221a797 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:52.336320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f79a7da6-03d6-45e3-89a0-c2848221a797 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:52.354969 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-441d65fe-0535-4f54-8a7e-1fc1b8dc93ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:52.363335 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-441d65fe-0535-4f54-8a7e-1fc1b8dc93ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:52.364879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-441d65fe-0535-4f54-8a7e-1fc1b8dc93ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:52.365183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f79a7da6-03d6-45e3-89a0-c2848221a797 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042054 Jun 20 07:26:52.366290 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 752/1397] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:26:52.366545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-441d65fe-0535-4f54-8a7e-1fc1b8dc93ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151270 Jun 20 07:26:52.367099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 646/1398] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:52 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:53.377371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b03a4b30-0dcb-4549-a257-daeb4141117f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:53.378318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b03a4b30-0dcb-4549-a257-daeb4141117f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:53.384876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-988203d1-c0bc-44c4-b9c0-1801df644e79 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:53.385532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-988203d1-c0bc-44c4-b9c0-1801df644e79 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:53.385744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b03a4b30-0dcb-4549-a257-daeb4141117f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:53.386187 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b03a4b30-0dcb-4549-a257-daeb4141117f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:53.386946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b03a4b30-0dcb-4549-a257-daeb4141117f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:53.387558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b03a4b30-0dcb-4549-a257-daeb4141117f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:53.392093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-988203d1-c0bc-44c4-b9c0-1801df644e79 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:53.392591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-988203d1-c0bc-44c4-b9c0-1801df644e79 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:53.393358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-988203d1-c0bc-44c4-b9c0-1801df644e79 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:53.393801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-988203d1-c0bc-44c4-b9c0-1801df644e79 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:53.416817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b03a4b30-0dcb-4549-a257-daeb4141117f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043388 Jun 20 07:26:53.417374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 753/1399] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:53.525081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-988203d1-c0bc-44c4-b9c0-1801df644e79 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:53.533394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-988203d1-c0bc-44c4-b9c0-1801df644e79 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:53.534879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-988203d1-c0bc-44c4-b9c0-1801df644e79 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:53.536028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-988203d1-c0bc-44c4-b9c0-1801df644e79 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155821 Jun 20 07:26:53.536683 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 647/1400] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:53 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:26:54.428306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f02a7a33-7921-47de-b87e-75fdc9ecb503 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:54.429221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f02a7a33-7921-47de-b87e-75fdc9ecb503 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:54.435705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f02a7a33-7921-47de-b87e-75fdc9ecb503 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:54.436185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f02a7a33-7921-47de-b87e-75fdc9ecb503 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:54.436945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f02a7a33-7921-47de-b87e-75fdc9ecb503 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:54.437406 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f02a7a33-7921-47de-b87e-75fdc9ecb503 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:54.466510 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f02a7a33-7921-47de-b87e-75fdc9ecb503 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042163 Jun 20 07:26:54.467063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 754/1401] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:54 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:54.554746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6917d04d-a89f-4b7c-9be5-20849226bb43 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:54.555358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6917d04d-a89f-4b7c-9be5-20849226bb43 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:54.561710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6917d04d-a89f-4b7c-9be5-20849226bb43 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:54.562154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6917d04d-a89f-4b7c-9be5-20849226bb43 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:54.562905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6917d04d-a89f-4b7c-9be5-20849226bb43 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:54.563336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6917d04d-a89f-4b7c-9be5-20849226bb43 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:54.690379 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6917d04d-a89f-4b7c-9be5-20849226bb43 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:54.699259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6917d04d-a89f-4b7c-9be5-20849226bb43 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:54.700766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6917d04d-a89f-4b7c-9be5-20849226bb43 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:54.701917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6917d04d-a89f-4b7c-9be5-20849226bb43 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151536 Jun 20 07:26:54.702472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 648/1402] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:54 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:55.477991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-44aa85af-356b-49a0-8cb8-abd0b0c548e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:55.479035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-44aa85af-356b-49a0-8cb8-abd0b0c548e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:55.485661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44aa85af-356b-49a0-8cb8-abd0b0c548e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:55.486112 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44aa85af-356b-49a0-8cb8-abd0b0c548e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:55.486878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44aa85af-356b-49a0-8cb8-abd0b0c548e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:55.487323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44aa85af-356b-49a0-8cb8-abd0b0c548e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:55.515699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-44aa85af-356b-49a0-8cb8-abd0b0c548e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042427 Jun 20 07:26:55.516271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 755/1403] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:55 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:55.719467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-43651874-5b51-4c71-a291-afafd41757f2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:55.720081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-43651874-5b51-4c71-a291-afafd41757f2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:55.726633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43651874-5b51-4c71-a291-afafd41757f2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:55.727074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43651874-5b51-4c71-a291-afafd41757f2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:55.727827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43651874-5b51-4c71-a291-afafd41757f2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:55.728299 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43651874-5b51-4c71-a291-afafd41757f2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:55.852693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-43651874-5b51-4c71-a291-afafd41757f2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:55.860939 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-43651874-5b51-4c71-a291-afafd41757f2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:55.862433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-43651874-5b51-4c71-a291-afafd41757f2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:55.863579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-43651874-5b51-4c71-a291-afafd41757f2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.148015 Jun 20 07:26:55.864152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 649/1404] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:55 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:56.527012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5b1fe6d8-96ae-43a5-a044-991ac9e0c45a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:56.527942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5b1fe6d8-96ae-43a5-a044-991ac9e0c45a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:56.534446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b1fe6d8-96ae-43a5-a044-991ac9e0c45a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:56.534899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b1fe6d8-96ae-43a5-a044-991ac9e0c45a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:56.535665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b1fe6d8-96ae-43a5-a044-991ac9e0c45a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:56.536117 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b1fe6d8-96ae-43a5-a044-991ac9e0c45a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:56.565708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5b1fe6d8-96ae-43a5-a044-991ac9e0c45a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042717 Jun 20 07:26:56.566270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 756/1405] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:56.882022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-586c06cb-71fa-40f8-b235-fc7eccdfb3ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:56.883505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-586c06cb-71fa-40f8-b235-fc7eccdfb3ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:56.889414 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-586c06cb-71fa-40f8-b235-fc7eccdfb3ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:56.889869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-586c06cb-71fa-40f8-b235-fc7eccdfb3ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:56.890634 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-586c06cb-71fa-40f8-b235-fc7eccdfb3ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:56.891074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-586c06cb-71fa-40f8-b235-fc7eccdfb3ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:57.020970 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-586c06cb-71fa-40f8-b235-fc7eccdfb3ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:57.029789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-586c06cb-71fa-40f8-b235-fc7eccdfb3ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:57.031273 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-586c06cb-71fa-40f8-b235-fc7eccdfb3ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:57.032451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-586c06cb-71fa-40f8-b235-fc7eccdfb3ad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154380 Jun 20 07:26:57.033005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 650/1406] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:56 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:26:57.577203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9f87690-cd66-4927-a6dd-56cfa704c593 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:57.578130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c9f87690-cd66-4927-a6dd-56cfa704c593 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:57.584537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9f87690-cd66-4927-a6dd-56cfa704c593 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:57.584991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9f87690-cd66-4927-a6dd-56cfa704c593 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:57.585754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9f87690-cd66-4927-a6dd-56cfa704c593 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:57.586194 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9f87690-cd66-4927-a6dd-56cfa704c593 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:57.614245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c9f87690-cd66-4927-a6dd-56cfa704c593 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040965 Jun 20 07:26:57.614793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 757/1407] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:57 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:58.051966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-105b4657-c0fc-42cd-9f7d-f6dbdee6427e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:58.052611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-105b4657-c0fc-42cd-9f7d-f6dbdee6427e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:58.059096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-105b4657-c0fc-42cd-9f7d-f6dbdee6427e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:58.059547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-105b4657-c0fc-42cd-9f7d-f6dbdee6427e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:58.060344 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-105b4657-c0fc-42cd-9f7d-f6dbdee6427e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:58.060782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-105b4657-c0fc-42cd-9f7d-f6dbdee6427e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:58.189172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-105b4657-c0fc-42cd-9f7d-f6dbdee6427e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:58.197971 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-105b4657-c0fc-42cd-9f7d-f6dbdee6427e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:58.199479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-105b4657-c0fc-42cd-9f7d-f6dbdee6427e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:58.200686 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-105b4657-c0fc-42cd-9f7d-f6dbdee6427e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152620 Jun 20 07:26:58.201247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 651/1408] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:58 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:58.626186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-730dbde0-c0ef-4366-ad59-89a1610f2fd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:58.627100 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-730dbde0-c0ef-4366-ad59-89a1610f2fd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:58.634276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-730dbde0-c0ef-4366-ad59-89a1610f2fd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:58.634719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-730dbde0-c0ef-4366-ad59-89a1610f2fd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:58.635472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-730dbde0-c0ef-4366-ad59-89a1610f2fd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:58.635901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-730dbde0-c0ef-4366-ad59-89a1610f2fd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:58.664988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-730dbde0-c0ef-4366-ad59-89a1610f2fd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042723 Jun 20 07:26:58.665461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 758/1409] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:26:59.218648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b8dccc31-9271-45a6-9810-2039333585e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:59.219266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b8dccc31-9271-45a6-9810-2039333585e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:59.225856 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8dccc31-9271-45a6-9810-2039333585e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:59.226305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8dccc31-9271-45a6-9810-2039333585e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:59.227066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8dccc31-9271-45a6-9810-2039333585e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:59.227502 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8dccc31-9271-45a6-9810-2039333585e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:59.366498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b8dccc31-9271-45a6-9810-2039333585e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:59.376325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b8dccc31-9271-45a6-9810-2039333585e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:59.378249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b8dccc31-9271-45a6-9810-2039333585e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:26:59.379401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b8dccc31-9271-45a6-9810-2039333585e9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.164686 Jun 20 07:26:59.379954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 652/1410] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:26:59 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:26:59.676669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bb44a45e-6a59-48d6-8087-54abd50e21ce tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:26:59.677497 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bb44a45e-6a59-48d6-8087-54abd50e21ce tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:26:59.684747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb44a45e-6a59-48d6-8087-54abd50e21ce tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:59.685237 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb44a45e-6a59-48d6-8087-54abd50e21ce tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:59.686040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb44a45e-6a59-48d6-8087-54abd50e21ce tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:26:59.686480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb44a45e-6a59-48d6-8087-54abd50e21ce tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:26:59.715240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bb44a45e-6a59-48d6-8087-54abd50e21ce tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042707 Jun 20 07:26:59.715804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 759/1411] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:26:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:00.398738 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2fed1c58-c5ab-436e-9ba0-cd5bf50e6311 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:00.399354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2fed1c58-c5ab-436e-9ba0-cd5bf50e6311 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:00.405740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fed1c58-c5ab-436e-9ba0-cd5bf50e6311 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:00.406182 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fed1c58-c5ab-436e-9ba0-cd5bf50e6311 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:00.406932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fed1c58-c5ab-436e-9ba0-cd5bf50e6311 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:00.407364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fed1c58-c5ab-436e-9ba0-cd5bf50e6311 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:00.538860 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2fed1c58-c5ab-436e-9ba0-cd5bf50e6311 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:00.547321 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2fed1c58-c5ab-436e-9ba0-cd5bf50e6311 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:00.548858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2fed1c58-c5ab-436e-9ba0-cd5bf50e6311 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:00.550024 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2fed1c58-c5ab-436e-9ba0-cd5bf50e6311 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155217 Jun 20 07:27:00.550581 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 653/1412] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:00 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:00.727542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f9278323-0db8-4fb6-8e60-0ae4495b5f71 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:00.728440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f9278323-0db8-4fb6-8e60-0ae4495b5f71 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:00.734983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9278323-0db8-4fb6-8e60-0ae4495b5f71 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:00.735438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9278323-0db8-4fb6-8e60-0ae4495b5f71 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:00.736239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9278323-0db8-4fb6-8e60-0ae4495b5f71 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:00.736682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9278323-0db8-4fb6-8e60-0ae4495b5f71 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:00.764822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f9278323-0db8-4fb6-8e60-0ae4495b5f71 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041944 Jun 20 07:27:00.765368 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 760/1413] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:00 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:01.568988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fdffc491-6b4f-4747-b1e5-1a1c889f3877 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:01.569616 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fdffc491-6b4f-4747-b1e5-1a1c889f3877 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:01.575999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdffc491-6b4f-4747-b1e5-1a1c889f3877 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:01.576487 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdffc491-6b4f-4747-b1e5-1a1c889f3877 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:01.577259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdffc491-6b4f-4747-b1e5-1a1c889f3877 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:01.577698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdffc491-6b4f-4747-b1e5-1a1c889f3877 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:01.713824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fdffc491-6b4f-4747-b1e5-1a1c889f3877 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:01.722477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fdffc491-6b4f-4747-b1e5-1a1c889f3877 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:01.723988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fdffc491-6b4f-4747-b1e5-1a1c889f3877 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:01.725179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fdffc491-6b4f-4747-b1e5-1a1c889f3877 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.160835 Jun 20 07:27:01.725744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 654/1414] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:01 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:01.776448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5abb3d90-faa4-4008-a5c3-eca441f6d8c0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:01.777402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5abb3d90-faa4-4008-a5c3-eca441f6d8c0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:01.783833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5abb3d90-faa4-4008-a5c3-eca441f6d8c0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:01.784334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5abb3d90-faa4-4008-a5c3-eca441f6d8c0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:01.785102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5abb3d90-faa4-4008-a5c3-eca441f6d8c0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:01.785542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5abb3d90-faa4-4008-a5c3-eca441f6d8c0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:01.813280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5abb3d90-faa4-4008-a5c3-eca441f6d8c0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040695 Jun 20 07:27:01.813766 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 761/1415] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:01 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:02.743243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c1b61851-40df-4909-98f8-0979f81b70eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:02.743854 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c1b61851-40df-4909-98f8-0979f81b70eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:02.750292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1b61851-40df-4909-98f8-0979f81b70eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:02.750733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1b61851-40df-4909-98f8-0979f81b70eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:02.751482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1b61851-40df-4909-98f8-0979f81b70eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:02.751913 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1b61851-40df-4909-98f8-0979f81b70eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:02.825245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2bef12c4-27a4-455e-938a-6d3e750001ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:02.826142 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2bef12c4-27a4-455e-938a-6d3e750001ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:02.832538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bef12c4-27a4-455e-938a-6d3e750001ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:02.832984 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bef12c4-27a4-455e-938a-6d3e750001ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:02.833769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bef12c4-27a4-455e-938a-6d3e750001ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:02.834221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bef12c4-27a4-455e-938a-6d3e750001ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:02.862373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2bef12c4-27a4-455e-938a-6d3e750001ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040933 Jun 20 07:27:02.862849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 762/1416] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:27:02.877805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c1b61851-40df-4909-98f8-0979f81b70eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:02.887026 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c1b61851-40df-4909-98f8-0979f81b70eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:02.888569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c1b61851-40df-4909-98f8-0979f81b70eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:02.889727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c1b61851-40df-4909-98f8-0979f81b70eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150938 Jun 20 07:27:02.890277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 655/1417] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:02 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:03.874251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-662577ee-3018-4268-b447-a05ad31da90f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:03.875168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-662577ee-3018-4268-b447-a05ad31da90f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:03.882710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-662577ee-3018-4268-b447-a05ad31da90f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:03.883169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-662577ee-3018-4268-b447-a05ad31da90f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:03.883938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-662577ee-3018-4268-b447-a05ad31da90f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:03.884411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-662577ee-3018-4268-b447-a05ad31da90f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:03.908739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2ff7e2d-de60-451b-bffd-67058663b37a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:03.909346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f2ff7e2d-de60-451b-bffd-67058663b37a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:03.916310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2ff7e2d-de60-451b-bffd-67058663b37a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:03.916737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-662577ee-3018-4268-b447-a05ad31da90f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046422 Jun 20 07:27:03.916865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2ff7e2d-de60-451b-bffd-67058663b37a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:03.917313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 763/1418] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:03 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:03.917528 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2ff7e2d-de60-451b-bffd-67058663b37a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:03.917968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2ff7e2d-de60-451b-bffd-67058663b37a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:04.046078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2ff7e2d-de60-451b-bffd-67058663b37a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:04.054963 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2ff7e2d-de60-451b-bffd-67058663b37a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:04.056478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2ff7e2d-de60-451b-bffd-67058663b37a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:04.057639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f2ff7e2d-de60-451b-bffd-67058663b37a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153486 Jun 20 07:27:04.058221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 656/1419] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:03 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:27:04.928850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ef8598f5-123b-415b-8d97-74c12753a1ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:04.929703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ef8598f5-123b-415b-8d97-74c12753a1ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:04.935745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef8598f5-123b-415b-8d97-74c12753a1ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:04.936221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef8598f5-123b-415b-8d97-74c12753a1ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:04.936979 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef8598f5-123b-415b-8d97-74c12753a1ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:04.937406 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef8598f5-123b-415b-8d97-74c12753a1ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:04.966296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ef8598f5-123b-415b-8d97-74c12753a1ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041549 Jun 20 07:27:04.966835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 764/1420] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:04 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:05.075903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab253b5f-f07b-423e-b394-9a45e1d05a05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:05.076553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab253b5f-f07b-423e-b394-9a45e1d05a05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:05.083005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab253b5f-f07b-423e-b394-9a45e1d05a05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:05.083457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab253b5f-f07b-423e-b394-9a45e1d05a05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:05.084251 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab253b5f-f07b-423e-b394-9a45e1d05a05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:05.084692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab253b5f-f07b-423e-b394-9a45e1d05a05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:05.103504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:27:05.103747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:27:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:27:05.215850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab253b5f-f07b-423e-b394-9a45e1d05a05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:05.224229 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab253b5f-f07b-423e-b394-9a45e1d05a05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:05.225724 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab253b5f-f07b-423e-b394-9a45e1d05a05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:05.226891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab253b5f-f07b-423e-b394-9a45e1d05a05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154980 Jun 20 07:27:05.227447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 657/1421] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:05 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:05.978360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-491b7159-67a9-4940-96c9-8a2e66c68481 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:05.979288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-491b7159-67a9-4940-96c9-8a2e66c68481 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:05.985949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-491b7159-67a9-4940-96c9-8a2e66c68481 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:05.986347 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-491b7159-67a9-4940-96c9-8a2e66c68481 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:05.987110 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-491b7159-67a9-4940-96c9-8a2e66c68481 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:05.987547 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-491b7159-67a9-4940-96c9-8a2e66c68481 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:06.022176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-491b7159-67a9-4940-96c9-8a2e66c68481 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048283 Jun 20 07:27:06.022723 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 765/1422] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:05 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:06.244895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-893bb144-4871-4289-8f19-cb0f223c1cd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:06.245441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-893bb144-4871-4289-8f19-cb0f223c1cd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:06.251685 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893bb144-4871-4289-8f19-cb0f223c1cd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:06.252135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893bb144-4871-4289-8f19-cb0f223c1cd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:06.252897 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893bb144-4871-4289-8f19-cb0f223c1cd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:06.253324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-893bb144-4871-4289-8f19-cb0f223c1cd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:06.381311 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-893bb144-4871-4289-8f19-cb0f223c1cd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:06.389949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-893bb144-4871-4289-8f19-cb0f223c1cd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:06.391441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-893bb144-4871-4289-8f19-cb0f223c1cd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:06.392625 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-893bb144-4871-4289-8f19-cb0f223c1cd8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151658 Jun 20 07:27:06.393184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 658/1423] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:06 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:07.033582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-799072c9-8008-44f0-9501-4e3709afaed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:07.034442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-799072c9-8008-44f0-9501-4e3709afaed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:07.040895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-799072c9-8008-44f0-9501-4e3709afaed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:07.041345 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-799072c9-8008-44f0-9501-4e3709afaed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:07.042108 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-799072c9-8008-44f0-9501-4e3709afaed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:07.042547 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-799072c9-8008-44f0-9501-4e3709afaed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:07.070436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-799072c9-8008-44f0-9501-4e3709afaed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040856 Jun 20 07:27:07.070979 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 766/1424] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:07 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:07.410715 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2146e3ac-1fc2-4d02-a90e-ae634704628f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:07.411247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2146e3ac-1fc2-4d02-a90e-ae634704628f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:07.417691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2146e3ac-1fc2-4d02-a90e-ae634704628f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:07.418142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2146e3ac-1fc2-4d02-a90e-ae634704628f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:07.418898 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2146e3ac-1fc2-4d02-a90e-ae634704628f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:07.419334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2146e3ac-1fc2-4d02-a90e-ae634704628f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:07.551923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2146e3ac-1fc2-4d02-a90e-ae634704628f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:07.561196 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2146e3ac-1fc2-4d02-a90e-ae634704628f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:07.562789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2146e3ac-1fc2-4d02-a90e-ae634704628f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:07.564041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2146e3ac-1fc2-4d02-a90e-ae634704628f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157262 Jun 20 07:27:07.564707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 659/1425] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:07 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:08.081962 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2847efce-980c-4bfc-ab10-a986b8f240b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:08.082931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2847efce-980c-4bfc-ab10-a986b8f240b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:08.089938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2847efce-980c-4bfc-ab10-a986b8f240b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:08.090391 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2847efce-980c-4bfc-ab10-a986b8f240b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:08.091159 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2847efce-980c-4bfc-ab10-a986b8f240b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:08.091597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2847efce-980c-4bfc-ab10-a986b8f240b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:08.107099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:27:08.122234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2847efce-980c-4bfc-ab10-a986b8f240b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044228 Jun 20 07:27:08.122780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 767/1426] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:08 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:08.583101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-de389188-071c-4c15-8099-4901cfc2aefe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:08.584367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-de389188-071c-4c15-8099-4901cfc2aefe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:08.590816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de389188-071c-4c15-8099-4901cfc2aefe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:08.591261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de389188-071c-4c15-8099-4901cfc2aefe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:08.592016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de389188-071c-4c15-8099-4901cfc2aefe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:08.592474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-de389188-071c-4c15-8099-4901cfc2aefe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:08.724259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-de389188-071c-4c15-8099-4901cfc2aefe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:08.732496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-de389188-071c-4c15-8099-4901cfc2aefe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:08.734018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-de389188-071c-4c15-8099-4901cfc2aefe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:08.735164 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-de389188-071c-4c15-8099-4901cfc2aefe tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155978 Jun 20 07:27:08.735717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 660/1427] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:08 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:09.133778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f89a2e96-777b-4819-8c7e-e8f9a08dddab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:09.134616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f89a2e96-777b-4819-8c7e-e8f9a08dddab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:09.141138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f89a2e96-777b-4819-8c7e-e8f9a08dddab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:09.141591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f89a2e96-777b-4819-8c7e-e8f9a08dddab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:09.142357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f89a2e96-777b-4819-8c7e-e8f9a08dddab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:09.142797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f89a2e96-777b-4819-8c7e-e8f9a08dddab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:09.171037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f89a2e96-777b-4819-8c7e-e8f9a08dddab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042129 Jun 20 07:27:09.171574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 768/1428] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:09 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:09.753912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-899d6d7d-93ef-495f-ae9a-d0155d13ecee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:09.754560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-899d6d7d-93ef-495f-ae9a-d0155d13ecee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:09.761300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-899d6d7d-93ef-495f-ae9a-d0155d13ecee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:09.761748 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-899d6d7d-93ef-495f-ae9a-d0155d13ecee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:09.762507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-899d6d7d-93ef-495f-ae9a-d0155d13ecee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:09.762944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-899d6d7d-93ef-495f-ae9a-d0155d13ecee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:09.891285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-899d6d7d-93ef-495f-ae9a-d0155d13ecee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:09.900206 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-899d6d7d-93ef-495f-ae9a-d0155d13ecee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:09.901703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-899d6d7d-93ef-495f-ae9a-d0155d13ecee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:09.902858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-899d6d7d-93ef-495f-ae9a-d0155d13ecee tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152817 Jun 20 07:27:09.903409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 661/1429] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:09 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:10.182716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0d920f33-5ea2-4705-b2b3-1bbab392f39c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:10.183559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0d920f33-5ea2-4705-b2b3-1bbab392f39c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:10.189989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d920f33-5ea2-4705-b2b3-1bbab392f39c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:10.190432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d920f33-5ea2-4705-b2b3-1bbab392f39c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:10.191188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d920f33-5ea2-4705-b2b3-1bbab392f39c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:10.191621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d920f33-5ea2-4705-b2b3-1bbab392f39c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:10.220308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0d920f33-5ea2-4705-b2b3-1bbab392f39c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041618 Jun 20 07:27:10.220846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 769/1430] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:10 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:10.920963 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-426ca4e7-66cd-404d-882c-703cd873c68c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:10.921604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-426ca4e7-66cd-404d-882c-703cd873c68c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:10.923889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:27:10.930020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-426ca4e7-66cd-404d-882c-703cd873c68c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:10.930477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-426ca4e7-66cd-404d-882c-703cd873c68c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:10.931245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-426ca4e7-66cd-404d-882c-703cd873c68c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:10.931681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-426ca4e7-66cd-404d-882c-703cd873c68c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:11.062319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-426ca4e7-66cd-404d-882c-703cd873c68c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:11.064625 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:27:11.072651 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-426ca4e7-66cd-404d-882c-703cd873c68c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:11.074151 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-426ca4e7-66cd-404d-882c-703cd873c68c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:11.075309 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-426ca4e7-66cd-404d-882c-703cd873c68c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.158230 Jun 20 07:27:11.075866 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 662/1431] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:10 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:11.230970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d0ddb916-5f30-4d6c-8d07-90372275eef0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:11.231829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d0ddb916-5f30-4d6c-8d07-90372275eef0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:11.238434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0ddb916-5f30-4d6c-8d07-90372275eef0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:11.238884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0ddb916-5f30-4d6c-8d07-90372275eef0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:11.240166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0ddb916-5f30-4d6c-8d07-90372275eef0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:11.240607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d0ddb916-5f30-4d6c-8d07-90372275eef0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:11.269255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d0ddb916-5f30-4d6c-8d07-90372275eef0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042342 Jun 20 07:27:11.269797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 770/1432] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:11 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:12.093689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6e9c9804-2b6e-41f4-9586-b641f0640bb2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:12.094310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6e9c9804-2b6e-41f4-9586-b641f0640bb2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:12.101631 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e9c9804-2b6e-41f4-9586-b641f0640bb2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:12.102081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e9c9804-2b6e-41f4-9586-b641f0640bb2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:12.102846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e9c9804-2b6e-41f4-9586-b641f0640bb2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:12.103315 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e9c9804-2b6e-41f4-9586-b641f0640bb2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:12.228996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6e9c9804-2b6e-41f4-9586-b641f0640bb2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:12.237226 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6e9c9804-2b6e-41f4-9586-b641f0640bb2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:12.238722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6e9c9804-2b6e-41f4-9586-b641f0640bb2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:12.239887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6e9c9804-2b6e-41f4-9586-b641f0640bb2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150257 Jun 20 07:27:12.240508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 663/1433] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:12 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:12.280657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-152d5962-4eff-4117-88f8-f1f0ccc625d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:12.281557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-152d5962-4eff-4117-88f8-f1f0ccc625d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:12.283931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=58 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:27:12.289378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-152d5962-4eff-4117-88f8-f1f0ccc625d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:12.289828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-152d5962-4eff-4117-88f8-f1f0ccc625d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:12.290599 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-152d5962-4eff-4117-88f8-f1f0ccc625d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:12.291038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-152d5962-4eff-4117-88f8-f1f0ccc625d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:12.319692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-152d5962-4eff-4117-88f8-f1f0ccc625d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042979 Jun 20 07:27:12.320254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 771/1434] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:12 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:12.553849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:27:12.554034 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:27:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:27:13.258466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cbf0730f-185e-4385-ab77-2b61d5f72a59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:13.259107 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cbf0730f-185e-4385-ab77-2b61d5f72a59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:13.265612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbf0730f-185e-4385-ab77-2b61d5f72a59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:13.266062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbf0730f-185e-4385-ab77-2b61d5f72a59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:13.266818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbf0730f-185e-4385-ab77-2b61d5f72a59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:13.267254 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbf0730f-185e-4385-ab77-2b61d5f72a59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:13.330363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-665e938c-29c1-43a9-ba85-71b3a5b5ae5f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:13.331373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-665e938c-29c1-43a9-ba85-71b3a5b5ae5f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:13.338210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-665e938c-29c1-43a9-ba85-71b3a5b5ae5f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:13.338663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-665e938c-29c1-43a9-ba85-71b3a5b5ae5f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:13.339432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-665e938c-29c1-43a9-ba85-71b3a5b5ae5f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:13.339867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-665e938c-29c1-43a9-ba85-71b3a5b5ae5f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:13.369310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-665e938c-29c1-43a9-ba85-71b3a5b5ae5f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042816 Jun 20 07:27:13.369873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 772/1435] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:13 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:27:13.398101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cbf0730f-185e-4385-ab77-2b61d5f72a59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:13.406634 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cbf0730f-185e-4385-ab77-2b61d5f72a59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:13.408127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cbf0730f-185e-4385-ab77-2b61d5f72a59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:13.409430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cbf0730f-185e-4385-ab77-2b61d5f72a59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155091 Jun 20 07:27:13.409976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 664/1436] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:13 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:14.379967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-549ba139-eacb-42a2-baed-d3e7a448b66d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:14.381589 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-549ba139-eacb-42a2-baed-d3e7a448b66d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:14.388292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-549ba139-eacb-42a2-baed-d3e7a448b66d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:14.388736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-549ba139-eacb-42a2-baed-d3e7a448b66d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:14.389482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-549ba139-eacb-42a2-baed-d3e7a448b66d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:14.389922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-549ba139-eacb-42a2-baed-d3e7a448b66d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:14.417788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-549ba139-eacb-42a2-baed-d3e7a448b66d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041752 Jun 20 07:27:14.418319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 773/1437] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:14 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:14.428327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c7395977-d9b8-4b40-93f6-95a32523d666 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:14.428952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c7395977-d9b8-4b40-93f6-95a32523d666 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:14.435367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7395977-d9b8-4b40-93f6-95a32523d666 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:14.435823 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7395977-d9b8-4b40-93f6-95a32523d666 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:14.436624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7395977-d9b8-4b40-93f6-95a32523d666 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:14.437066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c7395977-d9b8-4b40-93f6-95a32523d666 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:14.561784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c7395977-d9b8-4b40-93f6-95a32523d666 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:14.570124 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c7395977-d9b8-4b40-93f6-95a32523d666 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:14.571671 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c7395977-d9b8-4b40-93f6-95a32523d666 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:14.572879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c7395977-d9b8-4b40-93f6-95a32523d666 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149188 Jun 20 07:27:14.573435 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 665/1438] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:14 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:15.429388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2ee1147d-c4c2-4bc3-9498-51e099f4ff13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:15.430220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2ee1147d-c4c2-4bc3-9498-51e099f4ff13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:15.436747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ee1147d-c4c2-4bc3-9498-51e099f4ff13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:15.437188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ee1147d-c4c2-4bc3-9498-51e099f4ff13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:15.437937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ee1147d-c4c2-4bc3-9498-51e099f4ff13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:15.438362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ee1147d-c4c2-4bc3-9498-51e099f4ff13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:15.467109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2ee1147d-c4c2-4bc3-9498-51e099f4ff13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041839 Jun 20 07:27:15.467645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 774/1439] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:15 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:15.591586 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a3cddb1f-6f2a-4aee-b0a2-d9668005d9fa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:15.592230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a3cddb1f-6f2a-4aee-b0a2-d9668005d9fa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:15.598677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3cddb1f-6f2a-4aee-b0a2-d9668005d9fa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:15.599124 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3cddb1f-6f2a-4aee-b0a2-d9668005d9fa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:15.599881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3cddb1f-6f2a-4aee-b0a2-d9668005d9fa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:15.600349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3cddb1f-6f2a-4aee-b0a2-d9668005d9fa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:15.732763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a3cddb1f-6f2a-4aee-b0a2-d9668005d9fa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:15.741800 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a3cddb1f-6f2a-4aee-b0a2-d9668005d9fa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:15.743305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a3cddb1f-6f2a-4aee-b0a2-d9668005d9fa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:15.744510 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a3cddb1f-6f2a-4aee-b0a2-d9668005d9fa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.156779 Jun 20 07:27:15.745072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 666/1440] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:15 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:16.478987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0191bbb5-9c09-48b9-8e48-1643b6aaf8e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:16.479893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0191bbb5-9c09-48b9-8e48-1643b6aaf8e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:16.486324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0191bbb5-9c09-48b9-8e48-1643b6aaf8e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:16.486710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0191bbb5-9c09-48b9-8e48-1643b6aaf8e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:16.487490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0191bbb5-9c09-48b9-8e48-1643b6aaf8e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:16.487919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0191bbb5-9c09-48b9-8e48-1643b6aaf8e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:16.515903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0191bbb5-9c09-48b9-8e48-1643b6aaf8e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040828 Jun 20 07:27:16.516475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 775/1441] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:16 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:16.763846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6568c7c2-fa33-47b5-840f-02c720c5fb26 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:16.764495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6568c7c2-fa33-47b5-840f-02c720c5fb26 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:16.771692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6568c7c2-fa33-47b5-840f-02c720c5fb26 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:16.772166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6568c7c2-fa33-47b5-840f-02c720c5fb26 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:16.772931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6568c7c2-fa33-47b5-840f-02c720c5fb26 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:16.773373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6568c7c2-fa33-47b5-840f-02c720c5fb26 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:16.902622 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6568c7c2-fa33-47b5-840f-02c720c5fb26 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:16.910893 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6568c7c2-fa33-47b5-840f-02c720c5fb26 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:16.912428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6568c7c2-fa33-47b5-840f-02c720c5fb26 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:16.913678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6568c7c2-fa33-47b5-840f-02c720c5fb26 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153738 Jun 20 07:27:16.914236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 667/1442] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:16 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:17.526878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-71472c2d-1b8f-4fe6-aa68-4d150518b2b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:17.527804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-71472c2d-1b8f-4fe6-aa68-4d150518b2b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:17.534105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71472c2d-1b8f-4fe6-aa68-4d150518b2b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:17.534548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71472c2d-1b8f-4fe6-aa68-4d150518b2b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:17.535300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71472c2d-1b8f-4fe6-aa68-4d150518b2b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:17.535731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71472c2d-1b8f-4fe6-aa68-4d150518b2b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:17.566608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-71472c2d-1b8f-4fe6-aa68-4d150518b2b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043632 Jun 20 07:27:17.567168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 776/1443] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:17 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:17.932276 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4eb9b12a-ac27-479a-86da-af2575e70c40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:17.932827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4eb9b12a-ac27-479a-86da-af2575e70c40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:17.939146 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eb9b12a-ac27-479a-86da-af2575e70c40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:17.939595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eb9b12a-ac27-479a-86da-af2575e70c40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:17.940386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eb9b12a-ac27-479a-86da-af2575e70c40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:17.940827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4eb9b12a-ac27-479a-86da-af2575e70c40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:18.066516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4eb9b12a-ac27-479a-86da-af2575e70c40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:18.074782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4eb9b12a-ac27-479a-86da-af2575e70c40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:18.076320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4eb9b12a-ac27-479a-86da-af2575e70c40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:18.077482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4eb9b12a-ac27-479a-86da-af2575e70c40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149262 Jun 20 07:27:18.078037 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 668/1444] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:17 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:18.578565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa3d3f72-2a95-4931-977a-d10bfcfa7255 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:18.579487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aa3d3f72-2a95-4931-977a-d10bfcfa7255 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:18.585960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa3d3f72-2a95-4931-977a-d10bfcfa7255 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:18.586410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa3d3f72-2a95-4931-977a-d10bfcfa7255 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:18.587166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa3d3f72-2a95-4931-977a-d10bfcfa7255 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:18.587603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa3d3f72-2a95-4931-977a-d10bfcfa7255 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:18.615649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aa3d3f72-2a95-4931-977a-d10bfcfa7255 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041046 Jun 20 07:27:18.616206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 777/1445] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:18 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:19.096537 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2a6fd521-0411-4ecb-8ab3-40cb381dbbb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:19.097163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2a6fd521-0411-4ecb-8ab3-40cb381dbbb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:19.104203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a6fd521-0411-4ecb-8ab3-40cb381dbbb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:19.104658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a6fd521-0411-4ecb-8ab3-40cb381dbbb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:19.105422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a6fd521-0411-4ecb-8ab3-40cb381dbbb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:19.105863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a6fd521-0411-4ecb-8ab3-40cb381dbbb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:19.237587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2a6fd521-0411-4ecb-8ab3-40cb381dbbb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:19.246565 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2a6fd521-0411-4ecb-8ab3-40cb381dbbb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:19.248087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2a6fd521-0411-4ecb-8ab3-40cb381dbbb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:19.249289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2a6fd521-0411-4ecb-8ab3-40cb381dbbb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.156691 Jun 20 07:27:19.249803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 669/1446] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:19 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:19.627006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a62190c2-fa7d-456e-8812-8ecd6a0e79a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:19.627850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a62190c2-fa7d-456e-8812-8ecd6a0e79a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:19.635065 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a62190c2-fa7d-456e-8812-8ecd6a0e79a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:19.635512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a62190c2-fa7d-456e-8812-8ecd6a0e79a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:19.636305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a62190c2-fa7d-456e-8812-8ecd6a0e79a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:19.636743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a62190c2-fa7d-456e-8812-8ecd6a0e79a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:19.665045 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a62190c2-fa7d-456e-8812-8ecd6a0e79a5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042034 Jun 20 07:27:19.665583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 778/1447] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:19 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:20.267283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f9471b5a-9331-4bcf-a03f-732251d2a55a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:20.268263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f9471b5a-9331-4bcf-a03f-732251d2a55a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:20.275221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9471b5a-9331-4bcf-a03f-732251d2a55a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:20.275663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9471b5a-9331-4bcf-a03f-732251d2a55a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:20.276437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9471b5a-9331-4bcf-a03f-732251d2a55a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:20.276867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9471b5a-9331-4bcf-a03f-732251d2a55a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:20.403701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f9471b5a-9331-4bcf-a03f-732251d2a55a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:20.412141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f9471b5a-9331-4bcf-a03f-732251d2a55a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:20.413649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f9471b5a-9331-4bcf-a03f-732251d2a55a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:20.414815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f9471b5a-9331-4bcf-a03f-732251d2a55a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151397 Jun 20 07:27:20.415374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 670/1448] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:20 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:20.675923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bc343070-e79b-4795-bf5f-a2119cf036e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:20.676878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bc343070-e79b-4795-bf5f-a2119cf036e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:20.683265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc343070-e79b-4795-bf5f-a2119cf036e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:20.683709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc343070-e79b-4795-bf5f-a2119cf036e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:20.684490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc343070-e79b-4795-bf5f-a2119cf036e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:20.684917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc343070-e79b-4795-bf5f-a2119cf036e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:20.715275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bc343070-e79b-4795-bf5f-a2119cf036e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043287 Jun 20 07:27:20.715853 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 779/1449] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:20 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:21.434004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1f2a9995-6894-4aa8-abe9-30a0cc52870c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:21.434646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1f2a9995-6894-4aa8-abe9-30a0cc52870c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:21.441122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f2a9995-6894-4aa8-abe9-30a0cc52870c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:21.441573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f2a9995-6894-4aa8-abe9-30a0cc52870c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:21.442339 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f2a9995-6894-4aa8-abe9-30a0cc52870c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:21.442775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f2a9995-6894-4aa8-abe9-30a0cc52870c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:21.577213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1f2a9995-6894-4aa8-abe9-30a0cc52870c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:21.586113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1f2a9995-6894-4aa8-abe9-30a0cc52870c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:21.587590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1f2a9995-6894-4aa8-abe9-30a0cc52870c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:21.588764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1f2a9995-6894-4aa8-abe9-30a0cc52870c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.158869 Jun 20 07:27:21.589347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 671/1450] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:21 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:21.727340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0ae48f2e-059b-4413-8f92-5a59be0a125d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:21.728296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0ae48f2e-059b-4413-8f92-5a59be0a125d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:21.734736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ae48f2e-059b-4413-8f92-5a59be0a125d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:21.735192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ae48f2e-059b-4413-8f92-5a59be0a125d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:21.735957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ae48f2e-059b-4413-8f92-5a59be0a125d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:21.736428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ae48f2e-059b-4413-8f92-5a59be0a125d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:21.764778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0ae48f2e-059b-4413-8f92-5a59be0a125d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042091 Jun 20 07:27:21.765325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 780/1451] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:21 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:22.607298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9023ac31-a0a3-4eb7-a476-70e774cb9329 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:22.607945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9023ac31-a0a3-4eb7-a476-70e774cb9329 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:22.614393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9023ac31-a0a3-4eb7-a476-70e774cb9329 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:22.615401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9023ac31-a0a3-4eb7-a476-70e774cb9329 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:22.616177 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9023ac31-a0a3-4eb7-a476-70e774cb9329 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:22.616616 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9023ac31-a0a3-4eb7-a476-70e774cb9329 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:22.742546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9023ac31-a0a3-4eb7-a476-70e774cb9329 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:22.750872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9023ac31-a0a3-4eb7-a476-70e774cb9329 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:22.752438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9023ac31-a0a3-4eb7-a476-70e774cb9329 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:22.753584 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9023ac31-a0a3-4eb7-a476-70e774cb9329 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150265 Jun 20 07:27:22.754138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 672/1452] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:22.776350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3c0c06ad-04dc-45b6-8ede-1a4f1f947242 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:22.777221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3c0c06ad-04dc-45b6-8ede-1a4f1f947242 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:22.783527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c0c06ad-04dc-45b6-8ede-1a4f1f947242 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:22.783971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c0c06ad-04dc-45b6-8ede-1a4f1f947242 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:22.784765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c0c06ad-04dc-45b6-8ede-1a4f1f947242 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:22.785197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3c0c06ad-04dc-45b6-8ede-1a4f1f947242 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:22.813984 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3c0c06ad-04dc-45b6-8ede-1a4f1f947242 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041681 Jun 20 07:27:22.814525 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 781/1453] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:22 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:23.772444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-003c0c90-238a-4f60-a50b-c885f42a4f4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:23.773095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-003c0c90-238a-4f60-a50b-c885f42a4f4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:23.779532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-003c0c90-238a-4f60-a50b-c885f42a4f4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:23.779985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-003c0c90-238a-4f60-a50b-c885f42a4f4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:23.780773 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-003c0c90-238a-4f60-a50b-c885f42a4f4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:23.781215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-003c0c90-238a-4f60-a50b-c885f42a4f4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:23.825628 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a48ba8d5-c8e2-4cfa-bfe3-dfcbc09d3c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:23.826542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a48ba8d5-c8e2-4cfa-bfe3-dfcbc09d3c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:23.833046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a48ba8d5-c8e2-4cfa-bfe3-dfcbc09d3c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:23.833515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a48ba8d5-c8e2-4cfa-bfe3-dfcbc09d3c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:23.834274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a48ba8d5-c8e2-4cfa-bfe3-dfcbc09d3c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:23.834701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a48ba8d5-c8e2-4cfa-bfe3-dfcbc09d3c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:23.862792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a48ba8d5-c8e2-4cfa-bfe3-dfcbc09d3c27 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041172 Jun 20 07:27:23.863352 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 782/1454] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:23 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:27:23.911446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-003c0c90-238a-4f60-a50b-c885f42a4f4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:23.919756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-003c0c90-238a-4f60-a50b-c885f42a4f4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:23.921332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-003c0c90-238a-4f60-a50b-c885f42a4f4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:23.922503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-003c0c90-238a-4f60-a50b-c885f42a4f4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154065 Jun 20 07:27:23.923061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 673/1455] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:23 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:24.874870 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0cb73c45-5f33-4248-a898-361e99f08f6f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:24.875705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0cb73c45-5f33-4248-a898-361e99f08f6f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:24.882114 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cb73c45-5f33-4248-a898-361e99f08f6f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:24.882825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cb73c45-5f33-4248-a898-361e99f08f6f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:24.883589 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cb73c45-5f33-4248-a898-361e99f08f6f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:24.884004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cb73c45-5f33-4248-a898-361e99f08f6f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:24.912718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0cb73c45-5f33-4248-a898-361e99f08f6f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041850 Jun 20 07:27:24.913271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 783/1456] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:24 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:24.941212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7a9464eb-1375-47d8-91c6-c47b0c000b1d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:24.941828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7a9464eb-1375-47d8-91c6-c47b0c000b1d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:24.948285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a9464eb-1375-47d8-91c6-c47b0c000b1d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:24.948733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a9464eb-1375-47d8-91c6-c47b0c000b1d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:24.949486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a9464eb-1375-47d8-91c6-c47b0c000b1d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:24.949920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a9464eb-1375-47d8-91c6-c47b0c000b1d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:25.077212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7a9464eb-1375-47d8-91c6-c47b0c000b1d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:25.085533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7a9464eb-1375-47d8-91c6-c47b0c000b1d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:25.087039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7a9464eb-1375-47d8-91c6-c47b0c000b1d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:25.088229 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7a9464eb-1375-47d8-91c6-c47b0c000b1d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150836 Jun 20 07:27:25.088791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 674/1457] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:24 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:25.924405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c30d8c20-a1f0-41fe-8797-f29e6f4caabd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:25.925338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c30d8c20-a1f0-41fe-8797-f29e6f4caabd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:25.932522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c30d8c20-a1f0-41fe-8797-f29e6f4caabd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:25.933000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c30d8c20-a1f0-41fe-8797-f29e6f4caabd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:25.933763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c30d8c20-a1f0-41fe-8797-f29e6f4caabd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:25.934195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c30d8c20-a1f0-41fe-8797-f29e6f4caabd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:25.936502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:27:25.962540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c30d8c20-a1f0-41fe-8797-f29e6f4caabd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042197 Jun 20 07:27:25.963092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 784/1458] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:25 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:26.106729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-90f5fbc9-e7fb-497a-acea-fa4fff24b9b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:26.107370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-90f5fbc9-e7fb-497a-acea-fa4fff24b9b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:26.113893 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-90f5fbc9-e7fb-497a-acea-fa4fff24b9b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:26.114343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-90f5fbc9-e7fb-497a-acea-fa4fff24b9b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:26.115102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-90f5fbc9-e7fb-497a-acea-fa4fff24b9b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:26.115536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-90f5fbc9-e7fb-497a-acea-fa4fff24b9b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:26.239958 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-90f5fbc9-e7fb-497a-acea-fa4fff24b9b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:26.248232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-90f5fbc9-e7fb-497a-acea-fa4fff24b9b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:26.249724 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-90f5fbc9-e7fb-497a-acea-fa4fff24b9b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:26.250879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-90f5fbc9-e7fb-497a-acea-fa4fff24b9b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.148096 Jun 20 07:27:26.251432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 675/1459] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:26 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:26.973166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e6a617f-7277-4321-9506-f547445f3f8f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:26.974617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e6a617f-7277-4321-9506-f547445f3f8f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:26.981005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e6a617f-7277-4321-9506-f547445f3f8f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:26.981448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e6a617f-7277-4321-9506-f547445f3f8f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:26.982194 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e6a617f-7277-4321-9506-f547445f3f8f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:26.982623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e6a617f-7277-4321-9506-f547445f3f8f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:27.010441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e6a617f-7277-4321-9506-f547445f3f8f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041298 Jun 20 07:27:27.010987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 785/1460] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:26 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:27.269656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fbe3b1cf-5082-467f-b44e-21e56aaeccdc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:27.270281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fbe3b1cf-5082-467f-b44e-21e56aaeccdc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:27.276917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbe3b1cf-5082-467f-b44e-21e56aaeccdc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:27.277371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbe3b1cf-5082-467f-b44e-21e56aaeccdc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:27.278140 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbe3b1cf-5082-467f-b44e-21e56aaeccdc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:27.278587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbe3b1cf-5082-467f-b44e-21e56aaeccdc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:27.408774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fbe3b1cf-5082-467f-b44e-21e56aaeccdc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:27.417543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fbe3b1cf-5082-467f-b44e-21e56aaeccdc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:27.419040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fbe3b1cf-5082-467f-b44e-21e56aaeccdc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:27.420223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fbe3b1cf-5082-467f-b44e-21e56aaeccdc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154490 Jun 20 07:27:27.420774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 676/1461] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:27 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:28.022059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8424f9b6-fac2-4ae4-87a7-a0fe45b46018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:28.022987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8424f9b6-fac2-4ae4-87a7-a0fe45b46018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:28.029531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8424f9b6-fac2-4ae4-87a7-a0fe45b46018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:28.029983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8424f9b6-fac2-4ae4-87a7-a0fe45b46018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:28.030744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8424f9b6-fac2-4ae4-87a7-a0fe45b46018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:28.031178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8424f9b6-fac2-4ae4-87a7-a0fe45b46018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:28.060127 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8424f9b6-fac2-4ae4-87a7-a0fe45b46018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042073 Jun 20 07:27:28.060678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 786/1462] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:28 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:27:28.438685 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a6dcf608-e2f4-4659-8d58-5eafdbd469dc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:28.439221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a6dcf608-e2f4-4659-8d58-5eafdbd469dc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:28.445603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6dcf608-e2f4-4659-8d58-5eafdbd469dc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:28.446040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6dcf608-e2f4-4659-8d58-5eafdbd469dc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:28.446788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6dcf608-e2f4-4659-8d58-5eafdbd469dc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:28.447219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6dcf608-e2f4-4659-8d58-5eafdbd469dc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:28.574624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6dcf608-e2f4-4659-8d58-5eafdbd469dc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:28.582998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6dcf608-e2f4-4659-8d58-5eafdbd469dc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:28.584545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6dcf608-e2f4-4659-8d58-5eafdbd469dc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:28.585706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a6dcf608-e2f4-4659-8d58-5eafdbd469dc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150972 Jun 20 07:27:28.586267 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 677/1463] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:28 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:29.071606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-26e1ee51-8a2c-4aaf-be0b-b09402abb479 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:29.072547 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-26e1ee51-8a2c-4aaf-be0b-b09402abb479 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:29.078954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-26e1ee51-8a2c-4aaf-be0b-b09402abb479 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:29.079402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-26e1ee51-8a2c-4aaf-be0b-b09402abb479 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:29.080185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-26e1ee51-8a2c-4aaf-be0b-b09402abb479 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:29.080624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-26e1ee51-8a2c-4aaf-be0b-b09402abb479 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:29.109379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-26e1ee51-8a2c-4aaf-be0b-b09402abb479 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041759 Jun 20 07:27:29.109924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 787/1464] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:29 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:29.604070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aac3892f-7dbb-4a45-ab83-62687aed4e60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:29.604700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aac3892f-7dbb-4a45-ab83-62687aed4e60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:29.611144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aac3892f-7dbb-4a45-ab83-62687aed4e60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:29.611590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aac3892f-7dbb-4a45-ab83-62687aed4e60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:29.612369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aac3892f-7dbb-4a45-ab83-62687aed4e60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:29.612804 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aac3892f-7dbb-4a45-ab83-62687aed4e60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:29.749591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aac3892f-7dbb-4a45-ab83-62687aed4e60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:29.758806 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aac3892f-7dbb-4a45-ab83-62687aed4e60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:29.760339 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aac3892f-7dbb-4a45-ab83-62687aed4e60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:29.761500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aac3892f-7dbb-4a45-ab83-62687aed4e60 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.161360 Jun 20 07:27:29.762310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 678/1465] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:29 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:30.120964 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ddc8f3a3-b974-4a2c-9592-49ec08e66781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:30.121918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ddc8f3a3-b974-4a2c-9592-49ec08e66781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:30.128669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddc8f3a3-b974-4a2c-9592-49ec08e66781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:30.129120 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddc8f3a3-b974-4a2c-9592-49ec08e66781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:30.129910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddc8f3a3-b974-4a2c-9592-49ec08e66781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:30.130349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddc8f3a3-b974-4a2c-9592-49ec08e66781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:30.160304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ddc8f3a3-b974-4a2c-9592-49ec08e66781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043278 Jun 20 07:27:30.160861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 788/1466] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:30 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:30.782253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8d63c6ce-b329-4713-bc47-366b95b1dab3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:30.782878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8d63c6ce-b329-4713-bc47-366b95b1dab3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:30.789322 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d63c6ce-b329-4713-bc47-366b95b1dab3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:30.789782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d63c6ce-b329-4713-bc47-366b95b1dab3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:30.790548 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d63c6ce-b329-4713-bc47-366b95b1dab3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:30.790989 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d63c6ce-b329-4713-bc47-366b95b1dab3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:30.806000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:27:30.920452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d63c6ce-b329-4713-bc47-366b95b1dab3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:30.929292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d63c6ce-b329-4713-bc47-366b95b1dab3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:30.930773 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d63c6ce-b329-4713-bc47-366b95b1dab3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:30.931922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8d63c6ce-b329-4713-bc47-366b95b1dab3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153593 Jun 20 07:27:30.932535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 679/1467] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:30 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:31.172325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a9750bc3-9ca5-483d-9abc-f0304bef9695 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:31.173256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a9750bc3-9ca5-483d-9abc-f0304bef9695 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:31.180362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9750bc3-9ca5-483d-9abc-f0304bef9695 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:31.180816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9750bc3-9ca5-483d-9abc-f0304bef9695 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:31.181585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9750bc3-9ca5-483d-9abc-f0304bef9695 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:31.182025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a9750bc3-9ca5-483d-9abc-f0304bef9695 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:31.209656 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a9750bc3-9ca5-483d-9abc-f0304bef9695 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041330 Jun 20 07:27:31.210191 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 789/1468] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:31 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:31.950488 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2de25c7a-649b-4bdd-908f-63c22c727ca2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:31.951124 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2de25c7a-649b-4bdd-908f-63c22c727ca2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:31.957480 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2de25c7a-649b-4bdd-908f-63c22c727ca2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:31.957972 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2de25c7a-649b-4bdd-908f-63c22c727ca2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:31.958675 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2de25c7a-649b-4bdd-908f-63c22c727ca2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:31.959100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2de25c7a-649b-4bdd-908f-63c22c727ca2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:32.084225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2de25c7a-649b-4bdd-908f-63c22c727ca2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:32.092400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2de25c7a-649b-4bdd-908f-63c22c727ca2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:32.093881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2de25c7a-649b-4bdd-908f-63c22c727ca2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:32.095029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2de25c7a-649b-4bdd-908f-63c22c727ca2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.148489 Jun 20 07:27:32.095584 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 680/1469] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:31 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:32.221072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eabcb6a5-71e0-4296-a6eb-5287dcacbf5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:32.221928 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eabcb6a5-71e0-4296-a6eb-5287dcacbf5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:32.228377 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eabcb6a5-71e0-4296-a6eb-5287dcacbf5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:32.228832 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eabcb6a5-71e0-4296-a6eb-5287dcacbf5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:32.229588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eabcb6a5-71e0-4296-a6eb-5287dcacbf5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:32.230023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eabcb6a5-71e0-4296-a6eb-5287dcacbf5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:32.259143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eabcb6a5-71e0-4296-a6eb-5287dcacbf5b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042017 Jun 20 07:27:32.259688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 790/1470] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:32 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:33.113997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2a630b28-32c0-4387-b815-7c8ec9b0902a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:33.114539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2a630b28-32c0-4387-b815-7c8ec9b0902a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:33.120992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a630b28-32c0-4387-b815-7c8ec9b0902a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:33.121447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a630b28-32c0-4387-b815-7c8ec9b0902a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:33.122205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a630b28-32c0-4387-b815-7c8ec9b0902a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:33.122642 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a630b28-32c0-4387-b815-7c8ec9b0902a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:33.252965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2a630b28-32c0-4387-b815-7c8ec9b0902a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:33.262324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2a630b28-32c0-4387-b815-7c8ec9b0902a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:33.263802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2a630b28-32c0-4387-b815-7c8ec9b0902a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:33.264989 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2a630b28-32c0-4387-b815-7c8ec9b0902a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155033 Jun 20 07:27:33.265927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 681/1471] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:33 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:33.271728 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-94f19891-645f-426a-af8d-0c883d435e44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:33.272682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-94f19891-645f-426a-af8d-0c883d435e44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:33.279044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94f19891-645f-426a-af8d-0c883d435e44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:33.279493 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94f19891-645f-426a-af8d-0c883d435e44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:33.280332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94f19891-645f-426a-af8d-0c883d435e44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:33.280771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94f19891-645f-426a-af8d-0c883d435e44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:33.309354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-94f19891-645f-426a-af8d-0c883d435e44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042178 Jun 20 07:27:33.309921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 791/1472] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:33 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:27:34.283983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c10929cc-929e-463e-a7b9-53f10e0cbbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:34.284785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c10929cc-929e-463e-a7b9-53f10e0cbbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:34.292238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c10929cc-929e-463e-a7b9-53f10e0cbbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:34.292693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c10929cc-929e-463e-a7b9-53f10e0cbbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:34.293460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c10929cc-929e-463e-a7b9-53f10e0cbbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:34.293902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c10929cc-929e-463e-a7b9-53f10e0cbbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:34.320892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b40cca6-df0f-49e3-8ef1-abfce13b8f62 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:34.321835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6b40cca6-df0f-49e3-8ef1-abfce13b8f62 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:34.328054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b40cca6-df0f-49e3-8ef1-abfce13b8f62 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:34.328543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b40cca6-df0f-49e3-8ef1-abfce13b8f62 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:34.329313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b40cca6-df0f-49e3-8ef1-abfce13b8f62 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:34.329751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b40cca6-df0f-49e3-8ef1-abfce13b8f62 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:34.359494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6b40cca6-df0f-49e3-8ef1-abfce13b8f62 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042571 Jun 20 07:27:34.360058 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 792/1473] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:27:34.419757 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c10929cc-929e-463e-a7b9-53f10e0cbbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:34.428182 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c10929cc-929e-463e-a7b9-53f10e0cbbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:34.429718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c10929cc-929e-463e-a7b9-53f10e0cbbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:34.430876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c10929cc-929e-463e-a7b9-53f10e0cbbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150818 Jun 20 07:27:34.431442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 682/1474] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:34 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:35.371220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7afd1672-b5a8-4cf6-be3c-05ffc8282207 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:35.372150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7afd1672-b5a8-4cf6-be3c-05ffc8282207 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:35.378477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7afd1672-b5a8-4cf6-be3c-05ffc8282207 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:35.379176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7afd1672-b5a8-4cf6-be3c-05ffc8282207 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:35.379931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7afd1672-b5a8-4cf6-be3c-05ffc8282207 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:35.380380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7afd1672-b5a8-4cf6-be3c-05ffc8282207 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:35.408272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7afd1672-b5a8-4cf6-be3c-05ffc8282207 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040937 Jun 20 07:27:35.408806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 793/1475] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:35 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:35.449162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-40bc5075-a18e-4de1-904b-3f6dcfd9e140 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:35.449793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-40bc5075-a18e-4de1-904b-3f6dcfd9e140 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:35.456308 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40bc5075-a18e-4de1-904b-3f6dcfd9e140 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:35.456757 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40bc5075-a18e-4de1-904b-3f6dcfd9e140 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:35.457509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40bc5075-a18e-4de1-904b-3f6dcfd9e140 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:35.457942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40bc5075-a18e-4de1-904b-3f6dcfd9e140 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:35.589055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-40bc5075-a18e-4de1-904b-3f6dcfd9e140 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:35.597359 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-40bc5075-a18e-4de1-904b-3f6dcfd9e140 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:35.599417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-40bc5075-a18e-4de1-904b-3f6dcfd9e140 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:35.600595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-40bc5075-a18e-4de1-904b-3f6dcfd9e140 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155418 Jun 20 07:27:35.601150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 683/1476] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:35 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:36.420284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0e9770ab-250d-4cb0-918c-60dab88e7f2c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:36.421491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0e9770ab-250d-4cb0-918c-60dab88e7f2c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:36.428779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e9770ab-250d-4cb0-918c-60dab88e7f2c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:36.429232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e9770ab-250d-4cb0-918c-60dab88e7f2c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:36.430000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e9770ab-250d-4cb0-918c-60dab88e7f2c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:36.430438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e9770ab-250d-4cb0-918c-60dab88e7f2c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:36.459504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0e9770ab-250d-4cb0-918c-60dab88e7f2c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Jun 20 07:27:36.460049 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 794/1477] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:36 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:36.619019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef21207d-68c7-482c-b09a-b3771c810f13 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:36.619559 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ef21207d-68c7-482c-b09a-b3771c810f13 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:36.626274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef21207d-68c7-482c-b09a-b3771c810f13 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:36.626726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef21207d-68c7-482c-b09a-b3771c810f13 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:36.627490 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef21207d-68c7-482c-b09a-b3771c810f13 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:36.627936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef21207d-68c7-482c-b09a-b3771c810f13 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:36.769608 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ef21207d-68c7-482c-b09a-b3771c810f13 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:36.777948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ef21207d-68c7-482c-b09a-b3771c810f13 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:36.779444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ef21207d-68c7-482c-b09a-b3771c810f13 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:36.780635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ef21207d-68c7-482c-b09a-b3771c810f13 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.165616 Jun 20 07:27:36.781225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 684/1478] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:36 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:37.470958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-993c13d1-d53b-455e-8c8d-b2ce0c42a953 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:37.471795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-993c13d1-d53b-455e-8c8d-b2ce0c42a953 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:37.478922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-993c13d1-d53b-455e-8c8d-b2ce0c42a953 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:37.479371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-993c13d1-d53b-455e-8c8d-b2ce0c42a953 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:37.480153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-993c13d1-d53b-455e-8c8d-b2ce0c42a953 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:37.480591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-993c13d1-d53b-455e-8c8d-b2ce0c42a953 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:37.508999 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-993c13d1-d53b-455e-8c8d-b2ce0c42a953 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042075 Jun 20 07:27:37.509548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 795/1479] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:37 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:37.799127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a983db3d-4ed1-47ff-86ae-e554c61e37b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:37.799747 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a983db3d-4ed1-47ff-86ae-e554c61e37b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:37.806927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a983db3d-4ed1-47ff-86ae-e554c61e37b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:37.807402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a983db3d-4ed1-47ff-86ae-e554c61e37b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:37.808185 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a983db3d-4ed1-47ff-86ae-e554c61e37b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:37.808629 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a983db3d-4ed1-47ff-86ae-e554c61e37b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:37.938195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a983db3d-4ed1-47ff-86ae-e554c61e37b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:37.946499 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a983db3d-4ed1-47ff-86ae-e554c61e37b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:37.948001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a983db3d-4ed1-47ff-86ae-e554c61e37b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:37.949194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a983db3d-4ed1-47ff-86ae-e554c61e37b2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154046 Jun 20 07:27:37.949780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 685/1480] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:37 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:38.520959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4eba49b6-b58e-43be-a6c4-bb8b10921508 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:38.521885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4eba49b6-b58e-43be-a6c4-bb8b10921508 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:38.528379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4eba49b6-b58e-43be-a6c4-bb8b10921508 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:38.528839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4eba49b6-b58e-43be-a6c4-bb8b10921508 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:38.529601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4eba49b6-b58e-43be-a6c4-bb8b10921508 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:38.530038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4eba49b6-b58e-43be-a6c4-bb8b10921508 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:38.560414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4eba49b6-b58e-43be-a6c4-bb8b10921508 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 Jun 20 07:27:38.561519 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 796/1481] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:38 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:38.966919 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f1fd61cf-7820-44e6-96ac-bc970dee2f39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:38.967458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f1fd61cf-7820-44e6-96ac-bc970dee2f39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:38.974101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1fd61cf-7820-44e6-96ac-bc970dee2f39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:38.974563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1fd61cf-7820-44e6-96ac-bc970dee2f39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:38.975328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1fd61cf-7820-44e6-96ac-bc970dee2f39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:38.975771 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1fd61cf-7820-44e6-96ac-bc970dee2f39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:39.100781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f1fd61cf-7820-44e6-96ac-bc970dee2f39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:39.109330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f1fd61cf-7820-44e6-96ac-bc970dee2f39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:39.110873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f1fd61cf-7820-44e6-96ac-bc970dee2f39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:39.112035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f1fd61cf-7820-44e6-96ac-bc970dee2f39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149129 Jun 20 07:27:39.112623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 686/1482] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:38 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:39.572560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a8a3a1f7-8043-48b9-b398-7589c362e147 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:39.573522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a8a3a1f7-8043-48b9-b398-7589c362e147 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:39.586421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8a3a1f7-8043-48b9-b398-7589c362e147 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:39.586874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8a3a1f7-8043-48b9-b398-7589c362e147 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:39.588770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8a3a1f7-8043-48b9-b398-7589c362e147 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:39.589230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8a3a1f7-8043-48b9-b398-7589c362e147 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:39.618660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a8a3a1f7-8043-48b9-b398-7589c362e147 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050225 Jun 20 07:27:39.619211 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 797/1483] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:39 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:40.131800 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4fd3e600-6363-495d-a9b2-a8708dbb70bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:40.132694 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4fd3e600-6363-495d-a9b2-a8708dbb70bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:40.139128 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4fd3e600-6363-495d-a9b2-a8708dbb70bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:40.139578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4fd3e600-6363-495d-a9b2-a8708dbb70bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:40.140383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4fd3e600-6363-495d-a9b2-a8708dbb70bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:40.140820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4fd3e600-6363-495d-a9b2-a8708dbb70bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:40.276887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4fd3e600-6363-495d-a9b2-a8708dbb70bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:40.286787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4fd3e600-6363-495d-a9b2-a8708dbb70bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:40.288313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4fd3e600-6363-495d-a9b2-a8708dbb70bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:40.289553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4fd3e600-6363-495d-a9b2-a8708dbb70bf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.162136 Jun 20 07:27:40.290244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 687/1484] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:40 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:40.630611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f0d3d140-26e4-46ae-885a-d7033f211da1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:40.631546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0d3d140-26e4-46ae-885a-d7033f211da1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:40.638349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0d3d140-26e4-46ae-885a-d7033f211da1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:40.638800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0d3d140-26e4-46ae-885a-d7033f211da1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:40.639558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0d3d140-26e4-46ae-885a-d7033f211da1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:40.639994 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0d3d140-26e4-46ae-885a-d7033f211da1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:40.668287 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f0d3d140-26e4-46ae-885a-d7033f211da1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041554 Jun 20 07:27:40.668831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 798/1485] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:40 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:41.308074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0c3ed5b7-fefa-4e7a-a2ff-264c08519404 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:41.308665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0c3ed5b7-fefa-4e7a-a2ff-264c08519404 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:41.311134 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:27:41.317745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c3ed5b7-fefa-4e7a-a2ff-264c08519404 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:41.318194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c3ed5b7-fefa-4e7a-a2ff-264c08519404 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:41.319125 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c3ed5b7-fefa-4e7a-a2ff-264c08519404 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:41.319600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c3ed5b7-fefa-4e7a-a2ff-264c08519404 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:41.455999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0c3ed5b7-fefa-4e7a-a2ff-264c08519404 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:41.464911 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0c3ed5b7-fefa-4e7a-a2ff-264c08519404 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:41.466413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0c3ed5b7-fefa-4e7a-a2ff-264c08519404 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:41.467572 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0c3ed5b7-fefa-4e7a-a2ff-264c08519404 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.164621 Jun 20 07:27:41.468145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 688/1486] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:41 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:41.679016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-10a13ac5-5e97-49e0-b6b6-c3744df60921 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:41.679852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-10a13ac5-5e97-49e0-b6b6-c3744df60921 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:41.686259 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10a13ac5-5e97-49e0-b6b6-c3744df60921 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:41.686704 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10a13ac5-5e97-49e0-b6b6-c3744df60921 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:41.687456 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10a13ac5-5e97-49e0-b6b6-c3744df60921 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:41.687882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10a13ac5-5e97-49e0-b6b6-c3744df60921 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:41.719224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-10a13ac5-5e97-49e0-b6b6-c3744df60921 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Jun 20 07:27:41.719777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 799/1487] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:42.486637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f45cc6ea-73a7-424c-80ed-7399d1e23a53 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:42.487258 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f45cc6ea-73a7-424c-80ed-7399d1e23a53 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:42.494293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f45cc6ea-73a7-424c-80ed-7399d1e23a53 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:42.494773 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f45cc6ea-73a7-424c-80ed-7399d1e23a53 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:42.495539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f45cc6ea-73a7-424c-80ed-7399d1e23a53 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:42.495980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f45cc6ea-73a7-424c-80ed-7399d1e23a53 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:42.622100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f45cc6ea-73a7-424c-80ed-7399d1e23a53 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:42.631081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f45cc6ea-73a7-424c-80ed-7399d1e23a53 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:42.632873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f45cc6ea-73a7-424c-80ed-7399d1e23a53 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:42.634029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f45cc6ea-73a7-424c-80ed-7399d1e23a53 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151344 Jun 20 07:27:42.634582 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 689/1488] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:42.730602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42e28707-f91a-4647-bc59-e04b729e5125 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:42.731515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-42e28707-f91a-4647-bc59-e04b729e5125 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:42.733796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=58 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:27:42.739586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42e28707-f91a-4647-bc59-e04b729e5125 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:42.740028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42e28707-f91a-4647-bc59-e04b729e5125 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:42.740798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42e28707-f91a-4647-bc59-e04b729e5125 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:42.741224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42e28707-f91a-4647-bc59-e04b729e5125 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:42.765888 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:27:42.770660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-42e28707-f91a-4647-bc59-e04b729e5125 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044015 Jun 20 07:27:42.771199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 800/1489] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:42 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:43.652611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6b77d85b-a14e-4ce5-8957-c629068a3b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:43.653223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6b77d85b-a14e-4ce5-8957-c629068a3b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:43.659786 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b77d85b-a14e-4ce5-8957-c629068a3b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:43.660269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b77d85b-a14e-4ce5-8957-c629068a3b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:43.661544 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b77d85b-a14e-4ce5-8957-c629068a3b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:43.661985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b77d85b-a14e-4ce5-8957-c629068a3b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:43.782564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8aea198b-7d72-4414-8f38-817c82020ed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:43.783565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8aea198b-7d72-4414-8f38-817c82020ed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:43.790670 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8aea198b-7d72-4414-8f38-817c82020ed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:43.791251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8aea198b-7d72-4414-8f38-817c82020ed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:43.792012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8aea198b-7d72-4414-8f38-817c82020ed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:43.792465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8aea198b-7d72-4414-8f38-817c82020ed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:43.792987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6b77d85b-a14e-4ce5-8957-c629068a3b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:43.802121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6b77d85b-a14e-4ce5-8957-c629068a3b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:43.803639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6b77d85b-a14e-4ce5-8957-c629068a3b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:43.804837 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6b77d85b-a14e-4ce5-8957-c629068a3b4d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.156267 Jun 20 07:27:43.805400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 690/1490] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:43 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:43.821008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8aea198b-7d72-4414-8f38-817c82020ed5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042619 Jun 20 07:27:43.821551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 801/1491] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:43 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:44.823325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4afaa45a-8b43-4ed8-880c-9d3d20a85f05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:44.823913 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4afaa45a-8b43-4ed8-880c-9d3d20a85f05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:44.830549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4afaa45a-8b43-4ed8-880c-9d3d20a85f05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:44.830993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4afaa45a-8b43-4ed8-880c-9d3d20a85f05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:44.831746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4afaa45a-8b43-4ed8-880c-9d3d20a85f05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:44.832218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4afaa45a-8b43-4ed8-880c-9d3d20a85f05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:44.832843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-67df7dee-6add-4238-8fd6-ee4842f06448 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:44.833678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-67df7dee-6add-4238-8fd6-ee4842f06448 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:44.839996 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67df7dee-6add-4238-8fd6-ee4842f06448 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:44.840475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67df7dee-6add-4238-8fd6-ee4842f06448 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:44.841235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67df7dee-6add-4238-8fd6-ee4842f06448 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:44.841673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67df7dee-6add-4238-8fd6-ee4842f06448 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:44.870493 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-67df7dee-6add-4238-8fd6-ee4842f06448 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042101 Jun 20 07:27:44.871061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 802/1492] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:27:45.049124 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4afaa45a-8b43-4ed8-880c-9d3d20a85f05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:45.057960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4afaa45a-8b43-4ed8-880c-9d3d20a85f05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:45.059436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4afaa45a-8b43-4ed8-880c-9d3d20a85f05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:45.060650 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4afaa45a-8b43-4ed8-880c-9d3d20a85f05 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.241348 Jun 20 07:27:45.061207 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 691/1493] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:44 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:45.950054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1488016d-017e-46d3-be0e-3c524ef4463d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:45.950972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1488016d-017e-46d3-be0e-3c524ef4463d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:45.956882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1488016d-017e-46d3-be0e-3c524ef4463d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:45.957331 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1488016d-017e-46d3-be0e-3c524ef4463d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:45.958090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1488016d-017e-46d3-be0e-3c524ef4463d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:45.958524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1488016d-017e-46d3-be0e-3c524ef4463d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:45.987514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1488016d-017e-46d3-be0e-3c524ef4463d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109715 Jun 20 07:27:45.988004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 803/1494] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:46.079357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cab1ba14-32c6-46b3-bde6-4e884e9d229a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:46.079965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cab1ba14-32c6-46b3-bde6-4e884e9d229a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:46.086341 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cab1ba14-32c6-46b3-bde6-4e884e9d229a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:46.086784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cab1ba14-32c6-46b3-bde6-4e884e9d229a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:46.087534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cab1ba14-32c6-46b3-bde6-4e884e9d229a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:46.087967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cab1ba14-32c6-46b3-bde6-4e884e9d229a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:46.214239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cab1ba14-32c6-46b3-bde6-4e884e9d229a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:46.222630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cab1ba14-32c6-46b3-bde6-4e884e9d229a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:46.224648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cab1ba14-32c6-46b3-bde6-4e884e9d229a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:46.225816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cab1ba14-32c6-46b3-bde6-4e884e9d229a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150281 Jun 20 07:27:46.226366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 692/1495] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:46 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:46.999595 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8140d6ff-c634-4d3c-9700-33cb11a6eb4d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:47.000682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8140d6ff-c634-4d3c-9700-33cb11a6eb4d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:47.008083 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8140d6ff-c634-4d3c-9700-33cb11a6eb4d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:47.008562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8140d6ff-c634-4d3c-9700-33cb11a6eb4d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:47.009328 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8140d6ff-c634-4d3c-9700-33cb11a6eb4d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:47.009765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8140d6ff-c634-4d3c-9700-33cb11a6eb4d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:47.037326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8140d6ff-c634-4d3c-9700-33cb11a6eb4d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041708 Jun 20 07:27:47.037865 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 804/1496] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:47.250090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d13da5a8-d1a1-4c16-8c5d-b5208104720d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:47.250623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d13da5a8-d1a1-4c16-8c5d-b5208104720d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:47.257981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d13da5a8-d1a1-4c16-8c5d-b5208104720d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:47.258459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d13da5a8-d1a1-4c16-8c5d-b5208104720d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:47.259222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d13da5a8-d1a1-4c16-8c5d-b5208104720d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:47.259663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d13da5a8-d1a1-4c16-8c5d-b5208104720d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:47.387672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d13da5a8-d1a1-4c16-8c5d-b5208104720d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:47.395934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d13da5a8-d1a1-4c16-8c5d-b5208104720d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:47.397467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d13da5a8-d1a1-4c16-8c5d-b5208104720d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:47.398627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d13da5a8-d1a1-4c16-8c5d-b5208104720d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.156615 Jun 20 07:27:47.399195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 693/1497] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:47 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:48.048978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-deb39f0f-2aaf-4ec4-b222-174593a7d657 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:48.049910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-deb39f0f-2aaf-4ec4-b222-174593a7d657 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:48.056397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-deb39f0f-2aaf-4ec4-b222-174593a7d657 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:48.056835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-deb39f0f-2aaf-4ec4-b222-174593a7d657 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:48.057605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-deb39f0f-2aaf-4ec4-b222-174593a7d657 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:48.058039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-deb39f0f-2aaf-4ec4-b222-174593a7d657 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:48.086186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-deb39f0f-2aaf-4ec4-b222-174593a7d657 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041188 Jun 20 07:27:48.086722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 805/1498] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:48 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:48.416948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0235b6f3-d428-4313-a28f-d1c377dd487e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:48.417595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0235b6f3-d428-4313-a28f-d1c377dd487e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:48.424083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0235b6f3-d428-4313-a28f-d1c377dd487e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:48.424555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0235b6f3-d428-4313-a28f-d1c377dd487e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:48.425301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0235b6f3-d428-4313-a28f-d1c377dd487e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:48.425727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0235b6f3-d428-4313-a28f-d1c377dd487e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:48.552384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0235b6f3-d428-4313-a28f-d1c377dd487e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:48.560610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0235b6f3-d428-4313-a28f-d1c377dd487e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:48.562099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0235b6f3-d428-4313-a28f-d1c377dd487e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:48.563245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0235b6f3-d428-4313-a28f-d1c377dd487e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150192 Jun 20 07:27:48.563811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 694/1499] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:48 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:49.097692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f20f1cde-dae4-4213-bd1f-ad0900f33ada tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:49.099115 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f20f1cde-dae4-4213-bd1f-ad0900f33ada tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:49.105546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f20f1cde-dae4-4213-bd1f-ad0900f33ada tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:49.105994 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f20f1cde-dae4-4213-bd1f-ad0900f33ada tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:49.106754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f20f1cde-dae4-4213-bd1f-ad0900f33ada tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:49.107188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f20f1cde-dae4-4213-bd1f-ad0900f33ada tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:49.135755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f20f1cde-dae4-4213-bd1f-ad0900f33ada tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042067 Jun 20 07:27:49.136330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 806/1500] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:49.581426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1eecb7b5-90fb-4b4d-8989-f62ef8ec9ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:49.582054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1eecb7b5-90fb-4b4d-8989-f62ef8ec9ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:49.588085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1eecb7b5-90fb-4b4d-8989-f62ef8ec9ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:49.588560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1eecb7b5-90fb-4b4d-8989-f62ef8ec9ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:49.589321 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1eecb7b5-90fb-4b4d-8989-f62ef8ec9ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:49.589758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1eecb7b5-90fb-4b4d-8989-f62ef8ec9ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:49.721502 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1eecb7b5-90fb-4b4d-8989-f62ef8ec9ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:49.730403 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1eecb7b5-90fb-4b4d-8989-f62ef8ec9ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:49.731901 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1eecb7b5-90fb-4b4d-8989-f62ef8ec9ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:49.733094 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1eecb7b5-90fb-4b4d-8989-f62ef8ec9ef8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155776 Jun 20 07:27:49.733652 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 695/1501] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:49 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:50.146640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dc920699-b2d9-48d5-8ff5-5b18a981c1fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:50.147493 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dc920699-b2d9-48d5-8ff5-5b18a981c1fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:50.153871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc920699-b2d9-48d5-8ff5-5b18a981c1fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:50.154345 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc920699-b2d9-48d5-8ff5-5b18a981c1fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:50.155161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc920699-b2d9-48d5-8ff5-5b18a981c1fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:50.155596 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc920699-b2d9-48d5-8ff5-5b18a981c1fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:50.184506 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dc920699-b2d9-48d5-8ff5-5b18a981c1fb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041886 Jun 20 07:27:50.185051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 807/1502] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:50.752765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75a5cb86-1c5a-4dc5-8c86-102377da89b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:50.753411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-75a5cb86-1c5a-4dc5-8c86-102377da89b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:50.760910 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75a5cb86-1c5a-4dc5-8c86-102377da89b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:50.761363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75a5cb86-1c5a-4dc5-8c86-102377da89b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:50.762136 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75a5cb86-1c5a-4dc5-8c86-102377da89b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:50.762572 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75a5cb86-1c5a-4dc5-8c86-102377da89b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:50.766539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:27:50.896970 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-75a5cb86-1c5a-4dc5-8c86-102377da89b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:50.905470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-75a5cb86-1c5a-4dc5-8c86-102377da89b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:50.907824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-75a5cb86-1c5a-4dc5-8c86-102377da89b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:50.909122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-75a5cb86-1c5a-4dc5-8c86-102377da89b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.160253 Jun 20 07:27:50.909799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 696/1503] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:50 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:51.196019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ddbfa944-be87-4a0f-8e5c-3a1bbb61ba81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:51.196965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ddbfa944-be87-4a0f-8e5c-3a1bbb61ba81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:51.203498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddbfa944-be87-4a0f-8e5c-3a1bbb61ba81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:51.203949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddbfa944-be87-4a0f-8e5c-3a1bbb61ba81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:51.204747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddbfa944-be87-4a0f-8e5c-3a1bbb61ba81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:51.205184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ddbfa944-be87-4a0f-8e5c-3a1bbb61ba81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:51.234011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ddbfa944-be87-4a0f-8e5c-3a1bbb61ba81 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 Jun 20 07:27:51.234490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 808/1504] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:51.928692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5fcbf0d3-3384-44ff-acac-459fc47e80b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:51.929309 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5fcbf0d3-3384-44ff-acac-459fc47e80b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:51.935908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fcbf0d3-3384-44ff-acac-459fc47e80b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:51.936392 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fcbf0d3-3384-44ff-acac-459fc47e80b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:51.937158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fcbf0d3-3384-44ff-acac-459fc47e80b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:51.937593 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fcbf0d3-3384-44ff-acac-459fc47e80b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:52.067870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5fcbf0d3-3384-44ff-acac-459fc47e80b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:52.076365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5fcbf0d3-3384-44ff-acac-459fc47e80b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:52.077875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5fcbf0d3-3384-44ff-acac-459fc47e80b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:52.079036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5fcbf0d3-3384-44ff-acac-459fc47e80b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154293 Jun 20 07:27:52.079602 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 697/1505] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:51 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:52.246814 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f948f99b-db62-4c98-ae6a-6994c6dd972d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:52.248392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f948f99b-db62-4c98-ae6a-6994c6dd972d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:52.256788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f948f99b-db62-4c98-ae6a-6994c6dd972d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:52.257577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f948f99b-db62-4c98-ae6a-6994c6dd972d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:52.258387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f948f99b-db62-4c98-ae6a-6994c6dd972d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:52.258824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f948f99b-db62-4c98-ae6a-6994c6dd972d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:52.288805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f948f99b-db62-4c98-ae6a-6994c6dd972d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047119 Jun 20 07:27:52.289360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 809/1506] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:53.097893 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1c32531e-e617-400d-9959-e24e4e60474b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:53.098533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1c32531e-e617-400d-9959-e24e4e60474b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:53.104956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c32531e-e617-400d-9959-e24e4e60474b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:53.105405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c32531e-e617-400d-9959-e24e4e60474b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:53.106163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c32531e-e617-400d-9959-e24e4e60474b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:53.106603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c32531e-e617-400d-9959-e24e4e60474b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:53.231594 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1c32531e-e617-400d-9959-e24e4e60474b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:53.240782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1c32531e-e617-400d-9959-e24e4e60474b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:53.242200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1c32531e-e617-400d-9959-e24e4e60474b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:53.243352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1c32531e-e617-400d-9959-e24e4e60474b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149455 Jun 20 07:27:53.243905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 698/1507] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:53 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:53.300356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8a1627a9-5f8b-4102-ae02-667c874edf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:53.301838 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8a1627a9-5f8b-4102-ae02-667c874edf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:53.308234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a1627a9-5f8b-4102-ae02-667c874edf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:53.308681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a1627a9-5f8b-4102-ae02-667c874edf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:53.309435 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a1627a9-5f8b-4102-ae02-667c874edf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:53.309867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a1627a9-5f8b-4102-ae02-667c874edf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:53.338550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8a1627a9-5f8b-4102-ae02-667c874edf59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042176 Jun 20 07:27:53.339093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 810/1508] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:54.262473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7fa16cd8-fa93-4748-a4f2-d4cfde90103c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:54.263091 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7fa16cd8-fa93-4748-a4f2-d4cfde90103c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:54.269534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fa16cd8-fa93-4748-a4f2-d4cfde90103c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:54.269982 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fa16cd8-fa93-4748-a4f2-d4cfde90103c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:54.270739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fa16cd8-fa93-4748-a4f2-d4cfde90103c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:54.271179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fa16cd8-fa93-4748-a4f2-d4cfde90103c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:54.350913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-045ee505-79f0-4e83-b476-201d2686fcae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:54.351931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-045ee505-79f0-4e83-b476-201d2686fcae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:54.358540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-045ee505-79f0-4e83-b476-201d2686fcae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:54.359072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-045ee505-79f0-4e83-b476-201d2686fcae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:54.359848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-045ee505-79f0-4e83-b476-201d2686fcae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:54.360363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-045ee505-79f0-4e83-b476-201d2686fcae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:54.389464 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-045ee505-79f0-4e83-b476-201d2686fcae tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043140 Jun 20 07:27:54.390028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 811/1509] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:54 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:27:54.398874 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7fa16cd8-fa93-4748-a4f2-d4cfde90103c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:54.407218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7fa16cd8-fa93-4748-a4f2-d4cfde90103c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:54.408743 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7fa16cd8-fa93-4748-a4f2-d4cfde90103c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:54.409899 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7fa16cd8-fa93-4748-a4f2-d4cfde90103c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151253 Jun 20 07:27:54.410966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 699/1510] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:54 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:55.400874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d246536b-69bd-4d2d-b6d6-1bec7ad76e83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:55.401791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d246536b-69bd-4d2d-b6d6-1bec7ad76e83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:55.408248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d246536b-69bd-4d2d-b6d6-1bec7ad76e83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:55.408690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d246536b-69bd-4d2d-b6d6-1bec7ad76e83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:55.409441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d246536b-69bd-4d2d-b6d6-1bec7ad76e83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:55.409868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d246536b-69bd-4d2d-b6d6-1bec7ad76e83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:55.428620 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11ede1be-0ced-4ee5-b6e2-9bb2fdbede97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:55.429235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-11ede1be-0ced-4ee5-b6e2-9bb2fdbede97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:55.435588 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11ede1be-0ced-4ee5-b6e2-9bb2fdbede97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:55.436041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11ede1be-0ced-4ee5-b6e2-9bb2fdbede97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:55.436827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11ede1be-0ced-4ee5-b6e2-9bb2fdbede97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:55.437261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11ede1be-0ced-4ee5-b6e2-9bb2fdbede97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:55.438433 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d246536b-69bd-4d2d-b6d6-1bec7ad76e83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041413 Jun 20 07:27:55.438983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 812/1511] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:55 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:55.571534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-11ede1be-0ced-4ee5-b6e2-9bb2fdbede97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:55.579842 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-11ede1be-0ced-4ee5-b6e2-9bb2fdbede97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:55.581412 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-11ede1be-0ced-4ee5-b6e2-9bb2fdbede97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:55.582569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-11ede1be-0ced-4ee5-b6e2-9bb2fdbede97 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157834 Jun 20 07:27:55.583121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 700/1512] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:55 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:27:56.449599 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa740958-19ac-49e1-9ed2-85a0f2bed139 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:56.450446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aa740958-19ac-49e1-9ed2-85a0f2bed139 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:56.456914 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa740958-19ac-49e1-9ed2-85a0f2bed139 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:56.457363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa740958-19ac-49e1-9ed2-85a0f2bed139 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:56.458121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa740958-19ac-49e1-9ed2-85a0f2bed139 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:56.458554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa740958-19ac-49e1-9ed2-85a0f2bed139 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:56.487180 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aa740958-19ac-49e1-9ed2-85a0f2bed139 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041658 Jun 20 07:27:56.487732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 813/1513] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:56.601396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ddfdfa4a-82da-421a-9071-3683dc4422b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:56.602006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ddfdfa4a-82da-421a-9071-3683dc4422b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:56.608408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddfdfa4a-82da-421a-9071-3683dc4422b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:56.609051 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddfdfa4a-82da-421a-9071-3683dc4422b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:56.609804 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddfdfa4a-82da-421a-9071-3683dc4422b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:56.610234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ddfdfa4a-82da-421a-9071-3683dc4422b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:56.737944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ddfdfa4a-82da-421a-9071-3683dc4422b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:56.746958 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ddfdfa4a-82da-421a-9071-3683dc4422b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:56.748503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ddfdfa4a-82da-421a-9071-3683dc4422b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:56.749677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ddfdfa4a-82da-421a-9071-3683dc4422b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152697 Jun 20 07:27:56.750235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 701/1514] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:56 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:27:57.498864 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0b01b096-e474-44a7-83fd-094b73fa6bdb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:57.499808 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0b01b096-e474-44a7-83fd-094b73fa6bdb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:57.506399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b01b096-e474-44a7-83fd-094b73fa6bdb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:57.507108 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b01b096-e474-44a7-83fd-094b73fa6bdb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:57.507869 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b01b096-e474-44a7-83fd-094b73fa6bdb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:57.508331 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b01b096-e474-44a7-83fd-094b73fa6bdb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:57.537334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0b01b096-e474-44a7-83fd-094b73fa6bdb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042374 Jun 20 07:27:57.537816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 814/1515] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:57 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:57.768388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e8666a98-ef4c-436a-b60f-65ddb8b2801c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:57.769013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e8666a98-ef4c-436a-b60f-65ddb8b2801c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:57.775997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8666a98-ef4c-436a-b60f-65ddb8b2801c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:57.776481 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8666a98-ef4c-436a-b60f-65ddb8b2801c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:57.777244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8666a98-ef4c-436a-b60f-65ddb8b2801c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:57.777686 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8666a98-ef4c-436a-b60f-65ddb8b2801c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:57.908643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e8666a98-ef4c-436a-b60f-65ddb8b2801c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:57.916962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e8666a98-ef4c-436a-b60f-65ddb8b2801c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:57.918459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e8666a98-ef4c-436a-b60f-65ddb8b2801c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:57.919631 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e8666a98-ef4c-436a-b60f-65ddb8b2801c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155249 Jun 20 07:27:57.920275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 702/1516] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:57 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:58.547914 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9fcccb96-86a4-4168-b39f-531503c3dcb0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:58.548873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9fcccb96-86a4-4168-b39f-531503c3dcb0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:58.555842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fcccb96-86a4-4168-b39f-531503c3dcb0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:58.556331 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fcccb96-86a4-4168-b39f-531503c3dcb0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:58.557092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fcccb96-86a4-4168-b39f-531503c3dcb0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:58.557528 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fcccb96-86a4-4168-b39f-531503c3dcb0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:58.586784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9fcccb96-86a4-4168-b39f-531503c3dcb0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042828 Jun 20 07:27:58.587338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 815/1517] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:27:58.938538 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e704c004-ef2f-4e42-a980-b7c72ac20111 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:58.939084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e704c004-ef2f-4e42-a980-b7c72ac20111 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:58.945784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e704c004-ef2f-4e42-a980-b7c72ac20111 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:58.946236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e704c004-ef2f-4e42-a980-b7c72ac20111 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:58.947010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e704c004-ef2f-4e42-a980-b7c72ac20111 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:58.947450 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e704c004-ef2f-4e42-a980-b7c72ac20111 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:59.073071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e704c004-ef2f-4e42-a980-b7c72ac20111 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:59.081330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e704c004-ef2f-4e42-a980-b7c72ac20111 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:59.082835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e704c004-ef2f-4e42-a980-b7c72ac20111 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:27:59.083997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e704c004-ef2f-4e42-a980-b7c72ac20111 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149944 Jun 20 07:27:59.084581 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 703/1518] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:27:58 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:27:59.598844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-81cd8f81-f382-4e22-935c-5fd0afdc4189 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:27:59.600476 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-81cd8f81-f382-4e22-935c-5fd0afdc4189 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:27:59.606832 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81cd8f81-f382-4e22-935c-5fd0afdc4189 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:59.607274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81cd8f81-f382-4e22-935c-5fd0afdc4189 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:59.608024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81cd8f81-f382-4e22-935c-5fd0afdc4189 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:27:59.608477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81cd8f81-f382-4e22-935c-5fd0afdc4189 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:27:59.636923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-81cd8f81-f382-4e22-935c-5fd0afdc4189 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042575 Jun 20 07:27:59.637459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 816/1519] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:27:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:00.101898 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-28849d02-5e81-463d-bdb9-4a163556e8ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:00.102508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-28849d02-5e81-463d-bdb9-4a163556e8ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:00.108957 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28849d02-5e81-463d-bdb9-4a163556e8ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:00.109408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28849d02-5e81-463d-bdb9-4a163556e8ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:00.110156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28849d02-5e81-463d-bdb9-4a163556e8ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:00.110610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28849d02-5e81-463d-bdb9-4a163556e8ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:00.236434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-28849d02-5e81-463d-bdb9-4a163556e8ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:00.245777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-28849d02-5e81-463d-bdb9-4a163556e8ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:00.247281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-28849d02-5e81-463d-bdb9-4a163556e8ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:00.248461 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-28849d02-5e81-463d-bdb9-4a163556e8ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150970 Jun 20 07:28:00.249019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 704/1520] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:00 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:00.648374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9afb67e2-1b83-446c-9fa7-0233c4442ded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:00.649325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9afb67e2-1b83-446c-9fa7-0233c4442ded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:00.655732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9afb67e2-1b83-446c-9fa7-0233c4442ded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:00.656215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9afb67e2-1b83-446c-9fa7-0233c4442ded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:00.656973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9afb67e2-1b83-446c-9fa7-0233c4442ded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:00.657430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9afb67e2-1b83-446c-9fa7-0233c4442ded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:00.671402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:28:00.693288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9afb67e2-1b83-446c-9fa7-0233c4442ded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049405 Jun 20 07:28:00.695509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 817/1521] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:00 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:01.267176 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a949eb37-e5ca-4621-a030-3923cc2a8d90 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:01.267796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a949eb37-e5ca-4621-a030-3923cc2a8d90 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:01.274208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a949eb37-e5ca-4621-a030-3923cc2a8d90 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:01.274656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a949eb37-e5ca-4621-a030-3923cc2a8d90 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:01.275413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a949eb37-e5ca-4621-a030-3923cc2a8d90 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:01.275850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a949eb37-e5ca-4621-a030-3923cc2a8d90 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:01.410855 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a949eb37-e5ca-4621-a030-3923cc2a8d90 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:01.419144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a949eb37-e5ca-4621-a030-3923cc2a8d90 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:01.420668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a949eb37-e5ca-4621-a030-3923cc2a8d90 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:01.421824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a949eb37-e5ca-4621-a030-3923cc2a8d90 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.158674 Jun 20 07:28:01.422375 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 705/1522] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:01 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:01.706806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-62740437-228d-4b77-b475-e8f2e3794a05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:01.708272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-62740437-228d-4b77-b475-e8f2e3794a05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:01.717017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62740437-228d-4b77-b475-e8f2e3794a05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:01.717472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62740437-228d-4b77-b475-e8f2e3794a05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:01.718247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62740437-228d-4b77-b475-e8f2e3794a05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:01.718672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-62740437-228d-4b77-b475-e8f2e3794a05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:01.747765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-62740437-228d-4b77-b475-e8f2e3794a05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045093 Jun 20 07:28:01.748343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 818/1523] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:01 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:02.440777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f9b703c5-04a5-48e0-a9d0-a8e7d3372456 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:02.441386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f9b703c5-04a5-48e0-a9d0-a8e7d3372456 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:02.447803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9b703c5-04a5-48e0-a9d0-a8e7d3372456 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:02.448281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9b703c5-04a5-48e0-a9d0-a8e7d3372456 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:02.449036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9b703c5-04a5-48e0-a9d0-a8e7d3372456 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:02.449471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9b703c5-04a5-48e0-a9d0-a8e7d3372456 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:02.578419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f9b703c5-04a5-48e0-a9d0-a8e7d3372456 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:02.586653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f9b703c5-04a5-48e0-a9d0-a8e7d3372456 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:02.588162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f9b703c5-04a5-48e0-a9d0-a8e7d3372456 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:02.589313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f9b703c5-04a5-48e0-a9d0-a8e7d3372456 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152353 Jun 20 07:28:02.589863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 706/1524] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:02 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:02.759884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b109c3e2-e4f6-471e-b688-229859e30682 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:02.760919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b109c3e2-e4f6-471e-b688-229859e30682 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:02.767293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b109c3e2-e4f6-471e-b688-229859e30682 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:02.767740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b109c3e2-e4f6-471e-b688-229859e30682 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:02.768531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b109c3e2-e4f6-471e-b688-229859e30682 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:02.768968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b109c3e2-e4f6-471e-b688-229859e30682 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:02.798075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b109c3e2-e4f6-471e-b688-229859e30682 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042306 Jun 20 07:28:02.798557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 819/1525] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:03.607993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11a834e4-3048-418c-95f1-01f3336cffe1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:03.608648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-11a834e4-3048-418c-95f1-01f3336cffe1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:03.615592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11a834e4-3048-418c-95f1-01f3336cffe1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:03.616040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11a834e4-3048-418c-95f1-01f3336cffe1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:03.616874 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11a834e4-3048-418c-95f1-01f3336cffe1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:03.617312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11a834e4-3048-418c-95f1-01f3336cffe1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:03.748347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-11a834e4-3048-418c-95f1-01f3336cffe1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:03.757472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-11a834e4-3048-418c-95f1-01f3336cffe1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:03.758973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-11a834e4-3048-418c-95f1-01f3336cffe1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:03.760131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-11a834e4-3048-418c-95f1-01f3336cffe1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155948 Jun 20 07:28:03.760699 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 707/1526] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:03 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:03.808355 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d073b20e-f92b-4b3c-84ee-c6bdf446fcf8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:03.809285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d073b20e-f92b-4b3c-84ee-c6bdf446fcf8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:03.815646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d073b20e-f92b-4b3c-84ee-c6bdf446fcf8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:03.816764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d073b20e-f92b-4b3c-84ee-c6bdf446fcf8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:03.817514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d073b20e-f92b-4b3c-84ee-c6bdf446fcf8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:03.817946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d073b20e-f92b-4b3c-84ee-c6bdf446fcf8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:03.845696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d073b20e-f92b-4b3c-84ee-c6bdf446fcf8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041290 Jun 20 07:28:03.846230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 820/1527] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:03 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:04.778426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b994fdf-96a8-4b7f-b3e6-37837179f843 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:04.779039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2b994fdf-96a8-4b7f-b3e6-37837179f843 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:04.786093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b994fdf-96a8-4b7f-b3e6-37837179f843 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:04.786478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b994fdf-96a8-4b7f-b3e6-37837179f843 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:04.787233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b994fdf-96a8-4b7f-b3e6-37837179f843 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:04.787669 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b994fdf-96a8-4b7f-b3e6-37837179f843 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:04.856890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-06d81834-4b24-466b-a036-52ee6eba5fcf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:04.857851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-06d81834-4b24-466b-a036-52ee6eba5fcf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:04.864787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-06d81834-4b24-466b-a036-52ee6eba5fcf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:04.865240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-06d81834-4b24-466b-a036-52ee6eba5fcf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:04.866012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-06d81834-4b24-466b-a036-52ee6eba5fcf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:04.866449 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-06d81834-4b24-466b-a036-52ee6eba5fcf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:04.895206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-06d81834-4b24-466b-a036-52ee6eba5fcf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042233 Jun 20 07:28:04.895763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 821/1528] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:04 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:28:04.913285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2b994fdf-96a8-4b7f-b3e6-37837179f843 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:04.923016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2b994fdf-96a8-4b7f-b3e6-37837179f843 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:04.924560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2b994fdf-96a8-4b7f-b3e6-37837179f843 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:04.926373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2b994fdf-96a8-4b7f-b3e6-37837179f843 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151808 Jun 20 07:28:04.926919 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 708/1529] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:04 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:05.906698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4a80ccec-0316-4565-a571-b144d2442065 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:05.907622 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4a80ccec-0316-4565-a571-b144d2442065 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:05.914103 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a80ccec-0316-4565-a571-b144d2442065 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:05.914555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a80ccec-0316-4565-a571-b144d2442065 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:05.915319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a80ccec-0316-4565-a571-b144d2442065 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:05.915759 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a80ccec-0316-4565-a571-b144d2442065 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:05.945171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01296f31-70f7-47a7-abdf-6ed1edfe654a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:05.945705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4a80ccec-0316-4565-a571-b144d2442065 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042483 Jun 20 07:28:05.945812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01296f31-70f7-47a7-abdf-6ed1edfe654a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:05.946051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 822/1530] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:05 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:05.952596 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01296f31-70f7-47a7-abdf-6ed1edfe654a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:05.953043 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01296f31-70f7-47a7-abdf-6ed1edfe654a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:05.953802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01296f31-70f7-47a7-abdf-6ed1edfe654a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:05.954263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01296f31-70f7-47a7-abdf-6ed1edfe654a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:06.082880 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01296f31-70f7-47a7-abdf-6ed1edfe654a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:06.091198 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01296f31-70f7-47a7-abdf-6ed1edfe654a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:06.092746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01296f31-70f7-47a7-abdf-6ed1edfe654a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:06.093913 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-01296f31-70f7-47a7-abdf-6ed1edfe654a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153157 Jun 20 07:28:06.094475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 709/1531] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:05 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:28:06.956539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0fcc1b5b-30ba-475e-9d0d-0ef20c96ea86 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:06.957392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0fcc1b5b-30ba-475e-9d0d-0ef20c96ea86 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:06.963812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fcc1b5b-30ba-475e-9d0d-0ef20c96ea86 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:06.964309 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fcc1b5b-30ba-475e-9d0d-0ef20c96ea86 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:06.965073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fcc1b5b-30ba-475e-9d0d-0ef20c96ea86 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:06.965512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fcc1b5b-30ba-475e-9d0d-0ef20c96ea86 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:06.997694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0fcc1b5b-30ba-475e-9d0d-0ef20c96ea86 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045201 Jun 20 07:28:06.998250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 823/1532] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:06 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:07.113578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ede7012f-8ec5-4b00-a322-276e19b29009 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:07.114204 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ede7012f-8ec5-4b00-a322-276e19b29009 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:07.120663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ede7012f-8ec5-4b00-a322-276e19b29009 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:07.121111 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ede7012f-8ec5-4b00-a322-276e19b29009 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:07.121874 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ede7012f-8ec5-4b00-a322-276e19b29009 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:07.122319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ede7012f-8ec5-4b00-a322-276e19b29009 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:07.246931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ede7012f-8ec5-4b00-a322-276e19b29009 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:07.255194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ede7012f-8ec5-4b00-a322-276e19b29009 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:07.256984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ede7012f-8ec5-4b00-a322-276e19b29009 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:07.258159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ede7012f-8ec5-4b00-a322-276e19b29009 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149266 Jun 20 07:28:07.258722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 710/1533] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:07 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:08.010775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a141c985-395f-453b-814c-76e758e21e5a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:08.011693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a141c985-395f-453b-814c-76e758e21e5a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:08.018340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a141c985-395f-453b-814c-76e758e21e5a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:08.018785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a141c985-395f-453b-814c-76e758e21e5a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:08.020083 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a141c985-395f-453b-814c-76e758e21e5a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:08.020546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a141c985-395f-453b-814c-76e758e21e5a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:08.048785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a141c985-395f-453b-814c-76e758e21e5a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 Jun 20 07:28:08.049326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 824/1534] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:08 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:08.277385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bcbecbee-008c-4891-8eda-ef4bd7ba2724 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:08.277997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bcbecbee-008c-4891-8eda-ef4bd7ba2724 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:08.284501 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcbecbee-008c-4891-8eda-ef4bd7ba2724 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:08.284943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcbecbee-008c-4891-8eda-ef4bd7ba2724 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:08.285697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcbecbee-008c-4891-8eda-ef4bd7ba2724 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:08.286128 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcbecbee-008c-4891-8eda-ef4bd7ba2724 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:08.411805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bcbecbee-008c-4891-8eda-ef4bd7ba2724 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:08.420092 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bcbecbee-008c-4891-8eda-ef4bd7ba2724 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:08.421611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bcbecbee-008c-4891-8eda-ef4bd7ba2724 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:08.422761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bcbecbee-008c-4891-8eda-ef4bd7ba2724 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149312 Jun 20 07:28:08.423326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 711/1535] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:08 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:09.060706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e1be4d94-2877-4609-85c0-aa7f0721c251 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:09.061653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e1be4d94-2877-4609-85c0-aa7f0721c251 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:09.068830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1be4d94-2877-4609-85c0-aa7f0721c251 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:09.069284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1be4d94-2877-4609-85c0-aa7f0721c251 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:09.070113 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1be4d94-2877-4609-85c0-aa7f0721c251 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:09.070576 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1be4d94-2877-4609-85c0-aa7f0721c251 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:09.098820 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e1be4d94-2877-4609-85c0-aa7f0721c251 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042071 Jun 20 07:28:09.099370 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 825/1536] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:09 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:09.441612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c257ec72-01e5-462d-bd65-9e23cebb3cd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:09.442218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c257ec72-01e5-462d-bd65-9e23cebb3cd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:09.448739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c257ec72-01e5-462d-bd65-9e23cebb3cd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:09.449190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c257ec72-01e5-462d-bd65-9e23cebb3cd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:09.449947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c257ec72-01e5-462d-bd65-9e23cebb3cd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:09.450387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c257ec72-01e5-462d-bd65-9e23cebb3cd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:09.578749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c257ec72-01e5-462d-bd65-9e23cebb3cd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:09.580946 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:28:09.588415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c257ec72-01e5-462d-bd65-9e23cebb3cd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:09.589900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c257ec72-01e5-462d-bd65-9e23cebb3cd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:09.591050 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c257ec72-01e5-462d-bd65-9e23cebb3cd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153436 Jun 20 07:28:09.591610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 712/1537] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:09 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:10.109304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c2862e1d-c6c6-49aa-b2e0-1c91cf888495 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:10.110220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c2862e1d-c6c6-49aa-b2e0-1c91cf888495 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:10.117252 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2862e1d-c6c6-49aa-b2e0-1c91cf888495 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:10.117696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2862e1d-c6c6-49aa-b2e0-1c91cf888495 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:10.118451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2862e1d-c6c6-49aa-b2e0-1c91cf888495 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:10.118882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2862e1d-c6c6-49aa-b2e0-1c91cf888495 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:10.146550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c2862e1d-c6c6-49aa-b2e0-1c91cf888495 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041198 Jun 20 07:28:10.147081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 826/1538] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:10 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:10.609668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e0dbae41-d522-4a24-8c26-0cf9937a689f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:10.610287 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e0dbae41-d522-4a24-8c26-0cf9937a689f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:10.617357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0dbae41-d522-4a24-8c26-0cf9937a689f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:10.617805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0dbae41-d522-4a24-8c26-0cf9937a689f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:10.618577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0dbae41-d522-4a24-8c26-0cf9937a689f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:10.619017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0dbae41-d522-4a24-8c26-0cf9937a689f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:10.747041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0dbae41-d522-4a24-8c26-0cf9937a689f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:10.755409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0dbae41-d522-4a24-8c26-0cf9937a689f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:10.757184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0dbae41-d522-4a24-8c26-0cf9937a689f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:10.758341 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e0dbae41-d522-4a24-8c26-0cf9937a689f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152899 Jun 20 07:28:10.758895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 713/1539] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:10 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:11.157250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a4499ad2-29e6-4b2b-9edf-120f304e71ab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:11.158170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a4499ad2-29e6-4b2b-9edf-120f304e71ab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:11.164656 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4499ad2-29e6-4b2b-9edf-120f304e71ab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:11.165103 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4499ad2-29e6-4b2b-9edf-120f304e71ab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:11.165867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4499ad2-29e6-4b2b-9edf-120f304e71ab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:11.166300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4499ad2-29e6-4b2b-9edf-120f304e71ab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:11.196405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a4499ad2-29e6-4b2b-9edf-120f304e71ab tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043105 Jun 20 07:28:11.196967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 827/1540] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:11 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:11.776872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fb09176c-9657-42f5-82b3-7982aabbfcc7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:11.777477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fb09176c-9657-42f5-82b3-7982aabbfcc7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:11.779728 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:28:11.785005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb09176c-9657-42f5-82b3-7982aabbfcc7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:11.786149 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb09176c-9657-42f5-82b3-7982aabbfcc7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:11.786981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb09176c-9657-42f5-82b3-7982aabbfcc7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:11.787441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb09176c-9657-42f5-82b3-7982aabbfcc7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:11.927537 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fb09176c-9657-42f5-82b3-7982aabbfcc7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:11.935697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fb09176c-9657-42f5-82b3-7982aabbfcc7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:11.937241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fb09176c-9657-42f5-82b3-7982aabbfcc7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:11.938524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fb09176c-9657-42f5-82b3-7982aabbfcc7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.165641 Jun 20 07:28:11.939082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 714/1541] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:11 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:12.207866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f4eb4649-8224-447a-bad7-4c91587944d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:12.208852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f4eb4649-8224-447a-bad7-4c91587944d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:12.215270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4eb4649-8224-447a-bad7-4c91587944d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:12.215707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4eb4649-8224-447a-bad7-4c91587944d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:12.216484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4eb4649-8224-447a-bad7-4c91587944d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:12.216911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4eb4649-8224-447a-bad7-4c91587944d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:12.244511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f4eb4649-8224-447a-bad7-4c91587944d7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 Jun 20 07:28:12.244987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 828/1542] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:12 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:12.956675 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dfc0c6c2-c536-4371-b152-fcf4a8d9bc0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:12.957664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dfc0c6c2-c536-4371-b152-fcf4a8d9bc0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:12.964463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfc0c6c2-c536-4371-b152-fcf4a8d9bc0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:12.965041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfc0c6c2-c536-4371-b152-fcf4a8d9bc0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:12.965953 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfc0c6c2-c536-4371-b152-fcf4a8d9bc0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:12.966468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfc0c6c2-c536-4371-b152-fcf4a8d9bc0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:13.097536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dfc0c6c2-c536-4371-b152-fcf4a8d9bc0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:13.106433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dfc0c6c2-c536-4371-b152-fcf4a8d9bc0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:13.107909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dfc0c6c2-c536-4371-b152-fcf4a8d9bc0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:13.109085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dfc0c6c2-c536-4371-b152-fcf4a8d9bc0b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.156459 Jun 20 07:28:13.109639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 715/1543] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:12 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:13.255847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-75039220-fba4-485b-aa57-4d21b0f3ccd1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:13.256985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-75039220-fba4-485b-aa57-4d21b0f3ccd1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:13.259269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=58 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:28:13.264631 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75039220-fba4-485b-aa57-4d21b0f3ccd1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:13.265088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75039220-fba4-485b-aa57-4d21b0f3ccd1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:13.265849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75039220-fba4-485b-aa57-4d21b0f3ccd1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:13.266287 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75039220-fba4-485b-aa57-4d21b0f3ccd1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:13.295940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-75039220-fba4-485b-aa57-4d21b0f3ccd1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Jun 20 07:28:13.296520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 829/1544] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:13 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:14.127159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e303ff67-a80f-40a3-baac-3c888a03cd82 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:14.127781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e303ff67-a80f-40a3-baac-3c888a03cd82 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:14.135211 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e303ff67-a80f-40a3-baac-3c888a03cd82 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:14.135661 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e303ff67-a80f-40a3-baac-3c888a03cd82 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:14.136449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e303ff67-a80f-40a3-baac-3c888a03cd82 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:14.136891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e303ff67-a80f-40a3-baac-3c888a03cd82 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:14.260253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e303ff67-a80f-40a3-baac-3c888a03cd82 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:14.268561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e303ff67-a80f-40a3-baac-3c888a03cd82 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:14.270057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e303ff67-a80f-40a3-baac-3c888a03cd82 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:14.271213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e303ff67-a80f-40a3-baac-3c888a03cd82 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.147999 Jun 20 07:28:14.271773 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 716/1545] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:14 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:14.307292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e1de6880-fc4d-4bd2-a05b-08da7a4e7900 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:14.308238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e1de6880-fc4d-4bd2-a05b-08da7a4e7900 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:14.314859 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1de6880-fc4d-4bd2-a05b-08da7a4e7900 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:14.315301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1de6880-fc4d-4bd2-a05b-08da7a4e7900 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:14.316049 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1de6880-fc4d-4bd2-a05b-08da7a4e7900 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:14.317098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1de6880-fc4d-4bd2-a05b-08da7a4e7900 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:14.348730 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e1de6880-fc4d-4bd2-a05b-08da7a4e7900 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Jun 20 07:28:14.349281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 830/1546] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:14 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:15.289331 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca1eed3e-70f5-4fb3-ab3b-5f4a6ae3419a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:15.289949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca1eed3e-70f5-4fb3-ab3b-5f4a6ae3419a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:15.296496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca1eed3e-70f5-4fb3-ab3b-5f4a6ae3419a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:15.296943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca1eed3e-70f5-4fb3-ab3b-5f4a6ae3419a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:15.297700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca1eed3e-70f5-4fb3-ab3b-5f4a6ae3419a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:15.298136 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca1eed3e-70f5-4fb3-ab3b-5f4a6ae3419a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:15.359468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fb978a73-a01c-4e2f-979a-124863818b90 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:15.360432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fb978a73-a01c-4e2f-979a-124863818b90 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:15.367988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb978a73-a01c-4e2f-979a-124863818b90 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:15.368783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb978a73-a01c-4e2f-979a-124863818b90 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:15.370176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb978a73-a01c-4e2f-979a-124863818b90 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:15.370944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb978a73-a01c-4e2f-979a-124863818b90 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:15.404481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fb978a73-a01c-4e2f-979a-124863818b90 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048911 Jun 20 07:28:15.405264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 831/1547] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:15 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:28:15.647152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca1eed3e-70f5-4fb3-ab3b-5f4a6ae3419a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:15.655479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca1eed3e-70f5-4fb3-ab3b-5f4a6ae3419a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:15.657015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca1eed3e-70f5-4fb3-ab3b-5f4a6ae3419a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:15.658169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca1eed3e-70f5-4fb3-ab3b-5f4a6ae3419a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.373409 Jun 20 07:28:15.658716 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 717/1548] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:15 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:16.417188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e933f44e-31dd-47ab-9ee4-880b419c1887 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:16.418743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e933f44e-31dd-47ab-9ee4-880b419c1887 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:16.428549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e933f44e-31dd-47ab-9ee4-880b419c1887 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:16.429001 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e933f44e-31dd-47ab-9ee4-880b419c1887 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:16.429794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e933f44e-31dd-47ab-9ee4-880b419c1887 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:16.430234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e933f44e-31dd-47ab-9ee4-880b419c1887 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:16.458875 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e933f44e-31dd-47ab-9ee4-880b419c1887 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046695 Jun 20 07:28:16.459424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 832/1549] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:16 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:16.677169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca7f1678-c84e-48de-8756-345b87acb1b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:16.678008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca7f1678-c84e-48de-8756-345b87acb1b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:16.685478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca7f1678-c84e-48de-8756-345b87acb1b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:16.685932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca7f1678-c84e-48de-8756-345b87acb1b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:16.686712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca7f1678-c84e-48de-8756-345b87acb1b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:16.687156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca7f1678-c84e-48de-8756-345b87acb1b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:16.811665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca7f1678-c84e-48de-8756-345b87acb1b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:16.820023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca7f1678-c84e-48de-8756-345b87acb1b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:16.821555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca7f1678-c84e-48de-8756-345b87acb1b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:16.822713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca7f1678-c84e-48de-8756-345b87acb1b1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150293 Jun 20 07:28:16.823270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 718/1550] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:16 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:17.470638 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-af558c16-97cd-420f-b786-e15ccc206400 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:17.471470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-af558c16-97cd-420f-b786-e15ccc206400 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:17.478089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af558c16-97cd-420f-b786-e15ccc206400 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:17.478537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af558c16-97cd-420f-b786-e15ccc206400 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:17.479297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af558c16-97cd-420f-b786-e15ccc206400 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:17.479734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af558c16-97cd-420f-b786-e15ccc206400 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:17.508201 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-af558c16-97cd-420f-b786-e15ccc206400 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041678 Jun 20 07:28:17.508746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 833/1551] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:17 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:17.840884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-32aaab7a-da99-41d8-b2d6-5a3607977d09 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:17.841503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-32aaab7a-da99-41d8-b2d6-5a3607977d09 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:17.848554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32aaab7a-da99-41d8-b2d6-5a3607977d09 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:17.849005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32aaab7a-da99-41d8-b2d6-5a3607977d09 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:17.849759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32aaab7a-da99-41d8-b2d6-5a3607977d09 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:17.850194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32aaab7a-da99-41d8-b2d6-5a3607977d09 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:17.978093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32aaab7a-da99-41d8-b2d6-5a3607977d09 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:17.986604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32aaab7a-da99-41d8-b2d6-5a3607977d09 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:17.988098 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32aaab7a-da99-41d8-b2d6-5a3607977d09 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:17.989271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-32aaab7a-da99-41d8-b2d6-5a3607977d09 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152375 Jun 20 07:28:17.989831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 719/1552] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:17 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:18.519735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c96a6e30-c9fc-4b99-9cf7-6c5eac40427b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:18.520683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c96a6e30-c9fc-4b99-9cf7-6c5eac40427b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:18.527463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c96a6e30-c9fc-4b99-9cf7-6c5eac40427b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:18.527912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c96a6e30-c9fc-4b99-9cf7-6c5eac40427b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:18.528718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c96a6e30-c9fc-4b99-9cf7-6c5eac40427b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:18.529157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c96a6e30-c9fc-4b99-9cf7-6c5eac40427b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:18.531441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:28:18.558742 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c96a6e30-c9fc-4b99-9cf7-6c5eac40427b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 Jun 20 07:28:18.559285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 834/1553] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:18 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:19.007130 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3c63abb6-d368-4d74-922e-51c99daae895 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:19.007666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3c63abb6-d368-4d74-922e-51c99daae895 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:19.014255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c63abb6-d368-4d74-922e-51c99daae895 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:19.014702 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c63abb6-d368-4d74-922e-51c99daae895 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:19.015466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c63abb6-d368-4d74-922e-51c99daae895 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:19.015904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c63abb6-d368-4d74-922e-51c99daae895 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:19.141174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c63abb6-d368-4d74-922e-51c99daae895 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:19.149614 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c63abb6-d368-4d74-922e-51c99daae895 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:19.151170 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c63abb6-d368-4d74-922e-51c99daae895 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:19.152343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3c63abb6-d368-4d74-922e-51c99daae895 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149485 Jun 20 07:28:19.152938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 720/1554] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:19 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:19.570925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e4ed81f-b489-4617-9e13-72de2c6798b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:19.571846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e4ed81f-b489-4617-9e13-72de2c6798b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:19.578286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e4ed81f-b489-4617-9e13-72de2c6798b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:19.578737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e4ed81f-b489-4617-9e13-72de2c6798b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:19.579530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e4ed81f-b489-4617-9e13-72de2c6798b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:19.579965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e4ed81f-b489-4617-9e13-72de2c6798b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:19.609429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e4ed81f-b489-4617-9e13-72de2c6798b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Jun 20 07:28:19.609990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 835/1555] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:19 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:20.171423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a2270af-4d49-41a8-9673-9c70d7833974 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:20.172034 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6a2270af-4d49-41a8-9673-9c70d7833974 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:20.178093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a2270af-4d49-41a8-9673-9c70d7833974 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:20.178545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a2270af-4d49-41a8-9673-9c70d7833974 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:20.179283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a2270af-4d49-41a8-9673-9c70d7833974 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:20.179728 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a2270af-4d49-41a8-9673-9c70d7833974 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:20.313587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6a2270af-4d49-41a8-9673-9c70d7833974 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:20.322286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6a2270af-4d49-41a8-9673-9c70d7833974 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:20.323781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6a2270af-4d49-41a8-9673-9c70d7833974 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:20.324950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6a2270af-4d49-41a8-9673-9c70d7833974 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157617 Jun 20 07:28:20.325535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 721/1556] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:20 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:20.620661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bfeb789b-806d-43d1-b57b-013c8b18b316 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:20.621587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bfeb789b-806d-43d1-b57b-013c8b18b316 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:20.628085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfeb789b-806d-43d1-b57b-013c8b18b316 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:20.628562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfeb789b-806d-43d1-b57b-013c8b18b316 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:20.629329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfeb789b-806d-43d1-b57b-013c8b18b316 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:20.629767 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfeb789b-806d-43d1-b57b-013c8b18b316 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:20.658112 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bfeb789b-806d-43d1-b57b-013c8b18b316 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041409 Jun 20 07:28:20.658700 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 836/1557] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:20 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:21.342715 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a15ecd1a-79d8-40cf-b916-8e930aaae026 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:21.343337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a15ecd1a-79d8-40cf-b916-8e930aaae026 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:21.350355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a15ecd1a-79d8-40cf-b916-8e930aaae026 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:21.350802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a15ecd1a-79d8-40cf-b916-8e930aaae026 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:21.351562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a15ecd1a-79d8-40cf-b916-8e930aaae026 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:21.351999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a15ecd1a-79d8-40cf-b916-8e930aaae026 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:21.481329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a15ecd1a-79d8-40cf-b916-8e930aaae026 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:21.489775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a15ecd1a-79d8-40cf-b916-8e930aaae026 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:21.491282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a15ecd1a-79d8-40cf-b916-8e930aaae026 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:21.492474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a15ecd1a-79d8-40cf-b916-8e930aaae026 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153628 Jun 20 07:28:21.493026 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 722/1558] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:21 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:21.670216 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d956e7f2-8b9a-47d7-8f27-f7ab756adc94 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:21.671059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d956e7f2-8b9a-47d7-8f27-f7ab756adc94 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:21.677921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d956e7f2-8b9a-47d7-8f27-f7ab756adc94 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:21.678371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d956e7f2-8b9a-47d7-8f27-f7ab756adc94 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:21.679128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d956e7f2-8b9a-47d7-8f27-f7ab756adc94 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:21.679562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d956e7f2-8b9a-47d7-8f27-f7ab756adc94 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:21.711071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d956e7f2-8b9a-47d7-8f27-f7ab756adc94 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044814 Jun 20 07:28:21.711650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 837/1559] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:21 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:22.511090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-32b8a8de-e6ae-47b4-9b9c-6c68071a93aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:22.512373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-32b8a8de-e6ae-47b4-9b9c-6c68071a93aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:22.519209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32b8a8de-e6ae-47b4-9b9c-6c68071a93aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:22.519914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32b8a8de-e6ae-47b4-9b9c-6c68071a93aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:22.520794 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32b8a8de-e6ae-47b4-9b9c-6c68071a93aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:22.521431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32b8a8de-e6ae-47b4-9b9c-6c68071a93aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:22.658775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32b8a8de-e6ae-47b4-9b9c-6c68071a93aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:22.668641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32b8a8de-e6ae-47b4-9b9c-6c68071a93aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:22.670153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32b8a8de-e6ae-47b4-9b9c-6c68071a93aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:22.671328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-32b8a8de-e6ae-47b4-9b9c-6c68071a93aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.164076 Jun 20 07:28:22.671884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 723/1560] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:22.723095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-16a8ea68-c08e-48bc-96a4-1c22d844d415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:22.724015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-16a8ea68-c08e-48bc-96a4-1c22d844d415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:22.730522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16a8ea68-c08e-48bc-96a4-1c22d844d415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:22.730974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16a8ea68-c08e-48bc-96a4-1c22d844d415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:22.731737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16a8ea68-c08e-48bc-96a4-1c22d844d415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:22.732201 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-16a8ea68-c08e-48bc-96a4-1c22d844d415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:22.760865 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-16a8ea68-c08e-48bc-96a4-1c22d844d415 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042288 Jun 20 07:28:22.761409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 838/1561] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:22 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:23.689978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db026230-d75e-401e-9ed9-15a9e9cfc1ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:23.690522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-db026230-d75e-401e-9ed9-15a9e9cfc1ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:23.698014 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db026230-d75e-401e-9ed9-15a9e9cfc1ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:23.698466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db026230-d75e-401e-9ed9-15a9e9cfc1ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:23.699233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db026230-d75e-401e-9ed9-15a9e9cfc1ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:23.699673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db026230-d75e-401e-9ed9-15a9e9cfc1ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:23.772875 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6d30fbd7-8b2a-418f-8dee-809b7ae3c897 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:23.773804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6d30fbd7-8b2a-418f-8dee-809b7ae3c897 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:23.780635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d30fbd7-8b2a-418f-8dee-809b7ae3c897 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:23.781088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d30fbd7-8b2a-418f-8dee-809b7ae3c897 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:23.781862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d30fbd7-8b2a-418f-8dee-809b7ae3c897 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:23.782305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d30fbd7-8b2a-418f-8dee-809b7ae3c897 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:23.815959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6d30fbd7-8b2a-418f-8dee-809b7ae3c897 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047478 Jun 20 07:28:23.816600 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 839/1562] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:23 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:28:23.830971 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db026230-d75e-401e-9ed9-15a9e9cfc1ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:23.839771 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db026230-d75e-401e-9ed9-15a9e9cfc1ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:23.841350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db026230-d75e-401e-9ed9-15a9e9cfc1ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:23.842493 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db026230-d75e-401e-9ed9-15a9e9cfc1ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.156590 Jun 20 07:28:23.843047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 724/1563] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:23 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:24.828156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-90161f1c-8f49-4e4c-bf23-9af5734c9aaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:24.829006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-90161f1c-8f49-4e4c-bf23-9af5734c9aaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:24.835475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90161f1c-8f49-4e4c-bf23-9af5734c9aaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:24.835925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90161f1c-8f49-4e4c-bf23-9af5734c9aaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:24.836724 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90161f1c-8f49-4e4c-bf23-9af5734c9aaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:24.837166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90161f1c-8f49-4e4c-bf23-9af5734c9aaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:24.861304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-72c17c19-6088-4297-8289-58210de2353d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:24.861929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-72c17c19-6088-4297-8289-58210de2353d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:24.866392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-90161f1c-8f49-4e4c-bf23-9af5734c9aaa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042271 Jun 20 07:28:24.866970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 840/1564] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:24 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:24.869029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72c17c19-6088-4297-8289-58210de2353d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:24.869486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72c17c19-6088-4297-8289-58210de2353d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:24.870266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72c17c19-6088-4297-8289-58210de2353d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:24.870710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72c17c19-6088-4297-8289-58210de2353d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:24.999303 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-72c17c19-6088-4297-8289-58210de2353d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:25.007951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-72c17c19-6088-4297-8289-58210de2353d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:25.009503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-72c17c19-6088-4297-8289-58210de2353d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:25.010672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-72c17c19-6088-4297-8289-58210de2353d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153311 Jun 20 07:28:25.011232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 725/1565] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:24 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:28:25.878002 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-19496c67-4c3d-4d70-bf76-2fc897d23979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:25.878861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-19496c67-4c3d-4d70-bf76-2fc897d23979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:25.885491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19496c67-4c3d-4d70-bf76-2fc897d23979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:25.885935 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19496c67-4c3d-4d70-bf76-2fc897d23979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:25.886682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19496c67-4c3d-4d70-bf76-2fc897d23979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:25.887108 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19496c67-4c3d-4d70-bf76-2fc897d23979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:25.915008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-19496c67-4c3d-4d70-bf76-2fc897d23979 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041099 Jun 20 07:28:25.915540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 841/1566] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:25 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:26.029445 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-19212d26-52dd-4ebd-b268-2ef343c6bfc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:26.030065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-19212d26-52dd-4ebd-b268-2ef343c6bfc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:26.037159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19212d26-52dd-4ebd-b268-2ef343c6bfc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:26.037611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19212d26-52dd-4ebd-b268-2ef343c6bfc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:26.038376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19212d26-52dd-4ebd-b268-2ef343c6bfc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:26.038817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19212d26-52dd-4ebd-b268-2ef343c6bfc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:26.165085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-19212d26-52dd-4ebd-b268-2ef343c6bfc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:26.173378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-19212d26-52dd-4ebd-b268-2ef343c6bfc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:26.174885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-19212d26-52dd-4ebd-b268-2ef343c6bfc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:26.176580 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-19212d26-52dd-4ebd-b268-2ef343c6bfc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151095 Jun 20 07:28:26.177143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 726/1567] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:26 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:28:26.926227 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7f73c401-30c2-4bd1-ae1a-56b94982b089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:26.927063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7f73c401-30c2-4bd1-ae1a-56b94982b089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:26.933342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f73c401-30c2-4bd1-ae1a-56b94982b089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:26.933784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f73c401-30c2-4bd1-ae1a-56b94982b089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:26.934532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f73c401-30c2-4bd1-ae1a-56b94982b089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:26.934962 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f73c401-30c2-4bd1-ae1a-56b94982b089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:26.962752 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7f73c401-30c2-4bd1-ae1a-56b94982b089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040512 Jun 20 07:28:26.963281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 842/1568] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:26 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:27.195543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-45202366-2805-405e-b452-259e9ba1c212 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:27.196078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-45202366-2805-405e-b452-259e9ba1c212 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:27.202621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45202366-2805-405e-b452-259e9ba1c212 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:27.203069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45202366-2805-405e-b452-259e9ba1c212 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:27.203826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45202366-2805-405e-b452-259e9ba1c212 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:27.204293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45202366-2805-405e-b452-259e9ba1c212 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:27.331498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45202366-2805-405e-b452-259e9ba1c212 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:27.340703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45202366-2805-405e-b452-259e9ba1c212 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:27.342244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45202366-2805-405e-b452-259e9ba1c212 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:27.343413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-45202366-2805-405e-b452-259e9ba1c212 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152414 Jun 20 07:28:27.343977 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 727/1569] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:27 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:27.974855 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-78a618ff-50fc-4f0d-9866-f490db33b81f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:27.975692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-78a618ff-50fc-4f0d-9866-f490db33b81f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:27.982146 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78a618ff-50fc-4f0d-9866-f490db33b81f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:27.982601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78a618ff-50fc-4f0d-9866-f490db33b81f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:27.983367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78a618ff-50fc-4f0d-9866-f490db33b81f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:27.983803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78a618ff-50fc-4f0d-9866-f490db33b81f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:28.013053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-78a618ff-50fc-4f0d-9866-f490db33b81f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042737 Jun 20 07:28:28.013605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 843/1570] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:27 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:28.361323 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f6dc2be2-776e-4576-aa0e-44b290d15452 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:28.361943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f6dc2be2-776e-4576-aa0e-44b290d15452 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:28.368527 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6dc2be2-776e-4576-aa0e-44b290d15452 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:28.368981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6dc2be2-776e-4576-aa0e-44b290d15452 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:28.369744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6dc2be2-776e-4576-aa0e-44b290d15452 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:28.370187 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6dc2be2-776e-4576-aa0e-44b290d15452 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:28.500669 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f6dc2be2-776e-4576-aa0e-44b290d15452 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:28.509200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f6dc2be2-776e-4576-aa0e-44b290d15452 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:28.510704 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f6dc2be2-776e-4576-aa0e-44b290d15452 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:28.511872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f6dc2be2-776e-4576-aa0e-44b290d15452 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154430 Jun 20 07:28:28.512469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 728/1571] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:28 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:29.025235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4113d04b-fbb5-45f5-ad0c-af00d317b9b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:29.026188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4113d04b-fbb5-45f5-ad0c-af00d317b9b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:29.032800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4113d04b-fbb5-45f5-ad0c-af00d317b9b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:29.033249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4113d04b-fbb5-45f5-ad0c-af00d317b9b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:29.034013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4113d04b-fbb5-45f5-ad0c-af00d317b9b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:29.034447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4113d04b-fbb5-45f5-ad0c-af00d317b9b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:29.063195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4113d04b-fbb5-45f5-ad0c-af00d317b9b7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041913 Jun 20 07:28:29.063740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 844/1572] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:29 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:29.530099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d7855c7-5502-494e-8b0e-f11718167077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:29.530710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d7855c7-5502-494e-8b0e-f11718167077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:29.537712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d7855c7-5502-494e-8b0e-f11718167077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:29.538155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d7855c7-5502-494e-8b0e-f11718167077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:29.538905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d7855c7-5502-494e-8b0e-f11718167077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:29.539337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d7855c7-5502-494e-8b0e-f11718167077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:29.554248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:28:29.665986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d7855c7-5502-494e-8b0e-f11718167077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:29.674153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d7855c7-5502-494e-8b0e-f11718167077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:29.676436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d7855c7-5502-494e-8b0e-f11718167077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:29.677644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d7855c7-5502-494e-8b0e-f11718167077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151407 Jun 20 07:28:29.678277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 729/1573] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:29 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:30.075122 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5dc01c15-d001-4372-ace7-dca10757c3d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:30.075974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5dc01c15-d001-4372-ace7-dca10757c3d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:30.082448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5dc01c15-d001-4372-ace7-dca10757c3d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:30.082894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5dc01c15-d001-4372-ace7-dca10757c3d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:30.083655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5dc01c15-d001-4372-ace7-dca10757c3d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:30.084090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5dc01c15-d001-4372-ace7-dca10757c3d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:30.112456 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5dc01c15-d001-4372-ace7-dca10757c3d1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041360 Jun 20 07:28:30.113652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 845/1574] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:30 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:30.696774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d7ff5f7a-951c-4072-b291-291e3368962d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:30.697397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d7ff5f7a-951c-4072-b291-291e3368962d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:30.704030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7ff5f7a-951c-4072-b291-291e3368962d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:30.704509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7ff5f7a-951c-4072-b291-291e3368962d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:30.705274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7ff5f7a-951c-4072-b291-291e3368962d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:30.705709 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7ff5f7a-951c-4072-b291-291e3368962d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:30.838065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d7ff5f7a-951c-4072-b291-291e3368962d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:30.846739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d7ff5f7a-951c-4072-b291-291e3368962d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:30.848849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d7ff5f7a-951c-4072-b291-291e3368962d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:30.850022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d7ff5f7a-951c-4072-b291-291e3368962d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157196 Jun 20 07:28:30.850584 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 730/1575] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:30 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:31.124876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a0e184e6-e0b9-40d7-981e-969af10d4cad tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:31.125725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a0e184e6-e0b9-40d7-981e-969af10d4cad tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:31.132527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0e184e6-e0b9-40d7-981e-969af10d4cad tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:31.132977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0e184e6-e0b9-40d7-981e-969af10d4cad tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:31.133734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0e184e6-e0b9-40d7-981e-969af10d4cad tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:31.134170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a0e184e6-e0b9-40d7-981e-969af10d4cad tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:31.161936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a0e184e6-e0b9-40d7-981e-969af10d4cad tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041146 Jun 20 07:28:31.162480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 846/1576] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:31 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:31.868817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2dd0dfee-6e23-42c0-8bca-ca9641611940 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:31.869428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2dd0dfee-6e23-42c0-8bca-ca9641611940 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:31.876088 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dd0dfee-6e23-42c0-8bca-ca9641611940 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:31.876576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dd0dfee-6e23-42c0-8bca-ca9641611940 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:31.877313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dd0dfee-6e23-42c0-8bca-ca9641611940 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:31.877746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dd0dfee-6e23-42c0-8bca-ca9641611940 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:32.009885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2dd0dfee-6e23-42c0-8bca-ca9641611940 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:32.019367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2dd0dfee-6e23-42c0-8bca-ca9641611940 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:32.020929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2dd0dfee-6e23-42c0-8bca-ca9641611940 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:32.022128 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2dd0dfee-6e23-42c0-8bca-ca9641611940 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157153 Jun 20 07:28:32.022681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 731/1577] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:31 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:32.173291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8f083828-ea16-4922-8e98-0e6e87b25bc3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:32.174196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8f083828-ea16-4922-8e98-0e6e87b25bc3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:32.180546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f083828-ea16-4922-8e98-0e6e87b25bc3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:32.180983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f083828-ea16-4922-8e98-0e6e87b25bc3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:32.181727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f083828-ea16-4922-8e98-0e6e87b25bc3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:32.182159 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f083828-ea16-4922-8e98-0e6e87b25bc3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:32.210247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8f083828-ea16-4922-8e98-0e6e87b25bc3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040795 Jun 20 07:28:32.210708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 847/1578] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:32 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:33.040458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-13f98ff7-d772-481f-b8db-20e6d6d16259 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:33.041092 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-13f98ff7-d772-481f-b8db-20e6d6d16259 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:33.047428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13f98ff7-d772-481f-b8db-20e6d6d16259 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:33.047873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13f98ff7-d772-481f-b8db-20e6d6d16259 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:33.048664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13f98ff7-d772-481f-b8db-20e6d6d16259 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:33.049100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13f98ff7-d772-481f-b8db-20e6d6d16259 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:33.178158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-13f98ff7-d772-481f-b8db-20e6d6d16259 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:33.186393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-13f98ff7-d772-481f-b8db-20e6d6d16259 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:33.187878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-13f98ff7-d772-481f-b8db-20e6d6d16259 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:33.189053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-13f98ff7-d772-481f-b8db-20e6d6d16259 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152645 Jun 20 07:28:33.189608 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 732/1579] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:33 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:33.220839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-970f4440-ac09-493d-9319-6abbea741c56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:33.221751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-970f4440-ac09-493d-9319-6abbea741c56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:33.228561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-970f4440-ac09-493d-9319-6abbea741c56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:33.228998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-970f4440-ac09-493d-9319-6abbea741c56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:33.229741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-970f4440-ac09-493d-9319-6abbea741c56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:33.230169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-970f4440-ac09-493d-9319-6abbea741c56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:33.258640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-970f4440-ac09-493d-9319-6abbea741c56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041640 Jun 20 07:28:33.259181 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 848/1580] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:33 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:34.207701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d514b2cd-4ed3-4c1d-83fd-14721a04fc99 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:34.208338 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d514b2cd-4ed3-4c1d-83fd-14721a04fc99 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:34.214788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d514b2cd-4ed3-4c1d-83fd-14721a04fc99 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:34.215171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d514b2cd-4ed3-4c1d-83fd-14721a04fc99 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:34.215917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d514b2cd-4ed3-4c1d-83fd-14721a04fc99 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:34.216377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d514b2cd-4ed3-4c1d-83fd-14721a04fc99 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:34.270704 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-df1091e4-94b7-4bca-826c-49d3d9d6bcf7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:34.271799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-df1091e4-94b7-4bca-826c-49d3d9d6bcf7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:34.277793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df1091e4-94b7-4bca-826c-49d3d9d6bcf7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:34.278245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df1091e4-94b7-4bca-826c-49d3d9d6bcf7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:34.279005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df1091e4-94b7-4bca-826c-49d3d9d6bcf7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:34.279444 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df1091e4-94b7-4bca-826c-49d3d9d6bcf7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:34.308685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-df1091e4-94b7-4bca-826c-49d3d9d6bcf7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042519 Jun 20 07:28:34.309491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 849/1581] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:28:34.349798 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d514b2cd-4ed3-4c1d-83fd-14721a04fc99 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:34.357962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d514b2cd-4ed3-4c1d-83fd-14721a04fc99 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:34.359436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d514b2cd-4ed3-4c1d-83fd-14721a04fc99 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:34.360610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d514b2cd-4ed3-4c1d-83fd-14721a04fc99 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157371 Jun 20 07:28:34.361166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 733/1582] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:34 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:35.320987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-02a16b93-bb6e-4221-b344-dfa622c120ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:35.321834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-02a16b93-bb6e-4221-b344-dfa622c120ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:35.328172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02a16b93-bb6e-4221-b344-dfa622c120ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:35.328617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02a16b93-bb6e-4221-b344-dfa622c120ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:35.329370 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02a16b93-bb6e-4221-b344-dfa622c120ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:35.329801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02a16b93-bb6e-4221-b344-dfa622c120ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:35.353850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:28:35.358646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-02a16b93-bb6e-4221-b344-dfa622c120ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041651 Jun 20 07:28:35.359190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 850/1583] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:35 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:35.378612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-47e39d82-3616-4e74-add4-470e8c77e6ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:35.379237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-47e39d82-3616-4e74-add4-470e8c77e6ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:35.385986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47e39d82-3616-4e74-add4-470e8c77e6ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:35.386438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47e39d82-3616-4e74-add4-470e8c77e6ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:35.387203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47e39d82-3616-4e74-add4-470e8c77e6ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:35.387645 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47e39d82-3616-4e74-add4-470e8c77e6ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:35.511822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-47e39d82-3616-4e74-add4-470e8c77e6ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:35.520061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-47e39d82-3616-4e74-add4-470e8c77e6ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:35.521659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-47e39d82-3616-4e74-add4-470e8c77e6ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:35.522817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-47e39d82-3616-4e74-add4-470e8c77e6ff tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.148043 Jun 20 07:28:35.523374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 734/1584] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:35 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:36.370366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bad6ade3-5c83-4c1a-b8ae-e1df197e11ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:36.371223 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bad6ade3-5c83-4c1a-b8ae-e1df197e11ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:36.377602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bad6ade3-5c83-4c1a-b8ae-e1df197e11ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:36.378053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bad6ade3-5c83-4c1a-b8ae-e1df197e11ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:36.378818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bad6ade3-5c83-4c1a-b8ae-e1df197e11ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:36.379263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bad6ade3-5c83-4c1a-b8ae-e1df197e11ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:36.408043 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bad6ade3-5c83-4c1a-b8ae-e1df197e11ed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041934 Jun 20 07:28:36.408624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 851/1585] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:36 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:36.541420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b047a30-26b3-4636-a7d8-ad21070bf20a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:36.542040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b047a30-26b3-4636-a7d8-ad21070bf20a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:36.548517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b047a30-26b3-4636-a7d8-ad21070bf20a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:36.548968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b047a30-26b3-4636-a7d8-ad21070bf20a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:36.549728 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b047a30-26b3-4636-a7d8-ad21070bf20a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:36.550168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b047a30-26b3-4636-a7d8-ad21070bf20a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:36.679753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b047a30-26b3-4636-a7d8-ad21070bf20a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:36.687999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b047a30-26b3-4636-a7d8-ad21070bf20a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:36.689504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b047a30-26b3-4636-a7d8-ad21070bf20a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:36.690688 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b047a30-26b3-4636-a7d8-ad21070bf20a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153105 Jun 20 07:28:36.691275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 735/1586] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:36 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:37.419975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e4879d94-6b64-418f-9dfc-ba039791bae1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:37.420834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e4879d94-6b64-418f-9dfc-ba039791bae1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:37.427191 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4879d94-6b64-418f-9dfc-ba039791bae1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:37.427630 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4879d94-6b64-418f-9dfc-ba039791bae1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:37.428408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4879d94-6b64-418f-9dfc-ba039791bae1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:37.428836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4879d94-6b64-418f-9dfc-ba039791bae1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:37.457470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e4879d94-6b64-418f-9dfc-ba039791bae1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041466 Jun 20 07:28:37.458021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 852/1587] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:37 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:37.708642 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8be4dda0-c6c8-4be5-b577-ef2ebfb5c270 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:37.709238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8be4dda0-c6c8-4be5-b577-ef2ebfb5c270 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:37.715593 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8be4dda0-c6c8-4be5-b577-ef2ebfb5c270 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:37.716040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8be4dda0-c6c8-4be5-b577-ef2ebfb5c270 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:37.716821 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8be4dda0-c6c8-4be5-b577-ef2ebfb5c270 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:37.717254 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8be4dda0-c6c8-4be5-b577-ef2ebfb5c270 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:37.842515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8be4dda0-c6c8-4be5-b577-ef2ebfb5c270 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:37.851347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8be4dda0-c6c8-4be5-b577-ef2ebfb5c270 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:37.852873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8be4dda0-c6c8-4be5-b577-ef2ebfb5c270 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:37.854025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8be4dda0-c6c8-4be5-b577-ef2ebfb5c270 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149304 Jun 20 07:28:37.854622 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 736/1588] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:37 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:38.468922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2f1d6936-b013-43d6-a93e-d5e075db9c50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:38.469766 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2f1d6936-b013-43d6-a93e-d5e075db9c50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:38.476172 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f1d6936-b013-43d6-a93e-d5e075db9c50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:38.476618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f1d6936-b013-43d6-a93e-d5e075db9c50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:38.477368 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f1d6936-b013-43d6-a93e-d5e075db9c50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:38.477798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f1d6936-b013-43d6-a93e-d5e075db9c50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:38.505826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2f1d6936-b013-43d6-a93e-d5e075db9c50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040838 Jun 20 07:28:38.506616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 853/1589] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:28:38 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:28:38.872952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c1563192-7156-4e92-ba33-c17000737f87 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:38.873575 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c1563192-7156-4e92-ba33-c17000737f87 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:38.880805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1563192-7156-4e92-ba33-c17000737f87 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:38.881293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1563192-7156-4e92-ba33-c17000737f87 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:38.882350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1563192-7156-4e92-ba33-c17000737f87 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:38.882790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1563192-7156-4e92-ba33-c17000737f87 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:39.021841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c1563192-7156-4e92-ba33-c17000737f87 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:39.030223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c1563192-7156-4e92-ba33-c17000737f87 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:39.031699 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c1563192-7156-4e92-ba33-c17000737f87 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:39.032880 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c1563192-7156-4e92-ba33-c17000737f87 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.163869 Jun 20 07:28:39.033432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 737/1590] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:38 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:39.318759 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-446d6cf8-4e06-4a67-8a10-13b4123470d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:39.320428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-446d6cf8-4e06-4a67-8a10-13b4123470d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:39.326567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-446d6cf8-4e06-4a67-8a10-13b4123470d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:39.327009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-446d6cf8-4e06-4a67-8a10-13b4123470d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:39.327760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-446d6cf8-4e06-4a67-8a10-13b4123470d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:39.328212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-446d6cf8-4e06-4a67-8a10-13b4123470d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:39.353511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-446d6cf8-4e06-4a67-8a10-13b4123470d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:28:39.431513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-446d6cf8-4e06-4a67-8a10-13b4123470d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 204 len: 0 microversion: 2.1 time: 0.116294 Jun 20 07:28:39.432096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 854/1591] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:28:39 2022] DELETE /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:28:39.440307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-05519114-0787-4a77-bb65-8ee963ac8dd1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:39.440959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-05519114-0787-4a77-bb65-8ee963ac8dd1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:39.447004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05519114-0787-4a77-bb65-8ee963ac8dd1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:39.447456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05519114-0787-4a77-bb65-8ee963ac8dd1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:39.448245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05519114-0787-4a77-bb65-8ee963ac8dd1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:39.448683 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05519114-0787-4a77-bb65-8ee963ac8dd1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:39.517495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bfaefd51-754f-4ebf-9e7c-9dcea309e265 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:28:39.519012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bfaefd51-754f-4ebf-9e7c-9dcea309e265 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:39.525541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfaefd51-754f-4ebf-9e7c-9dcea309e265 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:39.525988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfaefd51-754f-4ebf-9e7c-9dcea309e265 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:39.526743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfaefd51-754f-4ebf-9e7c-9dcea309e265 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:39.527171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bfaefd51-754f-4ebf-9e7c-9dcea309e265 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:39.578201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-05519114-0787-4a77-bb65-8ee963ac8dd1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:39.586272 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-05519114-0787-4a77-bb65-8ee963ac8dd1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149995 Jun 20 07:28:39.586838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 738/1592] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:39 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:39.605793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bfaefd51-754f-4ebf-9e7c-9dcea309e265 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "POST /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/action" status: 200 len: 76561 microversion: 2.1 time: 0.092455 Jun 20 07:28:39.606479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 855/1593] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:28:39 2022] POST /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75/action => generated 76561 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 07:28:40.051508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-42e5d509-3c60-4132-8a50-39fafc78f2fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:40.052145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-42e5d509-3c60-4132-8a50-39fafc78f2fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:40.058607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42e5d509-3c60-4132-8a50-39fafc78f2fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:40.059059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42e5d509-3c60-4132-8a50-39fafc78f2fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:40.059815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42e5d509-3c60-4132-8a50-39fafc78f2fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:40.060294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42e5d509-3c60-4132-8a50-39fafc78f2fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:40.186497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-42e5d509-3c60-4132-8a50-39fafc78f2fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:40.194782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-42e5d509-3c60-4132-8a50-39fafc78f2fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:40.196305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-42e5d509-3c60-4132-8a50-39fafc78f2fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:40.197488 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-42e5d509-3c60-4132-8a50-39fafc78f2fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150553 Jun 20 07:28:40.198114 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 739/1594] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:40 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:40.487381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-67ebf10e-3c1d-4c19-b81e-d80a4d390d18 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] Calling method '.version_select at 0x7ffa1fadc550>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:40.508618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-67ebf10e-3c1d-4c19-b81e-d80a4d390d18 tempest-TestVolumeBootPattern-23472585 tempest-TestVolumeBootPattern-23472585-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-278969032" status: 202 len: 0 microversion: 2.1 time: 0.025482 Jun 20 07:28:40.509196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 856/1595] 10.222.0.23 () {58 vars in 1259 bytes} [Mon Jun 20 07:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-278969032 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:28:40.603264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-66138c03-0bc2-4bfd-a015-1351161c0224 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:40.603825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-66138c03-0bc2-4bfd-a015-1351161c0224 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:40.609872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66138c03-0bc2-4bfd-a015-1351161c0224 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:40.610327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66138c03-0bc2-4bfd-a015-1351161c0224 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:40.611123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66138c03-0bc2-4bfd-a015-1351161c0224 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:40.611555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66138c03-0bc2-4bfd-a015-1351161c0224 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:40.752915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-66138c03-0bc2-4bfd-a015-1351161c0224 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:40.761139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-66138c03-0bc2-4bfd-a015-1351161c0224 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.161790 Jun 20 07:28:40.761703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 740/1596] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:40 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:41.217593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-20608679-a5cc-4f29-80bb-b121afcb2cb6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:41.218334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-20608679-a5cc-4f29-80bb-b121afcb2cb6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:41.226580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20608679-a5cc-4f29-80bb-b121afcb2cb6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:41.227044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20608679-a5cc-4f29-80bb-b121afcb2cb6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:41.227816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20608679-a5cc-4f29-80bb-b121afcb2cb6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:41.228285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20608679-a5cc-4f29-80bb-b121afcb2cb6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:41.500159 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20608679-a5cc-4f29-80bb-b121afcb2cb6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:41.509690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20608679-a5cc-4f29-80bb-b121afcb2cb6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:41.511482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20608679-a5cc-4f29-80bb-b121afcb2cb6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:41.512682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-20608679-a5cc-4f29-80bb-b121afcb2cb6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.299622 Jun 20 07:28:41.513245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 857/1597] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:41 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:41.779539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-312e8b0e-f60a-4ea2-8000-4479e2a574ab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:41.782265 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-312e8b0e-f60a-4ea2-8000-4479e2a574ab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:41.790582 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=54 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:28:41.793022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-312e8b0e-f60a-4ea2-8000-4479e2a574ab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:41.793507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-312e8b0e-f60a-4ea2-8000-4479e2a574ab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:41.794336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-312e8b0e-f60a-4ea2-8000-4479e2a574ab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:41.794783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-312e8b0e-f60a-4ea2-8000-4479e2a574ab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:42.020980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-312e8b0e-f60a-4ea2-8000-4479e2a574ab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:42.029058 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-312e8b0e-f60a-4ea2-8000-4479e2a574ab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.254781 Jun 20 07:28:42.029627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 741/1598] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:41 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:42.531833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-77c66d35-7a18-4aea-88bf-ce8f9da3378a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:42.532616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-77c66d35-7a18-4aea-88bf-ce8f9da3378a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:42.540799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77c66d35-7a18-4aea-88bf-ce8f9da3378a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:42.541254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77c66d35-7a18-4aea-88bf-ce8f9da3378a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:42.542072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77c66d35-7a18-4aea-88bf-ce8f9da3378a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:42.542629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-77c66d35-7a18-4aea-88bf-ce8f9da3378a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:42.861065 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-77c66d35-7a18-4aea-88bf-ce8f9da3378a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:42.870676 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-77c66d35-7a18-4aea-88bf-ce8f9da3378a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:42.872204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-77c66d35-7a18-4aea-88bf-ce8f9da3378a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:42.873604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-77c66d35-7a18-4aea-88bf-ce8f9da3378a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.346291 Jun 20 07:28:42.885897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 858/1599] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:43.047237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e579b1e2-eb93-41ff-b4d0-55ee416539a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:43.047785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e579b1e2-eb93-41ff-b4d0-55ee416539a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:43.054918 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e579b1e2-eb93-41ff-b4d0-55ee416539a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:43.055572 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e579b1e2-eb93-41ff-b4d0-55ee416539a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:43.056370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e579b1e2-eb93-41ff-b4d0-55ee416539a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:43.056811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e579b1e2-eb93-41ff-b4d0-55ee416539a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:43.272281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e579b1e2-eb93-41ff-b4d0-55ee416539a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:43.282047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e579b1e2-eb93-41ff-b4d0-55ee416539a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.239163 Jun 20 07:28:43.282751 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 742/1600] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:43 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:43.893158 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-20dbdd81-4512-4d50-942c-531ec2f05fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:43.894416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-20dbdd81-4512-4d50-942c-531ec2f05fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:43.898282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:28:43.901775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20dbdd81-4512-4d50-942c-531ec2f05fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:43.902217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20dbdd81-4512-4d50-942c-531ec2f05fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:43.902972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20dbdd81-4512-4d50-942c-531ec2f05fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:43.903398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20dbdd81-4512-4d50-942c-531ec2f05fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:44.078244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20dbdd81-4512-4d50-942c-531ec2f05fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:44.087611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20dbdd81-4512-4d50-942c-531ec2f05fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:44.089149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20dbdd81-4512-4d50-942c-531ec2f05fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:44.090321 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-20dbdd81-4512-4d50-942c-531ec2f05fa3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.201147 Jun 20 07:28:44.090894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 859/1601] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:43 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:44.302174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2f856bf3-82b9-4a68-b9c6-9739362ed535 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:44.302856 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2f856bf3-82b9-4a68-b9c6-9739362ed535 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:44.321466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f856bf3-82b9-4a68-b9c6-9739362ed535 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:44.322230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f856bf3-82b9-4a68-b9c6-9739362ed535 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:44.323223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f856bf3-82b9-4a68-b9c6-9739362ed535 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:44.323967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f856bf3-82b9-4a68-b9c6-9739362ed535 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:44.551459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2f856bf3-82b9-4a68-b9c6-9739362ed535 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:44.559291 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2f856bf3-82b9-4a68-b9c6-9739362ed535 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.262039 Jun 20 07:28:44.560057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 743/1602] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:44 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:45.108946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f005e974-1e8a-489e-b764-2e14c7d3f455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:45.109544 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f005e974-1e8a-489e-b764-2e14c7d3f455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:45.116123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f005e974-1e8a-489e-b764-2e14c7d3f455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:45.116586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f005e974-1e8a-489e-b764-2e14c7d3f455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:45.117350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f005e974-1e8a-489e-b764-2e14c7d3f455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:45.117785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f005e974-1e8a-489e-b764-2e14c7d3f455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:45.322619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f005e974-1e8a-489e-b764-2e14c7d3f455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:45.332703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f005e974-1e8a-489e-b764-2e14c7d3f455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:45.334516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f005e974-1e8a-489e-b764-2e14c7d3f455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:45.335701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f005e974-1e8a-489e-b764-2e14c7d3f455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.230646 Jun 20 07:28:45.336285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 860/1603] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:45 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:45.576257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f713b0e1-ad09-4679-96c7-5a8a9b57b885 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:45.576919 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f713b0e1-ad09-4679-96c7-5a8a9b57b885 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:45.583450 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f713b0e1-ad09-4679-96c7-5a8a9b57b885 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:45.583845 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f713b0e1-ad09-4679-96c7-5a8a9b57b885 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:45.584644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f713b0e1-ad09-4679-96c7-5a8a9b57b885 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:45.585086 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f713b0e1-ad09-4679-96c7-5a8a9b57b885 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:45.610430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:28:45.615432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:28:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c (ip 10.222.0.23) !!! Jun 20 07:28:45.770956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f713b0e1-ad09-4679-96c7-5a8a9b57b885 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:45.778949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f713b0e1-ad09-4679-96c7-5a8a9b57b885 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.206684 Jun 20 07:28:45.779542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 744/1604] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:45 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:46.353299 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-424a83b9-0e99-4bdd-81e8-6852117695ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:46.353912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-424a83b9-0e99-4bdd-81e8-6852117695ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:46.360675 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-424a83b9-0e99-4bdd-81e8-6852117695ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:46.361337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-424a83b9-0e99-4bdd-81e8-6852117695ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:46.362786 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-424a83b9-0e99-4bdd-81e8-6852117695ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:46.363382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-424a83b9-0e99-4bdd-81e8-6852117695ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:46.504073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-424a83b9-0e99-4bdd-81e8-6852117695ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:46.513022 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-424a83b9-0e99-4bdd-81e8-6852117695ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:46.514514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-424a83b9-0e99-4bdd-81e8-6852117695ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:46.515703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-424a83b9-0e99-4bdd-81e8-6852117695ae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.166275 Jun 20 07:28:46.516294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 861/1605] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:46 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:46.795210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-012e47c8-ddc8-43d4-916c-ac9f33eb8ef2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:46.795833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-012e47c8-ddc8-43d4-916c-ac9f33eb8ef2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:46.803142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-012e47c8-ddc8-43d4-916c-ac9f33eb8ef2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:46.803591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-012e47c8-ddc8-43d4-916c-ac9f33eb8ef2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:46.804388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-012e47c8-ddc8-43d4-916c-ac9f33eb8ef2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:46.805127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-012e47c8-ddc8-43d4-916c-ac9f33eb8ef2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:46.946847 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-012e47c8-ddc8-43d4-916c-ac9f33eb8ef2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:46.954875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-012e47c8-ddc8-43d4-916c-ac9f33eb8ef2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.163538 Jun 20 07:28:46.955456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 745/1606] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:46 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:47.534429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0e6457b6-8ac1-4bd1-a2a5-a9fefa86bad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:47.535398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0e6457b6-8ac1-4bd1-a2a5-a9fefa86bad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:47.541699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e6457b6-8ac1-4bd1-a2a5-a9fefa86bad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:47.542214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e6457b6-8ac1-4bd1-a2a5-a9fefa86bad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:47.542976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e6457b6-8ac1-4bd1-a2a5-a9fefa86bad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:47.543411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0e6457b6-8ac1-4bd1-a2a5-a9fefa86bad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:47.705067 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0e6457b6-8ac1-4bd1-a2a5-a9fefa86bad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:47.719030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0e6457b6-8ac1-4bd1-a2a5-a9fefa86bad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:47.720631 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0e6457b6-8ac1-4bd1-a2a5-a9fefa86bad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:47.722684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0e6457b6-8ac1-4bd1-a2a5-a9fefa86bad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.192705 Jun 20 07:28:47.723278 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 862/1607] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:47 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:47.973157 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e372efab-3ca1-42f9-9ead-df352ff5c0e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:47.973807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e372efab-3ca1-42f9-9ead-df352ff5c0e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:47.980458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e372efab-3ca1-42f9-9ead-df352ff5c0e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:47.980908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e372efab-3ca1-42f9-9ead-df352ff5c0e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:47.981766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e372efab-3ca1-42f9-9ead-df352ff5c0e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:47.982204 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e372efab-3ca1-42f9-9ead-df352ff5c0e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:47.986178 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:28:48.133330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e372efab-3ca1-42f9-9ead-df352ff5c0e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:48.141434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e372efab-3ca1-42f9-9ead-df352ff5c0e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.172523 Jun 20 07:28:48.142001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 746/1608] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:47 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:48.740417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-02c11305-922d-4323-adaa-8b6208eb51dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:48.741032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-02c11305-922d-4323-adaa-8b6208eb51dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:48.747502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02c11305-922d-4323-adaa-8b6208eb51dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:48.747952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02c11305-922d-4323-adaa-8b6208eb51dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:48.748751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02c11305-922d-4323-adaa-8b6208eb51dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:48.749192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-02c11305-922d-4323-adaa-8b6208eb51dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:48.880526 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-02c11305-922d-4323-adaa-8b6208eb51dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:48.889298 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-02c11305-922d-4323-adaa-8b6208eb51dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:48.890798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-02c11305-922d-4323-adaa-8b6208eb51dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:48.891957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-02c11305-922d-4323-adaa-8b6208eb51dd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155530 Jun 20 07:28:48.892545 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 863/1609] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:48 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:49.157668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cbbbcb5c-ae4a-450b-8184-fce60098fa03 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:49.158116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cbbbcb5c-ae4a-450b-8184-fce60098fa03 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:49.164527 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbbbcb5c-ae4a-450b-8184-fce60098fa03 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:49.164984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbbbcb5c-ae4a-450b-8184-fce60098fa03 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:49.165748 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbbbcb5c-ae4a-450b-8184-fce60098fa03 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:49.166186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cbbbcb5c-ae4a-450b-8184-fce60098fa03 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:49.291988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cbbbcb5c-ae4a-450b-8184-fce60098fa03 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:49.300413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cbbbcb5c-ae4a-450b-8184-fce60098fa03 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146786 Jun 20 07:28:49.300994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 747/1610] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:49 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:49.915725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c9798a2-7970-496f-91f6-7df0e21f551d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:49.915725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2c9798a2-7970-496f-91f6-7df0e21f551d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:49.920244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c9798a2-7970-496f-91f6-7df0e21f551d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:49.920689 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c9798a2-7970-496f-91f6-7df0e21f551d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:49.921450 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c9798a2-7970-496f-91f6-7df0e21f551d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:49.921931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c9798a2-7970-496f-91f6-7df0e21f551d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:50.050621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c9798a2-7970-496f-91f6-7df0e21f551d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:50.058864 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c9798a2-7970-496f-91f6-7df0e21f551d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:50.060376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c9798a2-7970-496f-91f6-7df0e21f551d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:50.061521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2c9798a2-7970-496f-91f6-7df0e21f551d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154599 Jun 20 07:28:50.062091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 864/1611] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:49 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:50.317092 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0f903805-3cb5-4c41-9302-58d2f617cfdb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:50.317711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0f903805-3cb5-4c41-9302-58d2f617cfdb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:50.323878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f903805-3cb5-4c41-9302-58d2f617cfdb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:50.324377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f903805-3cb5-4c41-9302-58d2f617cfdb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:50.325174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f903805-3cb5-4c41-9302-58d2f617cfdb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:50.325614 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f903805-3cb5-4c41-9302-58d2f617cfdb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:50.453080 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0f903805-3cb5-4c41-9302-58d2f617cfdb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:50.461477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0f903805-3cb5-4c41-9302-58d2f617cfdb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148825 Jun 20 07:28:50.462075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 748/1612] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:50 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:51.079720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-398a906c-d239-474f-b7ca-398db008eee2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:51.080364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-398a906c-d239-474f-b7ca-398db008eee2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:51.086931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-398a906c-d239-474f-b7ca-398db008eee2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:51.087370 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-398a906c-d239-474f-b7ca-398db008eee2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:51.088150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-398a906c-d239-474f-b7ca-398db008eee2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:51.088591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-398a906c-d239-474f-b7ca-398db008eee2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:51.224437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-398a906c-d239-474f-b7ca-398db008eee2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:51.233135 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-398a906c-d239-474f-b7ca-398db008eee2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:51.234626 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-398a906c-d239-474f-b7ca-398db008eee2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:51.235775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-398a906c-d239-474f-b7ca-398db008eee2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.160079 Jun 20 07:28:51.236342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 865/1613] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:51 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:51.478894 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f64297c-ad89-4a94-ae62-081726d2536d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:51.479460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9f64297c-ad89-4a94-ae62-081726d2536d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:51.485880 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f64297c-ad89-4a94-ae62-081726d2536d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:51.486331 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f64297c-ad89-4a94-ae62-081726d2536d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:51.487151 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f64297c-ad89-4a94-ae62-081726d2536d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:51.487597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f64297c-ad89-4a94-ae62-081726d2536d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:51.617094 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9f64297c-ad89-4a94-ae62-081726d2536d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:51.624904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9f64297c-ad89-4a94-ae62-081726d2536d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150196 Jun 20 07:28:51.625459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 749/1614] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:51 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:52.255162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-824f5823-ec72-42b3-adba-a5ebba1bd127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:52.255739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-824f5823-ec72-42b3-adba-a5ebba1bd127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:52.262506 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-824f5823-ec72-42b3-adba-a5ebba1bd127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:52.262957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-824f5823-ec72-42b3-adba-a5ebba1bd127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:52.263720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-824f5823-ec72-42b3-adba-a5ebba1bd127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:52.264182 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-824f5823-ec72-42b3-adba-a5ebba1bd127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:52.393781 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-824f5823-ec72-42b3-adba-a5ebba1bd127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:52.402097 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-824f5823-ec72-42b3-adba-a5ebba1bd127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:52.403588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-824f5823-ec72-42b3-adba-a5ebba1bd127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:52.404765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-824f5823-ec72-42b3-adba-a5ebba1bd127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153601 Jun 20 07:28:52.405333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 866/1615] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:52 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:52.642027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c72ba4c0-1650-4e46-8e9e-f507c6572fa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:52.642676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c72ba4c0-1650-4e46-8e9e-f507c6572fa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:52.649743 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c72ba4c0-1650-4e46-8e9e-f507c6572fa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:52.650194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c72ba4c0-1650-4e46-8e9e-f507c6572fa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:52.650957 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c72ba4c0-1650-4e46-8e9e-f507c6572fa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:52.651397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c72ba4c0-1650-4e46-8e9e-f507c6572fa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:52.779987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c72ba4c0-1650-4e46-8e9e-f507c6572fa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:52.787243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:28:52.787392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:28:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:28:52.787869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c72ba4c0-1650-4e46-8e9e-f507c6572fa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149702 Jun 20 07:28:52.788452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 750/1616] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:52 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:53.423477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e5b245fa-3002-4d4f-ae37-3a300a4ff09c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:53.424094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e5b245fa-3002-4d4f-ae37-3a300a4ff09c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:53.431117 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5b245fa-3002-4d4f-ae37-3a300a4ff09c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:53.431560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5b245fa-3002-4d4f-ae37-3a300a4ff09c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:53.432352 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5b245fa-3002-4d4f-ae37-3a300a4ff09c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:53.432791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5b245fa-3002-4d4f-ae37-3a300a4ff09c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:53.436660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:28:53.563673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e5b245fa-3002-4d4f-ae37-3a300a4ff09c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:53.571932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e5b245fa-3002-4d4f-ae37-3a300a4ff09c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:53.573448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e5b245fa-3002-4d4f-ae37-3a300a4ff09c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:53.574589 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e5b245fa-3002-4d4f-ae37-3a300a4ff09c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154935 Jun 20 07:28:53.575165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 867/1617] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:53 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:53.804793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e3575ea8-b934-41be-ad0f-9562f56cc623 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:53.805416 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e3575ea8-b934-41be-ad0f-9562f56cc623 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:53.811851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3575ea8-b934-41be-ad0f-9562f56cc623 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:53.812343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3575ea8-b934-41be-ad0f-9562f56cc623 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:53.813102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3575ea8-b934-41be-ad0f-9562f56cc623 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:53.813545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3575ea8-b934-41be-ad0f-9562f56cc623 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:53.938503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e3575ea8-b934-41be-ad0f-9562f56cc623 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:53.948883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e3575ea8-b934-41be-ad0f-9562f56cc623 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147905 Jun 20 07:28:53.949458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 751/1618] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:53 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:54.592922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-40d75e32-4f25-407e-b916-bf3ccbc7cf45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:54.593464 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-40d75e32-4f25-407e-b916-bf3ccbc7cf45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:54.599863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40d75e32-4f25-407e-b916-bf3ccbc7cf45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:54.600349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40d75e32-4f25-407e-b916-bf3ccbc7cf45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:54.601101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40d75e32-4f25-407e-b916-bf3ccbc7cf45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:54.601533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40d75e32-4f25-407e-b916-bf3ccbc7cf45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:54.732706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-40d75e32-4f25-407e-b916-bf3ccbc7cf45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:54.741559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-40d75e32-4f25-407e-b916-bf3ccbc7cf45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:54.743055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-40d75e32-4f25-407e-b916-bf3ccbc7cf45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:54.744239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-40d75e32-4f25-407e-b916-bf3ccbc7cf45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155345 Jun 20 07:28:54.744797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 868/1619] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:54 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:54.966446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8ff0881a-d710-40db-ab6a-23fcf758139b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:54.966994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8ff0881a-d710-40db-ab6a-23fcf758139b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:54.973400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ff0881a-d710-40db-ab6a-23fcf758139b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:54.973848 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ff0881a-d710-40db-ab6a-23fcf758139b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:54.974607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ff0881a-d710-40db-ab6a-23fcf758139b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:54.975039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ff0881a-d710-40db-ab6a-23fcf758139b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:55.103533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8ff0881a-d710-40db-ab6a-23fcf758139b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:55.111334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8ff0881a-d710-40db-ab6a-23fcf758139b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148858 Jun 20 07:28:55.111893 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 752/1620] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:54 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:55.763254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-84397ced-de10-4795-b3ea-20e88220c0a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:55.763857 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-84397ced-de10-4795-b3ea-20e88220c0a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:55.770294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84397ced-de10-4795-b3ea-20e88220c0a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:55.770732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84397ced-de10-4795-b3ea-20e88220c0a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:55.771482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84397ced-de10-4795-b3ea-20e88220c0a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:55.771912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-84397ced-de10-4795-b3ea-20e88220c0a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:55.902618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-84397ced-de10-4795-b3ea-20e88220c0a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:55.911361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-84397ced-de10-4795-b3ea-20e88220c0a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:55.912883 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-84397ced-de10-4795-b3ea-20e88220c0a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:55.914054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-84397ced-de10-4795-b3ea-20e88220c0a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154716 Jun 20 07:28:55.914609 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 869/1621] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:55 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:56.128187 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-17be1135-4add-44e4-ac7e-ce05afe657f3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:56.128808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-17be1135-4add-44e4-ac7e-ce05afe657f3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:56.135505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17be1135-4add-44e4-ac7e-ce05afe657f3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:56.135946 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17be1135-4add-44e4-ac7e-ce05afe657f3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:56.136734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17be1135-4add-44e4-ac7e-ce05afe657f3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:56.137164 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-17be1135-4add-44e4-ac7e-ce05afe657f3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:56.266620 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-17be1135-4add-44e4-ac7e-ce05afe657f3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:56.275121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-17be1135-4add-44e4-ac7e-ce05afe657f3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150790 Jun 20 07:28:56.275684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 753/1622] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:56 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:56.933122 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d57fa8f2-f071-4bbf-b262-267c2841931f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:56.933728 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d57fa8f2-f071-4bbf-b262-267c2841931f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:56.941421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d57fa8f2-f071-4bbf-b262-267c2841931f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:56.941878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d57fa8f2-f071-4bbf-b262-267c2841931f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:56.942635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d57fa8f2-f071-4bbf-b262-267c2841931f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:56.943074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d57fa8f2-f071-4bbf-b262-267c2841931f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:57.075150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d57fa8f2-f071-4bbf-b262-267c2841931f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:57.083383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d57fa8f2-f071-4bbf-b262-267c2841931f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:57.084900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d57fa8f2-f071-4bbf-b262-267c2841931f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:57.086038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d57fa8f2-f071-4bbf-b262-267c2841931f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.156837 Jun 20 07:28:57.086587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 870/1623] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:56 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:57.292048 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-45d2d063-c4b0-4f29-85b8-0e3eddac9757 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:57.292703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-45d2d063-c4b0-4f29-85b8-0e3eddac9757 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:57.299698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45d2d063-c4b0-4f29-85b8-0e3eddac9757 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:57.300213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45d2d063-c4b0-4f29-85b8-0e3eddac9757 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:57.301010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45d2d063-c4b0-4f29-85b8-0e3eddac9757 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:57.301462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45d2d063-c4b0-4f29-85b8-0e3eddac9757 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:57.666867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45d2d063-c4b0-4f29-85b8-0e3eddac9757 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:57.674856 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-45d2d063-c4b0-4f29-85b8-0e3eddac9757 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.386647 Jun 20 07:28:57.675422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 754/1624] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:57 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:58.105217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8c45f4d7-8599-47f4-a8f0-45b30979f125 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:58.105831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8c45f4d7-8599-47f4-a8f0-45b30979f125 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:58.112349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c45f4d7-8599-47f4-a8f0-45b30979f125 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:58.112803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c45f4d7-8599-47f4-a8f0-45b30979f125 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:58.113565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c45f4d7-8599-47f4-a8f0-45b30979f125 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:58.114003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c45f4d7-8599-47f4-a8f0-45b30979f125 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:58.239712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8c45f4d7-8599-47f4-a8f0-45b30979f125 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:58.247961 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8c45f4d7-8599-47f4-a8f0-45b30979f125 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:58.249586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8c45f4d7-8599-47f4-a8f0-45b30979f125 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:58.250727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8c45f4d7-8599-47f4-a8f0-45b30979f125 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149450 Jun 20 07:28:58.251284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 871/1625] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:58 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:28:58.692419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9422abe3-87fc-489d-b33c-c5a189145368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:58.693039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9422abe3-87fc-489d-b33c-c5a189145368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:58.699442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9422abe3-87fc-489d-b33c-c5a189145368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:58.699885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9422abe3-87fc-489d-b33c-c5a189145368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:58.700664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9422abe3-87fc-489d-b33c-c5a189145368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:58.701100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9422abe3-87fc-489d-b33c-c5a189145368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:58.828335 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9422abe3-87fc-489d-b33c-c5a189145368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:58.836073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9422abe3-87fc-489d-b33c-c5a189145368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147455 Jun 20 07:28:58.836647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 755/1626] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:58 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:28:59.269919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-22e84cf9-98b3-4f06-aa59-f0550e4181c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:59.270531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-22e84cf9-98b3-4f06-aa59-f0550e4181c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:59.277150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22e84cf9-98b3-4f06-aa59-f0550e4181c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:59.277604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22e84cf9-98b3-4f06-aa59-f0550e4181c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:59.278367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22e84cf9-98b3-4f06-aa59-f0550e4181c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:59.278804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22e84cf9-98b3-4f06-aa59-f0550e4181c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:59.408794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-22e84cf9-98b3-4f06-aa59-f0550e4181c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:59.417951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-22e84cf9-98b3-4f06-aa59-f0550e4181c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:59.419538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-22e84cf9-98b3-4f06-aa59-f0550e4181c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:28:59.420735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-22e84cf9-98b3-4f06-aa59-f0550e4181c6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154733 Jun 20 07:28:59.421281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 872/1627] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:28:59 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:28:59.853364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d3e58652-154c-4482-97da-6888c2188de1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:28:59.853992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d3e58652-154c-4482-97da-6888c2188de1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:28:59.860437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d3e58652-154c-4482-97da-6888c2188de1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:59.860890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d3e58652-154c-4482-97da-6888c2188de1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:59.861646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d3e58652-154c-4482-97da-6888c2188de1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:28:59.862084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d3e58652-154c-4482-97da-6888c2188de1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:28:59.994887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d3e58652-154c-4482-97da-6888c2188de1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:00.003083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d3e58652-154c-4482-97da-6888c2188de1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.153545 Jun 20 07:29:00.003643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 756/1628] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:28:59 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:00.438406 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-87667929-38e3-446b-8e57-a786ee1dc46f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:00.439003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-87667929-38e3-446b-8e57-a786ee1dc46f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:00.446257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87667929-38e3-446b-8e57-a786ee1dc46f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:00.446696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87667929-38e3-446b-8e57-a786ee1dc46f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:00.447451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87667929-38e3-446b-8e57-a786ee1dc46f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:00.447878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87667929-38e3-446b-8e57-a786ee1dc46f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:00.575661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-87667929-38e3-446b-8e57-a786ee1dc46f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:00.583985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-87667929-38e3-446b-8e57-a786ee1dc46f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:00.585498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-87667929-38e3-446b-8e57-a786ee1dc46f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:00.586644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-87667929-38e3-446b-8e57-a786ee1dc46f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151999 Jun 20 07:29:00.587196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 873/1629] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:00 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:01.019698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-10ee7b30-d671-4f9e-9c80-c7d9ce9fe4fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:01.020350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-10ee7b30-d671-4f9e-9c80-c7d9ce9fe4fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:01.026815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10ee7b30-d671-4f9e-9c80-c7d9ce9fe4fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:01.027261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10ee7b30-d671-4f9e-9c80-c7d9ce9fe4fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:01.028017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10ee7b30-d671-4f9e-9c80-c7d9ce9fe4fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:01.028480 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10ee7b30-d671-4f9e-9c80-c7d9ce9fe4fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:01.153841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-10ee7b30-d671-4f9e-9c80-c7d9ce9fe4fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:01.162118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-10ee7b30-d671-4f9e-9c80-c7d9ce9fe4fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146317 Jun 20 07:29:01.162672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 757/1630] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:01 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:01.605496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0ceabf55-3a53-4938-a175-c61b5b3d6cc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:01.606106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0ceabf55-3a53-4938-a175-c61b5b3d6cc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:01.612654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ceabf55-3a53-4938-a175-c61b5b3d6cc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:01.613095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ceabf55-3a53-4938-a175-c61b5b3d6cc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:01.613847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ceabf55-3a53-4938-a175-c61b5b3d6cc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:01.614282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ceabf55-3a53-4938-a175-c61b5b3d6cc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:01.748311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0ceabf55-3a53-4938-a175-c61b5b3d6cc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:01.757359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0ceabf55-3a53-4938-a175-c61b5b3d6cc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:01.758877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0ceabf55-3a53-4938-a175-c61b5b3d6cc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:01.760025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0ceabf55-3a53-4938-a175-c61b5b3d6cc4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.158367 Jun 20 07:29:01.760605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 874/1631] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:01 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:02.179523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6e4fd057-b5d7-491a-87ee-4401552124aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:02.180200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6e4fd057-b5d7-491a-87ee-4401552124aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:02.186765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e4fd057-b5d7-491a-87ee-4401552124aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:02.187213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e4fd057-b5d7-491a-87ee-4401552124aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:02.187976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e4fd057-b5d7-491a-87ee-4401552124aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:02.188439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e4fd057-b5d7-491a-87ee-4401552124aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:02.314585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6e4fd057-b5d7-491a-87ee-4401552124aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:02.322588 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6e4fd057-b5d7-491a-87ee-4401552124aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147516 Jun 20 07:29:02.323155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 758/1632] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:02 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:02.778826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4607880d-36a5-4a04-aa3f-f1e067ba3631 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:02.779432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4607880d-36a5-4a04-aa3f-f1e067ba3631 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:02.786538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4607880d-36a5-4a04-aa3f-f1e067ba3631 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:02.786976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4607880d-36a5-4a04-aa3f-f1e067ba3631 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:02.787720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4607880d-36a5-4a04-aa3f-f1e067ba3631 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:02.788171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4607880d-36a5-4a04-aa3f-f1e067ba3631 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:02.919677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4607880d-36a5-4a04-aa3f-f1e067ba3631 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:02.927927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4607880d-36a5-4a04-aa3f-f1e067ba3631 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:02.929437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4607880d-36a5-4a04-aa3f-f1e067ba3631 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:02.930573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4607880d-36a5-4a04-aa3f-f1e067ba3631 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155663 Jun 20 07:29:02.931124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 875/1633] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:02 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:03.338795 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9fb31423-ca27-4db8-ad73-1d38c25dfe9d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:03.339322 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9fb31423-ca27-4db8-ad73-1d38c25dfe9d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:03.345751 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9fb31423-ca27-4db8-ad73-1d38c25dfe9d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:03.346196 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9fb31423-ca27-4db8-ad73-1d38c25dfe9d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:03.346945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9fb31423-ca27-4db8-ad73-1d38c25dfe9d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:03.347889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9fb31423-ca27-4db8-ad73-1d38c25dfe9d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:03.478091 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9fb31423-ca27-4db8-ad73-1d38c25dfe9d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:03.485908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9fb31423-ca27-4db8-ad73-1d38c25dfe9d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151073 Jun 20 07:29:03.486465 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 759/1634] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:03 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:03.949289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a673aa5d-e2c6-4f6e-aea9-249ca6758e0f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:03.949933 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a673aa5d-e2c6-4f6e-aea9-249ca6758e0f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:03.957131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a673aa5d-e2c6-4f6e-aea9-249ca6758e0f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:03.957580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a673aa5d-e2c6-4f6e-aea9-249ca6758e0f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:03.958343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a673aa5d-e2c6-4f6e-aea9-249ca6758e0f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:03.958773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a673aa5d-e2c6-4f6e-aea9-249ca6758e0f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:04.086685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a673aa5d-e2c6-4f6e-aea9-249ca6758e0f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:04.094929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a673aa5d-e2c6-4f6e-aea9-249ca6758e0f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:04.096504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a673aa5d-e2c6-4f6e-aea9-249ca6758e0f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:04.097721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a673aa5d-e2c6-4f6e-aea9-249ca6758e0f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152405 Jun 20 07:29:04.098269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 876/1635] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:03 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:29:04.502673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe39ef9e-8ed0-41fa-b11e-875a94ed6fcd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:04.503337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe39ef9e-8ed0-41fa-b11e-875a94ed6fcd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:04.510555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe39ef9e-8ed0-41fa-b11e-875a94ed6fcd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:04.510993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe39ef9e-8ed0-41fa-b11e-875a94ed6fcd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:04.511740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe39ef9e-8ed0-41fa-b11e-875a94ed6fcd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:04.512274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe39ef9e-8ed0-41fa-b11e-875a94ed6fcd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:04.643085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe39ef9e-8ed0-41fa-b11e-875a94ed6fcd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:04.650922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe39ef9e-8ed0-41fa-b11e-875a94ed6fcd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.152084 Jun 20 07:29:04.651476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 760/1636] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:04 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:05.115730 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fa0dcb13-3e91-4282-8ab9-6857d7573049 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:05.116369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fa0dcb13-3e91-4282-8ab9-6857d7573049 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:05.122889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa0dcb13-3e91-4282-8ab9-6857d7573049 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:05.123336 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa0dcb13-3e91-4282-8ab9-6857d7573049 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:05.124096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa0dcb13-3e91-4282-8ab9-6857d7573049 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:05.124554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa0dcb13-3e91-4282-8ab9-6857d7573049 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:05.248948 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fa0dcb13-3e91-4282-8ab9-6857d7573049 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:05.257558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fa0dcb13-3e91-4282-8ab9-6857d7573049 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:05.259059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fa0dcb13-3e91-4282-8ab9-6857d7573049 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:05.260251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fa0dcb13-3e91-4282-8ab9-6857d7573049 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.148344 Jun 20 07:29:05.260805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 877/1637] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:05 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:05.668337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e27b8da0-a02a-4384-8031-820c72a1f4d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:05.668952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e27b8da0-a02a-4384-8031-820c72a1f4d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:05.675903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e27b8da0-a02a-4384-8031-820c72a1f4d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:05.676385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e27b8da0-a02a-4384-8031-820c72a1f4d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:05.677143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e27b8da0-a02a-4384-8031-820c72a1f4d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:05.677575 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e27b8da0-a02a-4384-8031-820c72a1f4d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:05.811653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e27b8da0-a02a-4384-8031-820c72a1f4d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:05.820197 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e27b8da0-a02a-4384-8031-820c72a1f4d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.155706 Jun 20 07:29:05.820765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 761/1638] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:05 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:06.278979 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3d445dbe-06f1-4063-9792-bb4dad509ddf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:06.279593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3d445dbe-06f1-4063-9792-bb4dad509ddf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:06.286536 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d445dbe-06f1-4063-9792-bb4dad509ddf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:06.286981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d445dbe-06f1-4063-9792-bb4dad509ddf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:06.287739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d445dbe-06f1-4063-9792-bb4dad509ddf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:06.288199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3d445dbe-06f1-4063-9792-bb4dad509ddf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:06.413766 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3d445dbe-06f1-4063-9792-bb4dad509ddf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:06.422471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3d445dbe-06f1-4063-9792-bb4dad509ddf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:06.423964 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3d445dbe-06f1-4063-9792-bb4dad509ddf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:06.425736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3d445dbe-06f1-4063-9792-bb4dad509ddf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150068 Jun 20 07:29:06.426294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 878/1639] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:06 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:06.837235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c90dc965-3c3b-44b0-bd75-b1ab5c3547f8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:06.837854 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c90dc965-3c3b-44b0-bd75-b1ab5c3547f8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:06.844260 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c90dc965-3c3b-44b0-bd75-b1ab5c3547f8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:06.844711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c90dc965-3c3b-44b0-bd75-b1ab5c3547f8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:06.845469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c90dc965-3c3b-44b0-bd75-b1ab5c3547f8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:06.845907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c90dc965-3c3b-44b0-bd75-b1ab5c3547f8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:06.974588 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c90dc965-3c3b-44b0-bd75-b1ab5c3547f8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:06.976791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:29:06.983594 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c90dc965-3c3b-44b0-bd75-b1ab5c3547f8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150172 Jun 20 07:29:06.984181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 762/1640] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:06 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:07.444941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-004cb745-90a5-43f0-8c21-78c3acc2dc59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:07.445557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-004cb745-90a5-43f0-8c21-78c3acc2dc59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:07.452494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-004cb745-90a5-43f0-8c21-78c3acc2dc59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:07.452946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-004cb745-90a5-43f0-8c21-78c3acc2dc59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:07.453712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-004cb745-90a5-43f0-8c21-78c3acc2dc59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:07.454149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-004cb745-90a5-43f0-8c21-78c3acc2dc59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:07.582927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-004cb745-90a5-43f0-8c21-78c3acc2dc59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:07.591272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-004cb745-90a5-43f0-8c21-78c3acc2dc59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:07.592822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-004cb745-90a5-43f0-8c21-78c3acc2dc59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:07.593977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-004cb745-90a5-43f0-8c21-78c3acc2dc59 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153604 Jun 20 07:29:07.594538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 879/1641] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:07 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:08.000663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6dd3a4a3-8a1f-4b67-a433-905ce39eff6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:08.001210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6dd3a4a3-8a1f-4b67-a433-905ce39eff6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:08.009504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6dd3a4a3-8a1f-4b67-a433-905ce39eff6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:08.010287 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6dd3a4a3-8a1f-4b67-a433-905ce39eff6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:08.011142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6dd3a4a3-8a1f-4b67-a433-905ce39eff6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:08.011587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6dd3a4a3-8a1f-4b67-a433-905ce39eff6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:08.138897 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6dd3a4a3-8a1f-4b67-a433-905ce39eff6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:08.147194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6dd3a4a3-8a1f-4b67-a433-905ce39eff6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150485 Jun 20 07:29:08.147753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 763/1642] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:07 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:08.613419 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8041a645-dbaf-4a6b-988e-ff38f04db83c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:08.613953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8041a645-dbaf-4a6b-988e-ff38f04db83c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:08.620414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8041a645-dbaf-4a6b-988e-ff38f04db83c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:08.620864 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8041a645-dbaf-4a6b-988e-ff38f04db83c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:08.621622 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8041a645-dbaf-4a6b-988e-ff38f04db83c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:08.622060 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8041a645-dbaf-4a6b-988e-ff38f04db83c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:08.752580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8041a645-dbaf-4a6b-988e-ff38f04db83c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:08.761140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8041a645-dbaf-4a6b-988e-ff38f04db83c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:08.762643 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8041a645-dbaf-4a6b-988e-ff38f04db83c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:08.763798 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8041a645-dbaf-4a6b-988e-ff38f04db83c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154985 Jun 20 07:29:08.764398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 880/1643] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:08 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:09.163966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c9add5a8-4996-41f5-95ef-36f3e6b8a786 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:09.164618 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c9add5a8-4996-41f5-95ef-36f3e6b8a786 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:09.171017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9add5a8-4996-41f5-95ef-36f3e6b8a786 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:09.171474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9add5a8-4996-41f5-95ef-36f3e6b8a786 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:09.172266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9add5a8-4996-41f5-95ef-36f3e6b8a786 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:09.172708 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c9add5a8-4996-41f5-95ef-36f3e6b8a786 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:09.297571 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c9add5a8-4996-41f5-95ef-36f3e6b8a786 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:09.305420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c9add5a8-4996-41f5-95ef-36f3e6b8a786 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145309 Jun 20 07:29:09.305983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 764/1644] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:09 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:09.782815 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-36812b2b-c152-46c2-a071-0e31c76b7d8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:09.783448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-36812b2b-c152-46c2-a071-0e31c76b7d8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:09.790434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36812b2b-c152-46c2-a071-0e31c76b7d8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:09.790890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36812b2b-c152-46c2-a071-0e31c76b7d8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:09.791655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36812b2b-c152-46c2-a071-0e31c76b7d8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:09.792091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-36812b2b-c152-46c2-a071-0e31c76b7d8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:09.922844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36812b2b-c152-46c2-a071-0e31c76b7d8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:09.931865 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36812b2b-c152-46c2-a071-0e31c76b7d8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:09.933657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-36812b2b-c152-46c2-a071-0e31c76b7d8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:09.934803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-36812b2b-c152-46c2-a071-0e31c76b7d8c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155907 Jun 20 07:29:09.935350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 881/1645] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:09 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:10.322301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-613edc86-87f2-4314-9aa5-e334cc7388d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:10.322931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-613edc86-87f2-4314-9aa5-e334cc7388d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:10.329399 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-613edc86-87f2-4314-9aa5-e334cc7388d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:10.329853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-613edc86-87f2-4314-9aa5-e334cc7388d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:10.330621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-613edc86-87f2-4314-9aa5-e334cc7388d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:10.331058 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-613edc86-87f2-4314-9aa5-e334cc7388d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:10.462841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-613edc86-87f2-4314-9aa5-e334cc7388d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:10.470823 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-613edc86-87f2-4314-9aa5-e334cc7388d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.152415 Jun 20 07:29:10.471389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 765/1646] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:10 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:10.957918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c6a7c22e-9f8f-4a56-99c2-423a9192ac75 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:10.958531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c6a7c22e-9f8f-4a56-99c2-423a9192ac75 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:10.965754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6a7c22e-9f8f-4a56-99c2-423a9192ac75 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:10.966205 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6a7c22e-9f8f-4a56-99c2-423a9192ac75 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:10.967077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6a7c22e-9f8f-4a56-99c2-423a9192ac75 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:10.967392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c6a7c22e-9f8f-4a56-99c2-423a9192ac75 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:11.093168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c6a7c22e-9f8f-4a56-99c2-423a9192ac75 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:11.101623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c6a7c22e-9f8f-4a56-99c2-423a9192ac75 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:11.103156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c6a7c22e-9f8f-4a56-99c2-423a9192ac75 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:11.104350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c6a7c22e-9f8f-4a56-99c2-423a9192ac75 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150338 Jun 20 07:29:11.104912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 882/1647] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:10 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:11.488259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d6c271e-89bd-4bf3-a863-158764025165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:11.488812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1d6c271e-89bd-4bf3-a863-158764025165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:11.495318 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d6c271e-89bd-4bf3-a863-158764025165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:11.495772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d6c271e-89bd-4bf3-a863-158764025165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:11.496829 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d6c271e-89bd-4bf3-a863-158764025165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:11.497266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d6c271e-89bd-4bf3-a863-158764025165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:11.627180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1d6c271e-89bd-4bf3-a863-158764025165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:11.635882 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1d6c271e-89bd-4bf3-a863-158764025165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151628 Jun 20 07:29:11.636498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 766/1648] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:11 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:12.122610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-01fae590-0709-4c10-be91-5b4ccadb0f56 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:12.123254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-01fae590-0709-4c10-be91-5b4ccadb0f56 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:12.129797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01fae590-0709-4c10-be91-5b4ccadb0f56 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:12.130253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01fae590-0709-4c10-be91-5b4ccadb0f56 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:12.131255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01fae590-0709-4c10-be91-5b4ccadb0f56 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:12.131697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01fae590-0709-4c10-be91-5b4ccadb0f56 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:12.256815 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-01fae590-0709-4c10-be91-5b4ccadb0f56 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:12.258956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:29:12.266351 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-01fae590-0709-4c10-be91-5b4ccadb0f56 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:12.267840 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-01fae590-0709-4c10-be91-5b4ccadb0f56 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:12.269026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-01fae590-0709-4c10-be91-5b4ccadb0f56 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150278 Jun 20 07:29:12.269581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 883/1649] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:12 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:12.658555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-731dc62a-f370-4605-bdd2-a3829375430b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:12.659186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-731dc62a-f370-4605-bdd2-a3829375430b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:12.662260 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:29:12.667451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-731dc62a-f370-4605-bdd2-a3829375430b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:12.667901 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-731dc62a-f370-4605-bdd2-a3829375430b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:12.668686 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-731dc62a-f370-4605-bdd2-a3829375430b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:12.669127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-731dc62a-f370-4605-bdd2-a3829375430b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:12.798363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-731dc62a-f370-4605-bdd2-a3829375430b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:12.806115 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-731dc62a-f370-4605-bdd2-a3829375430b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151412 Jun 20 07:29:12.806679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 767/1650] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:12 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:13.286707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a055394c-3139-49fb-bbf8-78e4d2008e4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:13.287219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a055394c-3139-49fb-bbf8-78e4d2008e4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:13.293743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a055394c-3139-49fb-bbf8-78e4d2008e4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:13.294184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a055394c-3139-49fb-bbf8-78e4d2008e4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:13.294930 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a055394c-3139-49fb-bbf8-78e4d2008e4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:13.295358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a055394c-3139-49fb-bbf8-78e4d2008e4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:13.429304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a055394c-3139-49fb-bbf8-78e4d2008e4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:13.437662 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a055394c-3139-49fb-bbf8-78e4d2008e4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:13.439173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a055394c-3139-49fb-bbf8-78e4d2008e4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:13.440360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a055394c-3139-49fb-bbf8-78e4d2008e4e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157538 Jun 20 07:29:13.440932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 884/1651] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:13 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:13.822919 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0878036e-0301-46fb-a54d-6e456a555961 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:13.823560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0878036e-0301-46fb-a54d-6e456a555961 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:13.830035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0878036e-0301-46fb-a54d-6e456a555961 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:13.830483 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0878036e-0301-46fb-a54d-6e456a555961 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:13.831871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0878036e-0301-46fb-a54d-6e456a555961 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:13.832342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0878036e-0301-46fb-a54d-6e456a555961 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:13.960790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0878036e-0301-46fb-a54d-6e456a555961 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:13.968607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0878036e-0301-46fb-a54d-6e456a555961 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149526 Jun 20 07:29:13.969169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 768/1652] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:13 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:14.458736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-999aaa2a-c4b4-41f2-a68c-c875e7a41dfd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:14.459342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-999aaa2a-c4b4-41f2-a68c-c875e7a41dfd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:14.461638 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=52 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:29:14.467233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-999aaa2a-c4b4-41f2-a68c-c875e7a41dfd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:14.467687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-999aaa2a-c4b4-41f2-a68c-c875e7a41dfd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:14.468496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-999aaa2a-c4b4-41f2-a68c-c875e7a41dfd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:14.468937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-999aaa2a-c4b4-41f2-a68c-c875e7a41dfd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:14.598029 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-999aaa2a-c4b4-41f2-a68c-c875e7a41dfd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:14.606347 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-999aaa2a-c4b4-41f2-a68c-c875e7a41dfd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:14.607855 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-999aaa2a-c4b4-41f2-a68c-c875e7a41dfd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:14.609039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-999aaa2a-c4b4-41f2-a68c-c875e7a41dfd tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154151 Jun 20 07:29:14.609592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 885/1653] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:14 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:14.985637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba0285f5-4253-45f1-a122-ffdedcf35200 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:14.986190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba0285f5-4253-45f1-a122-ffdedcf35200 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:14.992843 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba0285f5-4253-45f1-a122-ffdedcf35200 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:14.993296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba0285f5-4253-45f1-a122-ffdedcf35200 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:14.994055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba0285f5-4253-45f1-a122-ffdedcf35200 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:14.994495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba0285f5-4253-45f1-a122-ffdedcf35200 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:15.120205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ba0285f5-4253-45f1-a122-ffdedcf35200 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:15.128562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba0285f5-4253-45f1-a122-ffdedcf35200 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146297 Jun 20 07:29:15.129133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 769/1654] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:14 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:15.627472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-077dc913-d656-4c61-8c1d-1ec8be341671 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:15.628719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-077dc913-d656-4c61-8c1d-1ec8be341671 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:15.635408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-077dc913-d656-4c61-8c1d-1ec8be341671 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:15.635858 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-077dc913-d656-4c61-8c1d-1ec8be341671 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:15.636663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-077dc913-d656-4c61-8c1d-1ec8be341671 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:15.637110 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-077dc913-d656-4c61-8c1d-1ec8be341671 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:15.771748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-077dc913-d656-4c61-8c1d-1ec8be341671 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:15.780454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-077dc913-d656-4c61-8c1d-1ec8be341671 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:15.782005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-077dc913-d656-4c61-8c1d-1ec8be341671 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:15.783159 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-077dc913-d656-4c61-8c1d-1ec8be341671 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.159539 Jun 20 07:29:15.783714 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 886/1655] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:15 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:16.144944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-40f2506e-70cd-4a95-b75c-a3d21ba19adf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:16.145575 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-40f2506e-70cd-4a95-b75c-a3d21ba19adf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:16.151955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40f2506e-70cd-4a95-b75c-a3d21ba19adf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:16.152428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40f2506e-70cd-4a95-b75c-a3d21ba19adf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:16.153175 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40f2506e-70cd-4a95-b75c-a3d21ba19adf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:16.153607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40f2506e-70cd-4a95-b75c-a3d21ba19adf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:16.283275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-40f2506e-70cd-4a95-b75c-a3d21ba19adf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:16.291708 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-40f2506e-70cd-4a95-b75c-a3d21ba19adf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150687 Jun 20 07:29:16.292302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 770/1656] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:16 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:16.801599 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3ede34e6-daa2-48d1-9162-b321250538b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:16.802205 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3ede34e6-daa2-48d1-9162-b321250538b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:16.808699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ede34e6-daa2-48d1-9162-b321250538b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:16.809142 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ede34e6-daa2-48d1-9162-b321250538b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:16.809900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ede34e6-daa2-48d1-9162-b321250538b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:16.810371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ede34e6-daa2-48d1-9162-b321250538b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:16.938777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3ede34e6-daa2-48d1-9162-b321250538b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:16.947690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3ede34e6-daa2-48d1-9162-b321250538b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:16.949218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3ede34e6-daa2-48d1-9162-b321250538b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:16.950369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3ede34e6-daa2-48d1-9162-b321250538b4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152718 Jun 20 07:29:16.950930 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 887/1657] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:16 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:17.308238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8f3a1d9f-f3e0-491b-8fa9-6cb2c94de771 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:17.308958 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8f3a1d9f-f3e0-491b-8fa9-6cb2c94de771 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:17.315278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f3a1d9f-f3e0-491b-8fa9-6cb2c94de771 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:17.315726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f3a1d9f-f3e0-491b-8fa9-6cb2c94de771 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:17.316508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f3a1d9f-f3e0-491b-8fa9-6cb2c94de771 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:17.316940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8f3a1d9f-f3e0-491b-8fa9-6cb2c94de771 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:17.442024 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8f3a1d9f-f3e0-491b-8fa9-6cb2c94de771 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:17.449892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8f3a1d9f-f3e0-491b-8fa9-6cb2c94de771 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145472 Jun 20 07:29:17.450457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 771/1658] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:17 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:17.968815 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ef1e336f-5f81-45ad-9ec5-f17566580d8a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:17.969451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ef1e336f-5f81-45ad-9ec5-f17566580d8a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:17.975781 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef1e336f-5f81-45ad-9ec5-f17566580d8a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:17.976267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef1e336f-5f81-45ad-9ec5-f17566580d8a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:17.977022 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef1e336f-5f81-45ad-9ec5-f17566580d8a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:17.977453 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef1e336f-5f81-45ad-9ec5-f17566580d8a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:18.111106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ef1e336f-5f81-45ad-9ec5-f17566580d8a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:18.119863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ef1e336f-5f81-45ad-9ec5-f17566580d8a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:18.121378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ef1e336f-5f81-45ad-9ec5-f17566580d8a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:18.122521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ef1e336f-5f81-45ad-9ec5-f17566580d8a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157705 Jun 20 07:29:18.123071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 888/1659] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:17 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:18.465747 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bc290f59-c4c8-49ce-b998-211d1940bd4b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:18.466366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bc290f59-c4c8-49ce-b998-211d1940bd4b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:18.473385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc290f59-c4c8-49ce-b998-211d1940bd4b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:18.473836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc290f59-c4c8-49ce-b998-211d1940bd4b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:18.474595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc290f59-c4c8-49ce-b998-211d1940bd4b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:18.475031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc290f59-c4c8-49ce-b998-211d1940bd4b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:18.605731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bc290f59-c4c8-49ce-b998-211d1940bd4b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:18.613629 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bc290f59-c4c8-49ce-b998-211d1940bd4b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151743 Jun 20 07:29:18.614202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 772/1660] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:18 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:19.141520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-776f813f-4cab-4c69-971c-ad53e1159d07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:19.142152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-776f813f-4cab-4c69-971c-ad53e1159d07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:19.149149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-776f813f-4cab-4c69-971c-ad53e1159d07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:19.149589 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-776f813f-4cab-4c69-971c-ad53e1159d07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:19.150332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-776f813f-4cab-4c69-971c-ad53e1159d07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:19.150757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-776f813f-4cab-4c69-971c-ad53e1159d07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:19.279296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-776f813f-4cab-4c69-971c-ad53e1159d07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:19.287598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-776f813f-4cab-4c69-971c-ad53e1159d07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:19.289102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-776f813f-4cab-4c69-971c-ad53e1159d07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:19.290250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-776f813f-4cab-4c69-971c-ad53e1159d07 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152564 Jun 20 07:29:19.290794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 889/1661] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:19 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:19.632618 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b95eafd-9496-45bd-b687-3ab5becd8fff tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:19.633758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2b95eafd-9496-45bd-b687-3ab5becd8fff tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:19.641578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b95eafd-9496-45bd-b687-3ab5becd8fff tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:19.642027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b95eafd-9496-45bd-b687-3ab5becd8fff tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:19.642791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b95eafd-9496-45bd-b687-3ab5becd8fff tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:19.643380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b95eafd-9496-45bd-b687-3ab5becd8fff tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:19.774217 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2b95eafd-9496-45bd-b687-3ab5becd8fff tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:19.782018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2b95eafd-9496-45bd-b687-3ab5becd8fff tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.154456 Jun 20 07:29:19.782576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 773/1662] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:19 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:20.309092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-29a115e1-aadb-4b70-b87a-8cbfe4355e2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:20.309824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-29a115e1-aadb-4b70-b87a-8cbfe4355e2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:20.316816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29a115e1-aadb-4b70-b87a-8cbfe4355e2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:20.317265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29a115e1-aadb-4b70-b87a-8cbfe4355e2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:20.318380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29a115e1-aadb-4b70-b87a-8cbfe4355e2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:20.318473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29a115e1-aadb-4b70-b87a-8cbfe4355e2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:20.545168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29a115e1-aadb-4b70-b87a-8cbfe4355e2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:20.554229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29a115e1-aadb-4b70-b87a-8cbfe4355e2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:20.555725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29a115e1-aadb-4b70-b87a-8cbfe4355e2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:20.556942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-29a115e1-aadb-4b70-b87a-8cbfe4355e2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.251756 Jun 20 07:29:20.565274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 890/1663] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:20 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:20.798771 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d125380-ff22-4c8a-af58-63dd7d792514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:20.799435 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d125380-ff22-4c8a-af58-63dd7d792514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:20.806770 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d125380-ff22-4c8a-af58-63dd7d792514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:20.807223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d125380-ff22-4c8a-af58-63dd7d792514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:20.807996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d125380-ff22-4c8a-af58-63dd7d792514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:20.808463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d125380-ff22-4c8a-af58-63dd7d792514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:20.943173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d125380-ff22-4c8a-af58-63dd7d792514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:20.951084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d125380-ff22-4c8a-af58-63dd7d792514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.156252 Jun 20 07:29:20.951648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 774/1664] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:20 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:21.575494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ccafc3fb-77d9-439f-be2d-3eafed8fe479 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:21.576099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ccafc3fb-77d9-439f-be2d-3eafed8fe479 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:21.583118 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccafc3fb-77d9-439f-be2d-3eafed8fe479 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:21.583565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccafc3fb-77d9-439f-be2d-3eafed8fe479 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:21.584354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccafc3fb-77d9-439f-be2d-3eafed8fe479 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:21.584785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccafc3fb-77d9-439f-be2d-3eafed8fe479 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:21.710125 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ccafc3fb-77d9-439f-be2d-3eafed8fe479 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:21.720463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ccafc3fb-77d9-439f-be2d-3eafed8fe479 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:21.722018 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ccafc3fb-77d9-439f-be2d-3eafed8fe479 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:21.723866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ccafc3fb-77d9-439f-be2d-3eafed8fe479 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152173 Jun 20 07:29:21.724458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 891/1665] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:21 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:21.968038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d9ac242f-e544-45b4-a8d2-45eb50865be5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:21.968626 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d9ac242f-e544-45b4-a8d2-45eb50865be5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:21.975064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9ac242f-e544-45b4-a8d2-45eb50865be5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:21.975516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9ac242f-e544-45b4-a8d2-45eb50865be5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:21.976309 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9ac242f-e544-45b4-a8d2-45eb50865be5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:21.976758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d9ac242f-e544-45b4-a8d2-45eb50865be5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:22.109026 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d9ac242f-e544-45b4-a8d2-45eb50865be5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:22.116923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d9ac242f-e544-45b4-a8d2-45eb50865be5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.152819 Jun 20 07:29:22.117491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 775/1666] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:21 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:22.742753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ae3a8de3-51b6-4a40-954e-b7da7417b4ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:22.743361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ae3a8de3-51b6-4a40-954e-b7da7417b4ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:22.749841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae3a8de3-51b6-4a40-954e-b7da7417b4ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:22.750282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae3a8de3-51b6-4a40-954e-b7da7417b4ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:22.751037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae3a8de3-51b6-4a40-954e-b7da7417b4ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:22.751465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ae3a8de3-51b6-4a40-954e-b7da7417b4ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:22.881366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae3a8de3-51b6-4a40-954e-b7da7417b4ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:22.889697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae3a8de3-51b6-4a40-954e-b7da7417b4ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:22.891194 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ae3a8de3-51b6-4a40-954e-b7da7417b4ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:22.892376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ae3a8de3-51b6-4a40-954e-b7da7417b4ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154064 Jun 20 07:29:22.892928 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 892/1667] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:23.133857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-412c7778-4c52-48b3-a2f6-e5701af3191c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:23.134475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-412c7778-4c52-48b3-a2f6-e5701af3191c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:23.141017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-412c7778-4c52-48b3-a2f6-e5701af3191c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:23.141468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-412c7778-4c52-48b3-a2f6-e5701af3191c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:23.142223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-412c7778-4c52-48b3-a2f6-e5701af3191c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:23.142666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-412c7778-4c52-48b3-a2f6-e5701af3191c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:23.266339 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-412c7778-4c52-48b3-a2f6-e5701af3191c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:23.274703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-412c7778-4c52-48b3-a2f6-e5701af3191c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145096 Jun 20 07:29:23.275260 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 776/1668] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:23 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:23.910612 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3e62a094-ae70-4e5d-9aa4-5bc28452ad83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:23.911225 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3e62a094-ae70-4e5d-9aa4-5bc28452ad83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:23.917618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e62a094-ae70-4e5d-9aa4-5bc28452ad83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:23.918066 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e62a094-ae70-4e5d-9aa4-5bc28452ad83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:23.918819 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e62a094-ae70-4e5d-9aa4-5bc28452ad83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:23.919258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e62a094-ae70-4e5d-9aa4-5bc28452ad83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:24.057397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3e62a094-ae70-4e5d-9aa4-5bc28452ad83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:24.066396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3e62a094-ae70-4e5d-9aa4-5bc28452ad83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:24.067943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3e62a094-ae70-4e5d-9aa4-5bc28452ad83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:24.069140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3e62a094-ae70-4e5d-9aa4-5bc28452ad83 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.162348 Jun 20 07:29:24.069700 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 893/1669] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:23 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:24.291586 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-468c354f-8823-4a74-93ff-e44fe2e72aa6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:24.292241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-468c354f-8823-4a74-93ff-e44fe2e72aa6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:24.298670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-468c354f-8823-4a74-93ff-e44fe2e72aa6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:24.299118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-468c354f-8823-4a74-93ff-e44fe2e72aa6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:24.299873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-468c354f-8823-4a74-93ff-e44fe2e72aa6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:24.300956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-468c354f-8823-4a74-93ff-e44fe2e72aa6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:24.425519 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-468c354f-8823-4a74-93ff-e44fe2e72aa6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:24.433393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-468c354f-8823-4a74-93ff-e44fe2e72aa6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145674 Jun 20 07:29:24.433962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 777/1670] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:24 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:25.087441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3f34cd68-6f33-4807-86ef-4e88bc6e5088 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:25.088048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3f34cd68-6f33-4807-86ef-4e88bc6e5088 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:25.094541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f34cd68-6f33-4807-86ef-4e88bc6e5088 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:25.094988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f34cd68-6f33-4807-86ef-4e88bc6e5088 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:25.095743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f34cd68-6f33-4807-86ef-4e88bc6e5088 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:25.096205 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f34cd68-6f33-4807-86ef-4e88bc6e5088 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:25.223128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3f34cd68-6f33-4807-86ef-4e88bc6e5088 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:25.231466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3f34cd68-6f33-4807-86ef-4e88bc6e5088 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:25.233005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3f34cd68-6f33-4807-86ef-4e88bc6e5088 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:25.234166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3f34cd68-6f33-4807-86ef-4e88bc6e5088 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150597 Jun 20 07:29:25.234739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 894/1671] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:25 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:29:25.449833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4ec5dc8e-a60e-43a7-8fc0-39c05b056c53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:25.450395 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4ec5dc8e-a60e-43a7-8fc0-39c05b056c53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:25.456868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ec5dc8e-a60e-43a7-8fc0-39c05b056c53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:25.457318 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ec5dc8e-a60e-43a7-8fc0-39c05b056c53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:25.458080 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ec5dc8e-a60e-43a7-8fc0-39c05b056c53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:25.458518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ec5dc8e-a60e-43a7-8fc0-39c05b056c53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:25.584345 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ec5dc8e-a60e-43a7-8fc0-39c05b056c53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:25.592286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4ec5dc8e-a60e-43a7-8fc0-39c05b056c53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146421 Jun 20 07:29:25.592853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 778/1672] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:25 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:26.253520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f591fa4d-acc4-4d07-8749-08b9e229164d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:26.254052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f591fa4d-acc4-4d07-8749-08b9e229164d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:26.261302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f591fa4d-acc4-4d07-8749-08b9e229164d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:26.261753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f591fa4d-acc4-4d07-8749-08b9e229164d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:26.262517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f591fa4d-acc4-4d07-8749-08b9e229164d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:26.262955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f591fa4d-acc4-4d07-8749-08b9e229164d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:26.392043 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f591fa4d-acc4-4d07-8749-08b9e229164d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:26.400910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f591fa4d-acc4-4d07-8749-08b9e229164d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:26.402391 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f591fa4d-acc4-4d07-8749-08b9e229164d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:26.403538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f591fa4d-acc4-4d07-8749-08b9e229164d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154048 Jun 20 07:29:26.404090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 895/1673] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:26 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:26.609001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-86b8b2aa-c4f9-4311-9ca9-632b878c2c00 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:26.609614 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-86b8b2aa-c4f9-4311-9ca9-632b878c2c00 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:26.616560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86b8b2aa-c4f9-4311-9ca9-632b878c2c00 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:26.617002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86b8b2aa-c4f9-4311-9ca9-632b878c2c00 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:26.617754 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86b8b2aa-c4f9-4311-9ca9-632b878c2c00 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:26.618180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-86b8b2aa-c4f9-4311-9ca9-632b878c2c00 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:26.635232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:29:26.749970 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-86b8b2aa-c4f9-4311-9ca9-632b878c2c00 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:26.758949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-86b8b2aa-c4f9-4311-9ca9-632b878c2c00 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.153785 Jun 20 07:29:26.759519 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 779/1674] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:26 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:27.421963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ad1264da-8da6-4286-80cc-2d2cf629ddcc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:27.422490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ad1264da-8da6-4286-80cc-2d2cf629ddcc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:27.428952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad1264da-8da6-4286-80cc-2d2cf629ddcc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:27.429402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad1264da-8da6-4286-80cc-2d2cf629ddcc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:27.430160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad1264da-8da6-4286-80cc-2d2cf629ddcc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:27.430593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad1264da-8da6-4286-80cc-2d2cf629ddcc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:27.559982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad1264da-8da6-4286-80cc-2d2cf629ddcc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:27.568918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad1264da-8da6-4286-80cc-2d2cf629ddcc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:27.570408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad1264da-8da6-4286-80cc-2d2cf629ddcc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:27.571571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ad1264da-8da6-4286-80cc-2d2cf629ddcc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153583 Jun 20 07:29:27.572157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 896/1675] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:27 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:27.776572 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef666caa-96e1-405a-8022-1a2edbb75522 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:27.777381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ef666caa-96e1-405a-8022-1a2edbb75522 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:27.783869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef666caa-96e1-405a-8022-1a2edbb75522 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:27.784237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef666caa-96e1-405a-8022-1a2edbb75522 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:27.785010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef666caa-96e1-405a-8022-1a2edbb75522 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:27.785483 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef666caa-96e1-405a-8022-1a2edbb75522 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:27.916393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ef666caa-96e1-405a-8022-1a2edbb75522 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:27.924308 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ef666caa-96e1-405a-8022-1a2edbb75522 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151759 Jun 20 07:29:27.924877 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 780/1676] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:27 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:28.589958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-89abceb8-965d-444d-8ab9-e45ebbe30eea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:28.590512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-89abceb8-965d-444d-8ab9-e45ebbe30eea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:28.596969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89abceb8-965d-444d-8ab9-e45ebbe30eea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:28.597419 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89abceb8-965d-444d-8ab9-e45ebbe30eea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:28.598183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89abceb8-965d-444d-8ab9-e45ebbe30eea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:28.599130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89abceb8-965d-444d-8ab9-e45ebbe30eea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:28.725794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-89abceb8-965d-444d-8ab9-e45ebbe30eea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:28.734592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-89abceb8-965d-444d-8ab9-e45ebbe30eea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:28.736099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-89abceb8-965d-444d-8ab9-e45ebbe30eea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:28.737280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-89abceb8-965d-444d-8ab9-e45ebbe30eea tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151327 Jun 20 07:29:28.737844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 897/1677] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:28 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:28.941112 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61f9f8cc-4799-48b4-88d6-56329d20a3d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:28.941728 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61f9f8cc-4799-48b4-88d6-56329d20a3d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:28.948273 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61f9f8cc-4799-48b4-88d6-56329d20a3d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:28.948726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61f9f8cc-4799-48b4-88d6-56329d20a3d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:28.949479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61f9f8cc-4799-48b4-88d6-56329d20a3d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:28.949915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61f9f8cc-4799-48b4-88d6-56329d20a3d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:29.079654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61f9f8cc-4799-48b4-88d6-56329d20a3d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:29.088066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61f9f8cc-4799-48b4-88d6-56329d20a3d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150756 Jun 20 07:29:29.088649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 781/1678] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:28 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:29.757295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d686a903-3a3b-4c26-aa10-f7918f486ad6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:29.757913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d686a903-3a3b-4c26-aa10-f7918f486ad6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:29.764719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d686a903-3a3b-4c26-aa10-f7918f486ad6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:29.765169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d686a903-3a3b-4c26-aa10-f7918f486ad6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:29.765931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d686a903-3a3b-4c26-aa10-f7918f486ad6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:29.766399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d686a903-3a3b-4c26-aa10-f7918f486ad6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:29.895633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d686a903-3a3b-4c26-aa10-f7918f486ad6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:29.903962 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d686a903-3a3b-4c26-aa10-f7918f486ad6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:29.905551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d686a903-3a3b-4c26-aa10-f7918f486ad6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:29.906611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d686a903-3a3b-4c26-aa10-f7918f486ad6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154189 Jun 20 07:29:29.907337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 898/1679] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:29 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:29.951363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1f631ce7-5089-4193-8135-07ac7037dd5e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:29.951878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1f631ce7-5089-4193-8135-07ac7037dd5e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:29.958261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f631ce7-5089-4193-8135-07ac7037dd5e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:29.958646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f631ce7-5089-4193-8135-07ac7037dd5e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:29.959391 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f631ce7-5089-4193-8135-07ac7037dd5e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:29.959820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f631ce7-5089-4193-8135-07ac7037dd5e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:29.983636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1f631ce7-5089-4193-8135-07ac7037dd5e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:29:30.058887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1f631ce7-5089-4193-8135-07ac7037dd5e tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 204 len: 0 microversion: 2.1 time: 0.110504 Jun 20 07:29:30.059182 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 782/1680] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:29:29 2022] DELETE /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:29:30.067821 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4c578234-5d60-4ab4-ac2c-c6ea70144cdd tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:30.068555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4c578234-5d60-4ab4-ac2c-c6ea70144cdd tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:30.074474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c578234-5d60-4ab4-ac2c-c6ea70144cdd tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:30.074914 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c578234-5d60-4ab4-ac2c-c6ea70144cdd tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:30.075660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c578234-5d60-4ab4-ac2c-c6ea70144cdd tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:30.076095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c578234-5d60-4ab4-ac2c-c6ea70144cdd tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:30.105865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cab06c9d-af5a-4c80-a895-83be94d3c6e4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:30.106573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cab06c9d-af5a-4c80-a895-83be94d3c6e4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:30.112732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cab06c9d-af5a-4c80-a895-83be94d3c6e4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:30.113195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cab06c9d-af5a-4c80-a895-83be94d3c6e4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:30.114610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cab06c9d-af5a-4c80-a895-83be94d3c6e4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:30.115055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cab06c9d-af5a-4c80-a895-83be94d3c6e4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:30.255633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4c578234-5d60-4ab4-ac2c-c6ea70144cdd tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:30.263818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4c578234-5d60-4ab4-ac2c-c6ea70144cdd tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 200 len: 1682 microversion: 2.1 time: 0.199911 Jun 20 07:29:30.264704 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 899/1681] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:30 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:30.295144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cab06c9d-af5a-4c80-a895-83be94d3c6e4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:30.303879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cab06c9d-af5a-4c80-a895-83be94d3c6e4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.202178 Jun 20 07:29:30.304495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 783/1682] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:30 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:29:30.925205 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-356a6ff3-4eab-4b3c-97f9-c8cb75af8aae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:30.926254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-356a6ff3-4eab-4b3c-97f9-c8cb75af8aae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:30.933363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-356a6ff3-4eab-4b3c-97f9-c8cb75af8aae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:30.934159 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-356a6ff3-4eab-4b3c-97f9-c8cb75af8aae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:30.935004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-356a6ff3-4eab-4b3c-97f9-c8cb75af8aae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:30.935497 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-356a6ff3-4eab-4b3c-97f9-c8cb75af8aae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:30.952059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:29:31.183279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-356a6ff3-4eab-4b3c-97f9-c8cb75af8aae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:31.191603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-356a6ff3-4eab-4b3c-97f9-c8cb75af8aae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:31.193772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-356a6ff3-4eab-4b3c-97f9-c8cb75af8aae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:31.194922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-356a6ff3-4eab-4b3c-97f9-c8cb75af8aae tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.273718 Jun 20 07:29:31.195483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 900/1683] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:30 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:31.281134 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-64f9b1d1-7e26-42f9-85b3-d3d255f39f12 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:31.281818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-64f9b1d1-7e26-42f9-85b3-d3d255f39f12 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:31.288301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64f9b1d1-7e26-42f9-85b3-d3d255f39f12 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:31.288759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64f9b1d1-7e26-42f9-85b3-d3d255f39f12 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:31.289528 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64f9b1d1-7e26-42f9-85b3-d3d255f39f12 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:31.289972 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64f9b1d1-7e26-42f9-85b3-d3d255f39f12 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:31.322151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9b1ca14c-2a1c-41e3-b991-d23e9dcb838d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:31.323034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9b1ca14c-2a1c-41e3-b991-d23e9dcb838d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:31.330185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b1ca14c-2a1c-41e3-b991-d23e9dcb838d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:31.330636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b1ca14c-2a1c-41e3-b991-d23e9dcb838d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:31.331407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b1ca14c-2a1c-41e3-b991-d23e9dcb838d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:31.331834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9b1ca14c-2a1c-41e3-b991-d23e9dcb838d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:31.396783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-64f9b1d1-7e26-42f9-85b3-d3d255f39f12 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66183ca9d884f43befaace02099c7f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31415828d04241249f14fb3ef6a3aa0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:31.405689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-64f9b1d1-7e26-42f9-85b3-d3d255f39f12 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 200 len: 1615 microversion: 2.1 time: 0.128399 Jun 20 07:29:31.406859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 784/1684] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:31 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 1615 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:31.682235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a4c4f444-33d7-4b84-8a20-8120cbea3160 req-5557bc51-405d-4fde-890a-71d888ee9121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ffe5f4-e1f6-4e33-9318-4ae736a72266", "name": "network-vif-deleted", "tag": "56ece4d3-64a2-459e-87e3-b75711334839"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:29:31.691761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a4c4f444-33d7-4b84-8a20-8120cbea3160 req-5557bc51-405d-4fde-890a-71d888ee9121 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:31.692577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a4c4f444-33d7-4b84-8a20-8120cbea3160 req-5557bc51-405d-4fde-890a-71d888ee9121 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:31.710239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a4c4f444-33d7-4b84-8a20-8120cbea3160 req-5557bc51-405d-4fde-890a-71d888ee9121 service nova] Creating event network-vif-deleted:56ece4d3-64a2-459e-87e3-b75711334839 for instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 on hv-cinder-77819 Jun 20 07:29:31.716781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a4c4f444-33d7-4b84-8a20-8120cbea3160 req-5557bc51-405d-4fde-890a-71d888ee9121 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308251 Jun 20 07:29:31.717941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 785/1685] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:29:31.783895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9b1ca14c-2a1c-41e3-b991-d23e9dcb838d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:31.793524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9b1ca14c-2a1c-41e3-b991-d23e9dcb838d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.475274 Jun 20 07:29:31.794179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 901/1686] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:31 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:32.214242 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-883673e2-eca6-482d-b8ca-6bf6438ec409 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:32.214949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-883673e2-eca6-482d-b8ca-6bf6438ec409 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:32.221322 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-883673e2-eca6-482d-b8ca-6bf6438ec409 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:32.221706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-883673e2-eca6-482d-b8ca-6bf6438ec409 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:32.222469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-883673e2-eca6-482d-b8ca-6bf6438ec409 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:32.222905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-883673e2-eca6-482d-b8ca-6bf6438ec409 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:32.360317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-883673e2-eca6-482d-b8ca-6bf6438ec409 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:32.369290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-883673e2-eca6-482d-b8ca-6bf6438ec409 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:32.370898 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-883673e2-eca6-482d-b8ca-6bf6438ec409 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:32.372237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-883673e2-eca6-482d-b8ca-6bf6438ec409 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.162264 Jun 20 07:29:32.372876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 786/1687] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:32 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:32.423665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e9aec46-15e9-4a8f-8653-53f7a5c0544d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:32.424437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7e9aec46-15e9-4a8f-8653-53f7a5c0544d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:32.430942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e9aec46-15e9-4a8f-8653-53f7a5c0544d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:32.431385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e9aec46-15e9-4a8f-8653-53f7a5c0544d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:32.432153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e9aec46-15e9-4a8f-8653-53f7a5c0544d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:32.432587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e9aec46-15e9-4a8f-8653-53f7a5c0544d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:32.446438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-7e9aec46-15e9-4a8f-8653-53f7a5c0544d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e9aec46-15e9-4a8f-8653-53f7a5c0544d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 HTTP/1.1 Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:29:32.448096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:29:32.449887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:29:32.449887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:29:32.449887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:29:32.449887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:29:32.449887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:29:32.449887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:29:32.449887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:29:32.449887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:29:32.449887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:29:32.449887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:29:32.449887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:29:32.449887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '62ffe5f4-e1f6-4e33-9318-4ae736a72266'} Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:29:32.450884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:29:32.452602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:29:32.454330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e9aec46-15e9-4a8f-8653-53f7a5c0544d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:29:32.454330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7e9aec46-15e9-4a8f-8653-53f7a5c0544d tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 404 len: 111 microversion: 2.1 time: 0.029695 Jun 20 07:29:32.454330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 902/1688] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:32 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:29:32.458975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6bc14620-3c02-4519-b53d-8ef6a3da8665 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '.version_select at 0x7ffa1faf0280>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:32.479239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6bc14620-3c02-4519-b53d-8ef6a3da8665 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-726525667" status: 202 len: 0 microversion: 2.1 time: 0.024570 Jun 20 07:29:32.479720 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 787/1689] 10.222.0.23 () {58 vars in 1217 bytes} [Mon Jun 20 07:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-726525667 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:29:32.811208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-73619511-abf9-4ec6-98a8-5682a5d7b082 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:32.811830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-73619511-abf9-4ec6-98a8-5682a5d7b082 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:32.818474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73619511-abf9-4ec6-98a8-5682a5d7b082 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:32.818918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73619511-abf9-4ec6-98a8-5682a5d7b082 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:32.819687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73619511-abf9-4ec6-98a8-5682a5d7b082 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:32.820141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-73619511-abf9-4ec6-98a8-5682a5d7b082 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:32.952997 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-73619511-abf9-4ec6-98a8-5682a5d7b082 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:32.961046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-73619511-abf9-4ec6-98a8-5682a5d7b082 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.153709 Jun 20 07:29:32.961621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 903/1690] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:32 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:33.391293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1621b169-e187-4d48-b703-642dca7bf421 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:33.391902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1621b169-e187-4d48-b703-642dca7bf421 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:33.398277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1621b169-e187-4d48-b703-642dca7bf421 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:33.398717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1621b169-e187-4d48-b703-642dca7bf421 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:33.399471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1621b169-e187-4d48-b703-642dca7bf421 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:33.399930 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1621b169-e187-4d48-b703-642dca7bf421 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:33.525692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1621b169-e187-4d48-b703-642dca7bf421 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:33.534162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1621b169-e187-4d48-b703-642dca7bf421 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:33.536295 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1621b169-e187-4d48-b703-642dca7bf421 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:33.537462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1621b169-e187-4d48-b703-642dca7bf421 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150727 Jun 20 07:29:33.538024 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 788/1691] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:33 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:33.978122 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-53502703-b5dd-42e2-8e35-c0b4e6fd4e11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:33.978681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-53502703-b5dd-42e2-8e35-c0b4e6fd4e11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:33.985244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53502703-b5dd-42e2-8e35-c0b4e6fd4e11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:33.985696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53502703-b5dd-42e2-8e35-c0b4e6fd4e11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:33.986452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53502703-b5dd-42e2-8e35-c0b4e6fd4e11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:33.986892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-53502703-b5dd-42e2-8e35-c0b4e6fd4e11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:34.119924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-53502703-b5dd-42e2-8e35-c0b4e6fd4e11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:34.127870 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-53502703-b5dd-42e2-8e35-c0b4e6fd4e11 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.153701 Jun 20 07:29:34.128444 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 904/1692] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:33 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:34.556382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bfd71e0f-50d0-40cf-971a-6a6f8dd645a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:34.557009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bfd71e0f-50d0-40cf-971a-6a6f8dd645a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:34.563468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfd71e0f-50d0-40cf-971a-6a6f8dd645a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:34.563920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfd71e0f-50d0-40cf-971a-6a6f8dd645a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:34.564718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfd71e0f-50d0-40cf-971a-6a6f8dd645a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:34.565160 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfd71e0f-50d0-40cf-971a-6a6f8dd645a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:34.698497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bfd71e0f-50d0-40cf-971a-6a6f8dd645a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:34.707636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bfd71e0f-50d0-40cf-971a-6a6f8dd645a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:34.709165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bfd71e0f-50d0-40cf-971a-6a6f8dd645a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:34.710310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bfd71e0f-50d0-40cf-971a-6a6f8dd645a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157917 Jun 20 07:29:34.710853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 789/1693] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:34 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:35.146092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6784a100-5e6a-4f3f-8178-5db812fd36e8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:35.146710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6784a100-5e6a-4f3f-8178-5db812fd36e8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:35.153446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6784a100-5e6a-4f3f-8178-5db812fd36e8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:35.153795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6784a100-5e6a-4f3f-8178-5db812fd36e8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:35.154587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6784a100-5e6a-4f3f-8178-5db812fd36e8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:35.155022 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6784a100-5e6a-4f3f-8178-5db812fd36e8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:35.284170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6784a100-5e6a-4f3f-8178-5db812fd36e8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:35.292534 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6784a100-5e6a-4f3f-8178-5db812fd36e8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150750 Jun 20 07:29:35.293292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 905/1694] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:35 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:35.728808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a532837e-2e89-40bd-ab07-e7763061213c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:35.729427 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a532837e-2e89-40bd-ab07-e7763061213c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:35.735886 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a532837e-2e89-40bd-ab07-e7763061213c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:35.736367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a532837e-2e89-40bd-ab07-e7763061213c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:35.737384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a532837e-2e89-40bd-ab07-e7763061213c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:35.737828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a532837e-2e89-40bd-ab07-e7763061213c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:35.868218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a532837e-2e89-40bd-ab07-e7763061213c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:35.876526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a532837e-2e89-40bd-ab07-e7763061213c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:35.878057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a532837e-2e89-40bd-ab07-e7763061213c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:35.879212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a532837e-2e89-40bd-ab07-e7763061213c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154605 Jun 20 07:29:35.880351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 790/1695] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:35 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:36.309525 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ccdbcd4e-3b3e-4519-9114-73d5f4005fe8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:36.310259 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ccdbcd4e-3b3e-4519-9114-73d5f4005fe8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:36.316828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccdbcd4e-3b3e-4519-9114-73d5f4005fe8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:36.317282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccdbcd4e-3b3e-4519-9114-73d5f4005fe8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:36.318048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccdbcd4e-3b3e-4519-9114-73d5f4005fe8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:36.318490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ccdbcd4e-3b3e-4519-9114-73d5f4005fe8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:36.446133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ccdbcd4e-3b3e-4519-9114-73d5f4005fe8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:36.454523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ccdbcd4e-3b3e-4519-9114-73d5f4005fe8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148832 Jun 20 07:29:36.455078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 906/1696] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:36 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:36.899612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5d1fdfe8-46d0-4fa9-aa9a-aa1bb643e945 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:36.900294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5d1fdfe8-46d0-4fa9-aa9a-aa1bb643e945 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:36.906766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d1fdfe8-46d0-4fa9-aa9a-aa1bb643e945 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:36.907218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d1fdfe8-46d0-4fa9-aa9a-aa1bb643e945 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:36.907980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d1fdfe8-46d0-4fa9-aa9a-aa1bb643e945 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:36.908460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d1fdfe8-46d0-4fa9-aa9a-aa1bb643e945 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:37.036613 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5d1fdfe8-46d0-4fa9-aa9a-aa1bb643e945 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:37.044956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5d1fdfe8-46d0-4fa9-aa9a-aa1bb643e945 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:37.046462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5d1fdfe8-46d0-4fa9-aa9a-aa1bb643e945 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:37.047624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5d1fdfe8-46d0-4fa9-aa9a-aa1bb643e945 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152627 Jun 20 07:29:37.048197 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 791/1697] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:36 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:37.471656 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-03f9e67a-6e9d-4102-a1c8-f8e3c66d6be0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:37.472288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-03f9e67a-6e9d-4102-a1c8-f8e3c66d6be0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:37.478628 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03f9e67a-6e9d-4102-a1c8-f8e3c66d6be0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:37.479077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03f9e67a-6e9d-4102-a1c8-f8e3c66d6be0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:37.479820 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03f9e67a-6e9d-4102-a1c8-f8e3c66d6be0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:37.480274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03f9e67a-6e9d-4102-a1c8-f8e3c66d6be0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:37.614902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-03f9e67a-6e9d-4102-a1c8-f8e3c66d6be0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:37.622781 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-03f9e67a-6e9d-4102-a1c8-f8e3c66d6be0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.154918 Jun 20 07:29:37.623341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 907/1698] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:37 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:38.066094 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4ba79721-567b-409f-827e-5d07257dbcd9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:38.066717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4ba79721-567b-409f-827e-5d07257dbcd9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:38.073234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ba79721-567b-409f-827e-5d07257dbcd9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:38.073697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ba79721-567b-409f-827e-5d07257dbcd9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:38.074458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ba79721-567b-409f-827e-5d07257dbcd9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:38.074898 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ba79721-567b-409f-827e-5d07257dbcd9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:38.203432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ba79721-567b-409f-827e-5d07257dbcd9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:38.212283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ba79721-567b-409f-827e-5d07257dbcd9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:38.213793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ba79721-567b-409f-827e-5d07257dbcd9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:38.214956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4ba79721-567b-409f-827e-5d07257dbcd9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152805 Jun 20 07:29:38.215528 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 792/1699] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:38 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:38.640281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7b5dd102-1849-42ea-81c2-c60ca40ac09f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:38.640889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7b5dd102-1849-42ea-81c2-c60ca40ac09f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:38.647209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b5dd102-1849-42ea-81c2-c60ca40ac09f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:38.647643 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b5dd102-1849-42ea-81c2-c60ca40ac09f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:38.648417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b5dd102-1849-42ea-81c2-c60ca40ac09f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:38.648841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b5dd102-1849-42ea-81c2-c60ca40ac09f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:38.777279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b5dd102-1849-42ea-81c2-c60ca40ac09f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:38.785137 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7b5dd102-1849-42ea-81c2-c60ca40ac09f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148688 Jun 20 07:29:38.785696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 908/1700] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:38 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:39.234120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8563175a-72b6-4c2b-b110-d4368df4424b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:39.235427 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8563175a-72b6-4c2b-b110-d4368df4424b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:39.242637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8563175a-72b6-4c2b-b110-d4368df4424b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:39.243089 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8563175a-72b6-4c2b-b110-d4368df4424b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:39.243857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8563175a-72b6-4c2b-b110-d4368df4424b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:39.244319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8563175a-72b6-4c2b-b110-d4368df4424b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:39.376172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8563175a-72b6-4c2b-b110-d4368df4424b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:39.385071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8563175a-72b6-4c2b-b110-d4368df4424b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:39.386581 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8563175a-72b6-4c2b-b110-d4368df4424b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:39.387745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8563175a-72b6-4c2b-b110-d4368df4424b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157622 Jun 20 07:29:39.388422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 793/1701] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:39 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:39.802016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d56fda31-7689-4f7a-bd64-a18e8784dd01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:39.802621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d56fda31-7689-4f7a-bd64-a18e8784dd01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:39.809143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d56fda31-7689-4f7a-bd64-a18e8784dd01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:39.809587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d56fda31-7689-4f7a-bd64-a18e8784dd01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:39.810329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d56fda31-7689-4f7a-bd64-a18e8784dd01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:39.810757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d56fda31-7689-4f7a-bd64-a18e8784dd01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:39.938019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d56fda31-7689-4f7a-bd64-a18e8784dd01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:39.946398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d56fda31-7689-4f7a-bd64-a18e8784dd01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148184 Jun 20 07:29:39.946951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 909/1702] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:39 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:40.405980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-242259e9-1d67-4d31-a016-28469f548ad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:40.406693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-242259e9-1d67-4d31-a016-28469f548ad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:40.413101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-242259e9-1d67-4d31-a016-28469f548ad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:40.413559 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-242259e9-1d67-4d31-a016-28469f548ad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:40.414316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-242259e9-1d67-4d31-a016-28469f548ad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:40.414752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-242259e9-1d67-4d31-a016-28469f548ad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:40.544367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-242259e9-1d67-4d31-a016-28469f548ad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:40.553361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-242259e9-1d67-4d31-a016-28469f548ad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:40.554869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-242259e9-1d67-4d31-a016-28469f548ad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:40.556025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-242259e9-1d67-4d31-a016-28469f548ad1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154062 Jun 20 07:29:40.556643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 794/1703] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:40 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:40.963646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-efd4bbee-dada-4351-b1d5-5857b6920944 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:40.964297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-efd4bbee-dada-4351-b1d5-5857b6920944 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:40.972044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efd4bbee-dada-4351-b1d5-5857b6920944 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:40.972518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efd4bbee-dada-4351-b1d5-5857b6920944 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:40.973871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efd4bbee-dada-4351-b1d5-5857b6920944 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:40.974887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-efd4bbee-dada-4351-b1d5-5857b6920944 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:41.103490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-efd4bbee-dada-4351-b1d5-5857b6920944 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:41.111273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-efd4bbee-dada-4351-b1d5-5857b6920944 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151546 Jun 20 07:29:41.111828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 910/1704] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:40 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:41.574729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31b82b8b-5f53-49a9-816b-513024e670f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:41.575350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-31b82b8b-5f53-49a9-816b-513024e670f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:41.581787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b82b8b-5f53-49a9-816b-513024e670f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:41.582241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b82b8b-5f53-49a9-816b-513024e670f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:41.583010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b82b8b-5f53-49a9-816b-513024e670f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:41.584080 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b82b8b-5f53-49a9-816b-513024e670f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:41.714933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31b82b8b-5f53-49a9-816b-513024e670f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:41.723642 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31b82b8b-5f53-49a9-816b-513024e670f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:41.725190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31b82b8b-5f53-49a9-816b-513024e670f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:41.726353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-31b82b8b-5f53-49a9-816b-513024e670f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155470 Jun 20 07:29:41.726909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 795/1705] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:41 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:42.127727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-35834ab5-44a8-44ea-be68-e4603196a9e0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:42.128361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-35834ab5-44a8-44ea-be68-e4603196a9e0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:42.135165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35834ab5-44a8-44ea-be68-e4603196a9e0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:42.135609 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35834ab5-44a8-44ea-be68-e4603196a9e0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:42.136386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35834ab5-44a8-44ea-be68-e4603196a9e0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:42.136814 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35834ab5-44a8-44ea-be68-e4603196a9e0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:42.262558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-35834ab5-44a8-44ea-be68-e4603196a9e0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:42.270745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-35834ab5-44a8-44ea-be68-e4603196a9e0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146844 Jun 20 07:29:42.271936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 911/1706] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:42 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:42.745367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1deebbf6-fb67-4be0-a832-9e40292db74b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:42.745967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1deebbf6-fb67-4be0-a832-9e40292db74b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:42.748377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:29:42.753562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1deebbf6-fb67-4be0-a832-9e40292db74b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:42.754005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1deebbf6-fb67-4be0-a832-9e40292db74b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:42.754753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1deebbf6-fb67-4be0-a832-9e40292db74b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:42.755185 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1deebbf6-fb67-4be0-a832-9e40292db74b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:42.758674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:29:42.889280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1deebbf6-fb67-4be0-a832-9e40292db74b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:42.898766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1deebbf6-fb67-4be0-a832-9e40292db74b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:42.900899 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1deebbf6-fb67-4be0-a832-9e40292db74b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:42.902233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1deebbf6-fb67-4be0-a832-9e40292db74b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.160818 Jun 20 07:29:42.902798 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 796/1707] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:43.289931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1bb40543-720c-4165-8e1b-bad8c113dadc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:43.290547 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1bb40543-720c-4165-8e1b-bad8c113dadc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:43.297052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bb40543-720c-4165-8e1b-bad8c113dadc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:43.297504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bb40543-720c-4165-8e1b-bad8c113dadc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:43.298268 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bb40543-720c-4165-8e1b-bad8c113dadc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:43.298705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bb40543-720c-4165-8e1b-bad8c113dadc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:43.426155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1bb40543-720c-4165-8e1b-bad8c113dadc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:43.434597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1bb40543-720c-4165-8e1b-bad8c113dadc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150069 Jun 20 07:29:43.435164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 912/1708] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:43 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:43.921488 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5c532ddb-b740-4210-a365-9197a649e808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:43.922103 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5c532ddb-b740-4210-a365-9197a649e808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:43.928641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c532ddb-b740-4210-a365-9197a649e808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:43.929092 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c532ddb-b740-4210-a365-9197a649e808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:43.929857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c532ddb-b740-4210-a365-9197a649e808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:43.930292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c532ddb-b740-4210-a365-9197a649e808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:44.061957 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5c532ddb-b740-4210-a365-9197a649e808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:44.070376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5c532ddb-b740-4210-a365-9197a649e808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:44.071855 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5c532ddb-b740-4210-a365-9197a649e808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:44.073035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5c532ddb-b740-4210-a365-9197a649e808 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155414 Jun 20 07:29:44.073603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 797/1709] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:43 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:44.552791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-813683bb-fa0b-45dd-86b5-8b911ecd117a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:44.553403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-813683bb-fa0b-45dd-86b5-8b911ecd117a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:44.555195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:29:44.560505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-813683bb-fa0b-45dd-86b5-8b911ecd117a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:44.560947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-813683bb-fa0b-45dd-86b5-8b911ecd117a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:44.561694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-813683bb-fa0b-45dd-86b5-8b911ecd117a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:44.562120 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-813683bb-fa0b-45dd-86b5-8b911ecd117a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:44.840257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-813683bb-fa0b-45dd-86b5-8b911ecd117a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:44.847990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-813683bb-fa0b-45dd-86b5-8b911ecd117a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.400536 Jun 20 07:29:44.848575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 913/1710] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:44 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:45.091476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-13bb73e2-10eb-4570-ad5b-d4a9bc779f1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:45.092128 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-13bb73e2-10eb-4570-ad5b-d4a9bc779f1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:45.098777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13bb73e2-10eb-4570-ad5b-d4a9bc779f1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:45.099228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13bb73e2-10eb-4570-ad5b-d4a9bc779f1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:45.100558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13bb73e2-10eb-4570-ad5b-d4a9bc779f1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:45.100996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13bb73e2-10eb-4570-ad5b-d4a9bc779f1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:45.228531 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-13bb73e2-10eb-4570-ad5b-d4a9bc779f1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:45.236811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-13bb73e2-10eb-4570-ad5b-d4a9bc779f1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:45.238295 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-13bb73e2-10eb-4570-ad5b-d4a9bc779f1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:45.239449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-13bb73e2-10eb-4570-ad5b-d4a9bc779f1f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151970 Jun 20 07:29:45.240019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 798/1711] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:45 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:45.864551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fda6816a-e5c6-40ff-8ca7-226633872656 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:45.865193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fda6816a-e5c6-40ff-8ca7-226633872656 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:45.871578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda6816a-e5c6-40ff-8ca7-226633872656 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:45.872023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda6816a-e5c6-40ff-8ca7-226633872656 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:45.872818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda6816a-e5c6-40ff-8ca7-226633872656 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:45.873257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda6816a-e5c6-40ff-8ca7-226633872656 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:46.002534 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fda6816a-e5c6-40ff-8ca7-226633872656 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:46.011214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fda6816a-e5c6-40ff-8ca7-226633872656 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150487 Jun 20 07:29:46.011789 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 914/1712] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:45 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:46.258941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1cacdd30-7243-43a4-ba52-68f7313050b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:46.259470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1cacdd30-7243-43a4-ba52-68f7313050b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:46.265893 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cacdd30-7243-43a4-ba52-68f7313050b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:46.266379 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cacdd30-7243-43a4-ba52-68f7313050b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:46.267135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cacdd30-7243-43a4-ba52-68f7313050b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:46.267575 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cacdd30-7243-43a4-ba52-68f7313050b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:46.397278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1cacdd30-7243-43a4-ba52-68f7313050b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:46.405916 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1cacdd30-7243-43a4-ba52-68f7313050b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:46.407427 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1cacdd30-7243-43a4-ba52-68f7313050b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:46.408632 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1cacdd30-7243-43a4-ba52-68f7313050b8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154590 Jun 20 07:29:46.409199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 799/1713] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:46 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:47.028187 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a1111144-71a8-4ee4-bd0f-f54a59e1e02b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:47.028810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a1111144-71a8-4ee4-bd0f-f54a59e1e02b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:47.034992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1111144-71a8-4ee4-bd0f-f54a59e1e02b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:47.035442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1111144-71a8-4ee4-bd0f-f54a59e1e02b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:47.036245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1111144-71a8-4ee4-bd0f-f54a59e1e02b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:47.036687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1111144-71a8-4ee4-bd0f-f54a59e1e02b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:47.167084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1111144-71a8-4ee4-bd0f-f54a59e1e02b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:47.174997 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a1111144-71a8-4ee4-bd0f-f54a59e1e02b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150647 Jun 20 07:29:47.175557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 915/1714] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:47 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:47.427035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-064ed78b-320c-4aaf-b685-978c0e1af9ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:47.427686 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-064ed78b-320c-4aaf-b685-978c0e1af9ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:47.434239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-064ed78b-320c-4aaf-b685-978c0e1af9ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:47.434691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-064ed78b-320c-4aaf-b685-978c0e1af9ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:47.435454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-064ed78b-320c-4aaf-b685-978c0e1af9ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:47.435931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-064ed78b-320c-4aaf-b685-978c0e1af9ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:47.562531 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-064ed78b-320c-4aaf-b685-978c0e1af9ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:47.572202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-064ed78b-320c-4aaf-b685-978c0e1af9ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:47.573692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-064ed78b-320c-4aaf-b685-978c0e1af9ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:47.575041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-064ed78b-320c-4aaf-b685-978c0e1af9ac tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152005 Jun 20 07:29:47.575633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 800/1715] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:47 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:48.191947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4d2574f5-76cd-45b5-a3c2-0d6c2304d1b4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:48.192581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4d2574f5-76cd-45b5-a3c2-0d6c2304d1b4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:48.198954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d2574f5-76cd-45b5-a3c2-0d6c2304d1b4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:48.199398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d2574f5-76cd-45b5-a3c2-0d6c2304d1b4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:48.200178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d2574f5-76cd-45b5-a3c2-0d6c2304d1b4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:48.200614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d2574f5-76cd-45b5-a3c2-0d6c2304d1b4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:48.323980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4d2574f5-76cd-45b5-a3c2-0d6c2304d1b4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:48.331926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4d2574f5-76cd-45b5-a3c2-0d6c2304d1b4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.143778 Jun 20 07:29:48.332507 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 916/1716] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:48 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:48.593541 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-836fb75b-5b7d-4549-b81f-0e69ded3d53a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:48.594093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-836fb75b-5b7d-4549-b81f-0e69ded3d53a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:48.601349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-836fb75b-5b7d-4549-b81f-0e69ded3d53a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:48.601799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-836fb75b-5b7d-4549-b81f-0e69ded3d53a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:48.602559 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-836fb75b-5b7d-4549-b81f-0e69ded3d53a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:48.603000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-836fb75b-5b7d-4549-b81f-0e69ded3d53a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:48.736396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-836fb75b-5b7d-4549-b81f-0e69ded3d53a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:48.744921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-836fb75b-5b7d-4549-b81f-0e69ded3d53a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:48.746422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-836fb75b-5b7d-4549-b81f-0e69ded3d53a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:48.747626 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-836fb75b-5b7d-4549-b81f-0e69ded3d53a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.158054 Jun 20 07:29:48.748190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 801/1717] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:48 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:49.349218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cf8499dc-138a-4c6c-9eab-e81644563e85 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:49.350436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cf8499dc-138a-4c6c-9eab-e81644563e85 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:49.356964 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf8499dc-138a-4c6c-9eab-e81644563e85 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:49.357412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf8499dc-138a-4c6c-9eab-e81644563e85 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:49.358179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf8499dc-138a-4c6c-9eab-e81644563e85 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:49.358617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cf8499dc-138a-4c6c-9eab-e81644563e85 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:49.484382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cf8499dc-138a-4c6c-9eab-e81644563e85 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:49.486525 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:29:49.493835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cf8499dc-138a-4c6c-9eab-e81644563e85 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148424 Jun 20 07:29:49.494413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 917/1718] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:49 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:49.766635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b91cc4ce-897c-42ea-b771-befa5d0eadde tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:49.767244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b91cc4ce-897c-42ea-b771-befa5d0eadde tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:49.773992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b91cc4ce-897c-42ea-b771-befa5d0eadde tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:49.774433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b91cc4ce-897c-42ea-b771-befa5d0eadde tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:49.775181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b91cc4ce-897c-42ea-b771-befa5d0eadde tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:49.775673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b91cc4ce-897c-42ea-b771-befa5d0eadde tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:49.904744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b91cc4ce-897c-42ea-b771-befa5d0eadde tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:49.913117 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b91cc4ce-897c-42ea-b771-befa5d0eadde tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:49.914626 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b91cc4ce-897c-42ea-b771-befa5d0eadde tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:49.916462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b91cc4ce-897c-42ea-b771-befa5d0eadde tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153310 Jun 20 07:29:49.917466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 802/1719] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:49 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:50.511069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6475633b-7e68-445e-8d45-113171ebb041 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:50.511676 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6475633b-7e68-445e-8d45-113171ebb041 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:50.518178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6475633b-7e68-445e-8d45-113171ebb041 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:50.518620 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6475633b-7e68-445e-8d45-113171ebb041 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:50.519369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6475633b-7e68-445e-8d45-113171ebb041 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:50.519799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6475633b-7e68-445e-8d45-113171ebb041 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:50.652507 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6475633b-7e68-445e-8d45-113171ebb041 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:50.660336 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6475633b-7e68-445e-8d45-113171ebb041 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.153158 Jun 20 07:29:50.660901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 918/1720] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:50 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:50.937583 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b01cece-306b-482a-b204-2151be32955e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:50.938332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b01cece-306b-482a-b204-2151be32955e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:50.945214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b01cece-306b-482a-b204-2151be32955e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:50.945663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b01cece-306b-482a-b204-2151be32955e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:50.946422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b01cece-306b-482a-b204-2151be32955e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:50.946856 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b01cece-306b-482a-b204-2151be32955e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:51.083466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b01cece-306b-482a-b204-2151be32955e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:51.092439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b01cece-306b-482a-b204-2151be32955e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:51.093931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b01cece-306b-482a-b204-2151be32955e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:51.095078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b01cece-306b-482a-b204-2151be32955e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.161434 Jun 20 07:29:51.095629 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 803/1721] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:50 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:51.679527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eb71242f-a620-4776-983e-84963538aea7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:51.680338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eb71242f-a620-4776-983e-84963538aea7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:51.686651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb71242f-a620-4776-983e-84963538aea7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:51.687159 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb71242f-a620-4776-983e-84963538aea7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:51.688411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb71242f-a620-4776-983e-84963538aea7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:51.689224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb71242f-a620-4776-983e-84963538aea7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:51.829330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eb71242f-a620-4776-983e-84963538aea7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:51.837700 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eb71242f-a620-4776-983e-84963538aea7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.163445 Jun 20 07:29:51.838254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 919/1722] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:51 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:52.113454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-acf8b97e-c9d1-4e3a-b42c-2bb96be6af8d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:52.114073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-acf8b97e-c9d1-4e3a-b42c-2bb96be6af8d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:52.120754 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acf8b97e-c9d1-4e3a-b42c-2bb96be6af8d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:52.121202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acf8b97e-c9d1-4e3a-b42c-2bb96be6af8d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:52.121954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acf8b97e-c9d1-4e3a-b42c-2bb96be6af8d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:52.122387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-acf8b97e-c9d1-4e3a-b42c-2bb96be6af8d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:52.260170 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-acf8b97e-c9d1-4e3a-b42c-2bb96be6af8d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:52.271976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-acf8b97e-c9d1-4e3a-b42c-2bb96be6af8d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:52.273543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-acf8b97e-c9d1-4e3a-b42c-2bb96be6af8d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:52.274759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-acf8b97e-c9d1-4e3a-b42c-2bb96be6af8d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.165187 Jun 20 07:29:52.275323 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 804/1723] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:52 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:52.856573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0393ccdc-8639-4d38-9da9-2cac53550bec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:52.857187 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0393ccdc-8639-4d38-9da9-2cac53550bec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:52.863757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0393ccdc-8639-4d38-9da9-2cac53550bec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:52.864311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0393ccdc-8639-4d38-9da9-2cac53550bec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:52.865588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0393ccdc-8639-4d38-9da9-2cac53550bec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:52.866019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0393ccdc-8639-4d38-9da9-2cac53550bec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:52.996000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0393ccdc-8639-4d38-9da9-2cac53550bec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:53.003772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0393ccdc-8639-4d38-9da9-2cac53550bec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151080 Jun 20 07:29:53.004359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 920/1724] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:52 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:53.293576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0a302f34-3a38-489f-a65f-67c0e5170b01 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:53.294194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0a302f34-3a38-489f-a65f-67c0e5170b01 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:53.300675 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a302f34-3a38-489f-a65f-67c0e5170b01 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:53.301122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a302f34-3a38-489f-a65f-67c0e5170b01 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:53.301875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a302f34-3a38-489f-a65f-67c0e5170b01 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:53.302313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a302f34-3a38-489f-a65f-67c0e5170b01 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:53.432237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0a302f34-3a38-489f-a65f-67c0e5170b01 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:53.440648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0a302f34-3a38-489f-a65f-67c0e5170b01 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:53.442183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0a302f34-3a38-489f-a65f-67c0e5170b01 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:53.443337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0a302f34-3a38-489f-a65f-67c0e5170b01 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153655 Jun 20 07:29:53.443934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 805/1725] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:53 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:54.021160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aae33d31-96f2-4d6d-b73b-b9ba998426de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:54.021773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aae33d31-96f2-4d6d-b73b-b9ba998426de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:54.028829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aae33d31-96f2-4d6d-b73b-b9ba998426de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:54.029275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aae33d31-96f2-4d6d-b73b-b9ba998426de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:54.030028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aae33d31-96f2-4d6d-b73b-b9ba998426de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:54.030460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aae33d31-96f2-4d6d-b73b-b9ba998426de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:54.166133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-aae33d31-96f2-4d6d-b73b-b9ba998426de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:54.174069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aae33d31-96f2-4d6d-b73b-b9ba998426de tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.156803 Jun 20 07:29:54.174623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 921/1726] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:54 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:54.462048 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ee23e4e4-fce5-46bf-a7dc-82c749a85fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:54.462669 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ee23e4e4-fce5-46bf-a7dc-82c749a85fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:54.469387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee23e4e4-fce5-46bf-a7dc-82c749a85fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:54.469840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee23e4e4-fce5-46bf-a7dc-82c749a85fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:54.470604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee23e4e4-fce5-46bf-a7dc-82c749a85fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:54.471047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee23e4e4-fce5-46bf-a7dc-82c749a85fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:54.600670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ee23e4e4-fce5-46bf-a7dc-82c749a85fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:54.608951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ee23e4e4-fce5-46bf-a7dc-82c749a85fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:54.610444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ee23e4e4-fce5-46bf-a7dc-82c749a85fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:54.611596 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ee23e4e4-fce5-46bf-a7dc-82c749a85fd3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153434 Jun 20 07:29:54.612170 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 806/1727] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:54 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:55.190577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-edead52e-3e18-42c0-95d5-cbb5f5d3c87f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:55.191197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-edead52e-3e18-42c0-95d5-cbb5f5d3c87f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:55.197898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edead52e-3e18-42c0-95d5-cbb5f5d3c87f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:55.198346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edead52e-3e18-42c0-95d5-cbb5f5d3c87f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:55.199151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edead52e-3e18-42c0-95d5-cbb5f5d3c87f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:55.199582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edead52e-3e18-42c0-95d5-cbb5f5d3c87f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:55.327268 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-edead52e-3e18-42c0-95d5-cbb5f5d3c87f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:55.335612 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-edead52e-3e18-42c0-95d5-cbb5f5d3c87f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148335 Jun 20 07:29:55.336185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 922/1728] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:55 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:55.630415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9df9fab7-f64e-4e3d-aba0-c6bb590e14eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:55.631306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9df9fab7-f64e-4e3d-aba0-c6bb590e14eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:55.638293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9df9fab7-f64e-4e3d-aba0-c6bb590e14eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:55.638749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9df9fab7-f64e-4e3d-aba0-c6bb590e14eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:55.639512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9df9fab7-f64e-4e3d-aba0-c6bb590e14eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:55.639956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9df9fab7-f64e-4e3d-aba0-c6bb590e14eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:55.770569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9df9fab7-f64e-4e3d-aba0-c6bb590e14eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:55.779483 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9df9fab7-f64e-4e3d-aba0-c6bb590e14eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:55.781022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9df9fab7-f64e-4e3d-aba0-c6bb590e14eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:55.782261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9df9fab7-f64e-4e3d-aba0-c6bb590e14eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155732 Jun 20 07:29:55.782829 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 807/1729] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:55 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:56.352965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4f73c778-a6ff-453c-8203-059926550c49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:56.353579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4f73c778-a6ff-453c-8203-059926550c49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:56.359966 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f73c778-a6ff-453c-8203-059926550c49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:56.360425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f73c778-a6ff-453c-8203-059926550c49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:56.361176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f73c778-a6ff-453c-8203-059926550c49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:56.361606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f73c778-a6ff-453c-8203-059926550c49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:56.487218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4f73c778-a6ff-453c-8203-059926550c49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:56.495618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4f73c778-a6ff-453c-8203-059926550c49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147065 Jun 20 07:29:56.496200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 923/1730] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:56 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:56.799904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b9d14426-5fa0-4f17-9573-2a063fb662ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:56.800548 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b9d14426-5fa0-4f17-9573-2a063fb662ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:56.807048 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9d14426-5fa0-4f17-9573-2a063fb662ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:56.807505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9d14426-5fa0-4f17-9573-2a063fb662ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:56.808300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9d14426-5fa0-4f17-9573-2a063fb662ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:56.808745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9d14426-5fa0-4f17-9573-2a063fb662ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:56.938416 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b9d14426-5fa0-4f17-9573-2a063fb662ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:56.947434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b9d14426-5fa0-4f17-9573-2a063fb662ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:56.948979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b9d14426-5fa0-4f17-9573-2a063fb662ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:56.950147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b9d14426-5fa0-4f17-9573-2a063fb662ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154225 Jun 20 07:29:56.950711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 808/1731] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:56 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:57.512888 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2ae5de63-b588-494c-8fa5-ac14422f4939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:57.513499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2ae5de63-b588-494c-8fa5-ac14422f4939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:57.519876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ae5de63-b588-494c-8fa5-ac14422f4939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:57.520355 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ae5de63-b588-494c-8fa5-ac14422f4939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:57.521105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ae5de63-b588-494c-8fa5-ac14422f4939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:57.521538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ae5de63-b588-494c-8fa5-ac14422f4939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:57.651719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2ae5de63-b588-494c-8fa5-ac14422f4939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:57.659591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2ae5de63-b588-494c-8fa5-ac14422f4939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150524 Jun 20 07:29:57.660174 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 924/1732] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:57 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:57.969262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3572b9d3-7ada-417a-a0ec-04f399e31069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:57.969796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3572b9d3-7ada-417a-a0ec-04f399e31069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:57.976246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3572b9d3-7ada-417a-a0ec-04f399e31069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:57.976697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3572b9d3-7ada-417a-a0ec-04f399e31069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:57.977452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3572b9d3-7ada-417a-a0ec-04f399e31069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:57.977892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3572b9d3-7ada-417a-a0ec-04f399e31069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:58.106684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3572b9d3-7ada-417a-a0ec-04f399e31069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:58.115065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3572b9d3-7ada-417a-a0ec-04f399e31069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:58.117081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3572b9d3-7ada-417a-a0ec-04f399e31069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:58.118233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3572b9d3-7ada-417a-a0ec-04f399e31069 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152965 Jun 20 07:29:58.118789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 809/1733] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:57 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:58.676500 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-517b1ac5-36d8-47e6-af92-7e23e08f0f8b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:58.677105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-517b1ac5-36d8-47e6-af92-7e23e08f0f8b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:58.684217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-517b1ac5-36d8-47e6-af92-7e23e08f0f8b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:58.684659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-517b1ac5-36d8-47e6-af92-7e23e08f0f8b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:58.685410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-517b1ac5-36d8-47e6-af92-7e23e08f0f8b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:58.685876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-517b1ac5-36d8-47e6-af92-7e23e08f0f8b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:58.813279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-517b1ac5-36d8-47e6-af92-7e23e08f0f8b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:58.821130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-517b1ac5-36d8-47e6-af92-7e23e08f0f8b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148459 Jun 20 07:29:58.821691 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 925/1734] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:58 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:29:59.137060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-02b41d77-3d30-4986-a7e8-ac21410ec95b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:59.137632 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-02b41d77-3d30-4986-a7e8-ac21410ec95b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:59.144124 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02b41d77-3d30-4986-a7e8-ac21410ec95b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:59.144565 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02b41d77-3d30-4986-a7e8-ac21410ec95b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:59.145332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02b41d77-3d30-4986-a7e8-ac21410ec95b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:59.145774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02b41d77-3d30-4986-a7e8-ac21410ec95b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:59.271695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-02b41d77-3d30-4986-a7e8-ac21410ec95b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:59.280775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-02b41d77-3d30-4986-a7e8-ac21410ec95b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:59.282638 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-02b41d77-3d30-4986-a7e8-ac21410ec95b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:59.283800 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-02b41d77-3d30-4986-a7e8-ac21410ec95b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150740 Jun 20 07:29:59.284387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 810/1735] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:29:59 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:29:59.838232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9fba2ff4-a67a-4418-81ba-a894ab795a6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:29:59.838843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9fba2ff4-a67a-4418-81ba-a894ab795a6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:29:59.845344 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fba2ff4-a67a-4418-81ba-a894ab795a6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:59.845790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fba2ff4-a67a-4418-81ba-a894ab795a6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:59.846543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fba2ff4-a67a-4418-81ba-a894ab795a6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:29:59.846973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fba2ff4-a67a-4418-81ba-a894ab795a6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:29:59.975859 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9fba2ff4-a67a-4418-81ba-a894ab795a6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:29:59.983668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9fba2ff4-a67a-4418-81ba-a894ab795a6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149336 Jun 20 07:29:59.984282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 926/1736] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:29:59 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:00.303573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b24a38b0-f7ab-4b8e-b153-615fcc058257 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:00.304352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b24a38b0-f7ab-4b8e-b153-615fcc058257 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:00.311046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b24a38b0-f7ab-4b8e-b153-615fcc058257 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:00.311501 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b24a38b0-f7ab-4b8e-b153-615fcc058257 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:00.312301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b24a38b0-f7ab-4b8e-b153-615fcc058257 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:00.312744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b24a38b0-f7ab-4b8e-b153-615fcc058257 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:00.449593 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b24a38b0-f7ab-4b8e-b153-615fcc058257 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:00.458321 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b24a38b0-f7ab-4b8e-b153-615fcc058257 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:00.460361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b24a38b0-f7ab-4b8e-b153-615fcc058257 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:00.461533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b24a38b0-f7ab-4b8e-b153-615fcc058257 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.163163 Jun 20 07:30:00.462092 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 811/1737] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:00 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:01.001484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-418bea24-e253-47b1-b841-3c38a3eb3faf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:01.002026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-418bea24-e253-47b1-b841-3c38a3eb3faf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:01.009329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-418bea24-e253-47b1-b841-3c38a3eb3faf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:01.009777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-418bea24-e253-47b1-b841-3c38a3eb3faf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:01.010545 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-418bea24-e253-47b1-b841-3c38a3eb3faf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:01.010985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-418bea24-e253-47b1-b841-3c38a3eb3faf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:01.139119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-418bea24-e253-47b1-b841-3c38a3eb3faf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:01.146968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-418bea24-e253-47b1-b841-3c38a3eb3faf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149380 Jun 20 07:30:01.147535 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 927/1738] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:00 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:01.479706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f886d0ec-0126-43f1-a0f3-b885f4cb351f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:01.480463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f886d0ec-0126-43f1-a0f3-b885f4cb351f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:01.487093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f886d0ec-0126-43f1-a0f3-b885f4cb351f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:01.487543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f886d0ec-0126-43f1-a0f3-b885f4cb351f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:01.488334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f886d0ec-0126-43f1-a0f3-b885f4cb351f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:01.488772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f886d0ec-0126-43f1-a0f3-b885f4cb351f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:01.616161 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f886d0ec-0126-43f1-a0f3-b885f4cb351f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:01.618312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:30:01.625589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f886d0ec-0126-43f1-a0f3-b885f4cb351f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:01.627082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f886d0ec-0126-43f1-a0f3-b885f4cb351f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:01.628267 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f886d0ec-0126-43f1-a0f3-b885f4cb351f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152417 Jun 20 07:30:01.628827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 812/1739] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:01 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:02.164359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d9219663-0b95-493a-8945-48c66a9179d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:02.164969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d9219663-0b95-493a-8945-48c66a9179d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:02.171359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9219663-0b95-493a-8945-48c66a9179d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:02.171797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9219663-0b95-493a-8945-48c66a9179d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:02.172581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9219663-0b95-493a-8945-48c66a9179d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:02.173009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d9219663-0b95-493a-8945-48c66a9179d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:02.298295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d9219663-0b95-493a-8945-48c66a9179d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:02.306708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d9219663-0b95-493a-8945-48c66a9179d1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146740 Jun 20 07:30:02.307305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 928/1740] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:02 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:02.647961 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1cc10719-40bd-47c4-809a-38284c541847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:02.648599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1cc10719-40bd-47c4-809a-38284c541847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:02.654941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cc10719-40bd-47c4-809a-38284c541847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:02.655393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cc10719-40bd-47c4-809a-38284c541847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:02.656183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cc10719-40bd-47c4-809a-38284c541847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:02.656628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1cc10719-40bd-47c4-809a-38284c541847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:02.785365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1cc10719-40bd-47c4-809a-38284c541847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:02.794322 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1cc10719-40bd-47c4-809a-38284c541847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:02.795824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1cc10719-40bd-47c4-809a-38284c541847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:02.797019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1cc10719-40bd-47c4-809a-38284c541847 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153650 Jun 20 07:30:02.797583 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 813/1741] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:02 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:03.323415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-98f58005-620a-4dd3-abcf-d3bc7581b62b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:03.324028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-98f58005-620a-4dd3-abcf-d3bc7581b62b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:03.330609 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98f58005-620a-4dd3-abcf-d3bc7581b62b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:03.331059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98f58005-620a-4dd3-abcf-d3bc7581b62b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:03.331810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98f58005-620a-4dd3-abcf-d3bc7581b62b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:03.332279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-98f58005-620a-4dd3-abcf-d3bc7581b62b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:03.457400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-98f58005-620a-4dd3-abcf-d3bc7581b62b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:03.465263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-98f58005-620a-4dd3-abcf-d3bc7581b62b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146367 Jun 20 07:30:03.465829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 929/1742] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:03 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:03.815110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1611fc52-ff22-4de3-9a4e-807cf603b740 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:03.815729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1611fc52-ff22-4de3-9a4e-807cf603b740 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:03.822423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1611fc52-ff22-4de3-9a4e-807cf603b740 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:03.822874 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1611fc52-ff22-4de3-9a4e-807cf603b740 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:03.823635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1611fc52-ff22-4de3-9a4e-807cf603b740 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:03.824074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1611fc52-ff22-4de3-9a4e-807cf603b740 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:03.952960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1611fc52-ff22-4de3-9a4e-807cf603b740 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:03.961209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1611fc52-ff22-4de3-9a4e-807cf603b740 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:03.962717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1611fc52-ff22-4de3-9a4e-807cf603b740 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:03.963873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1611fc52-ff22-4de3-9a4e-807cf603b740 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152695 Jun 20 07:30:03.964473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 814/1743] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:03 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:04.482169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e5e274ae-2da7-4f02-9e75-c97268b96663 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:04.482776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e5e274ae-2da7-4f02-9e75-c97268b96663 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:04.488890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5e274ae-2da7-4f02-9e75-c97268b96663 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:04.489329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5e274ae-2da7-4f02-9e75-c97268b96663 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:04.490079 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5e274ae-2da7-4f02-9e75-c97268b96663 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:04.490509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5e274ae-2da7-4f02-9e75-c97268b96663 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:04.616512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e5e274ae-2da7-4f02-9e75-c97268b96663 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:04.624475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e5e274ae-2da7-4f02-9e75-c97268b96663 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146250 Jun 20 07:30:04.625107 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 930/1744] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:04 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:04.982271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-641d922d-147d-4f7d-8454-142139cdbe16 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:04.982898 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-641d922d-147d-4f7d-8454-142139cdbe16 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:04.989653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-641d922d-147d-4f7d-8454-142139cdbe16 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:04.990102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-641d922d-147d-4f7d-8454-142139cdbe16 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:04.991363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-641d922d-147d-4f7d-8454-142139cdbe16 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:04.991804 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-641d922d-147d-4f7d-8454-142139cdbe16 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:05.119912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-641d922d-147d-4f7d-8454-142139cdbe16 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:05.128252 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-641d922d-147d-4f7d-8454-142139cdbe16 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:05.129751 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-641d922d-147d-4f7d-8454-142139cdbe16 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:05.131162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-641d922d-147d-4f7d-8454-142139cdbe16 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152740 Jun 20 07:30:05.132347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 815/1745] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:04 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:05.642568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-369a707d-7f14-44c7-b2cf-a72fae7775c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:05.643175 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-369a707d-7f14-44c7-b2cf-a72fae7775c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:05.649836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-369a707d-7f14-44c7-b2cf-a72fae7775c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:05.650531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-369a707d-7f14-44c7-b2cf-a72fae7775c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:05.651038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-369a707d-7f14-44c7-b2cf-a72fae7775c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:05.651497 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-369a707d-7f14-44c7-b2cf-a72fae7775c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:05.787355 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-369a707d-7f14-44c7-b2cf-a72fae7775c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:05.795248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-369a707d-7f14-44c7-b2cf-a72fae7775c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.156808 Jun 20 07:30:05.795818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 931/1746] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:05 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:06.150153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7744ee71-ca04-4e67-bfa8-39b0979c9d45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:06.150799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7744ee71-ca04-4e67-bfa8-39b0979c9d45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:06.157600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7744ee71-ca04-4e67-bfa8-39b0979c9d45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:06.158046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7744ee71-ca04-4e67-bfa8-39b0979c9d45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:06.158812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7744ee71-ca04-4e67-bfa8-39b0979c9d45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:06.159246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7744ee71-ca04-4e67-bfa8-39b0979c9d45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:06.294218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7744ee71-ca04-4e67-bfa8-39b0979c9d45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:06.304929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7744ee71-ca04-4e67-bfa8-39b0979c9d45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:06.306412 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7744ee71-ca04-4e67-bfa8-39b0979c9d45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:06.307569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7744ee71-ca04-4e67-bfa8-39b0979c9d45 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.161350 Jun 20 07:30:06.308198 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 816/1747] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:06 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:06.812512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b4fee1f3-722c-46fd-893b-9700b2b572b0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:06.813122 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b4fee1f3-722c-46fd-893b-9700b2b572b0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:06.819961 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4fee1f3-722c-46fd-893b-9700b2b572b0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:06.820437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4fee1f3-722c-46fd-893b-9700b2b572b0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:06.821187 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4fee1f3-722c-46fd-893b-9700b2b572b0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:06.821616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b4fee1f3-722c-46fd-893b-9700b2b572b0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:06.951006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b4fee1f3-722c-46fd-893b-9700b2b572b0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:06.958854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b4fee1f3-722c-46fd-893b-9700b2b572b0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150113 Jun 20 07:30:06.959353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 932/1748] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:06 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:07.325947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-46e7fc1e-fd38-4753-b0d4-6ac17fb4a034 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:07.326571 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-46e7fc1e-fd38-4753-b0d4-6ac17fb4a034 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:07.333062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46e7fc1e-fd38-4753-b0d4-6ac17fb4a034 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:07.333515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46e7fc1e-fd38-4753-b0d4-6ac17fb4a034 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:07.334281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46e7fc1e-fd38-4753-b0d4-6ac17fb4a034 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:07.334723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46e7fc1e-fd38-4753-b0d4-6ac17fb4a034 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:07.460538 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-46e7fc1e-fd38-4753-b0d4-6ac17fb4a034 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:07.468884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-46e7fc1e-fd38-4753-b0d4-6ac17fb4a034 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:07.470388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-46e7fc1e-fd38-4753-b0d4-6ac17fb4a034 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:07.471546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-46e7fc1e-fd38-4753-b0d4-6ac17fb4a034 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149475 Jun 20 07:30:07.472129 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 817/1749] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:07 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:07.976889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0d29ddd3-b92a-48a2-bd82-6b8421d3bb84 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:07.977439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0d29ddd3-b92a-48a2-bd82-6b8421d3bb84 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:07.983842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d29ddd3-b92a-48a2-bd82-6b8421d3bb84 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:07.984324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d29ddd3-b92a-48a2-bd82-6b8421d3bb84 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:07.985074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d29ddd3-b92a-48a2-bd82-6b8421d3bb84 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:07.985502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d29ddd3-b92a-48a2-bd82-6b8421d3bb84 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:08.113779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0d29ddd3-b92a-48a2-bd82-6b8421d3bb84 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:08.121778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0d29ddd3-b92a-48a2-bd82-6b8421d3bb84 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149406 Jun 20 07:30:08.122372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 933/1750] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:07 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:08.490484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6190b4a6-5fc2-445f-9d5b-7f862bc159ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:08.491129 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6190b4a6-5fc2-445f-9d5b-7f862bc159ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:08.497659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6190b4a6-5fc2-445f-9d5b-7f862bc159ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:08.498106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6190b4a6-5fc2-445f-9d5b-7f862bc159ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:08.498861 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6190b4a6-5fc2-445f-9d5b-7f862bc159ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:08.499300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6190b4a6-5fc2-445f-9d5b-7f862bc159ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:08.626381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6190b4a6-5fc2-445f-9d5b-7f862bc159ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:08.635454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6190b4a6-5fc2-445f-9d5b-7f862bc159ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:08.636988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6190b4a6-5fc2-445f-9d5b-7f862bc159ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:08.638150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6190b4a6-5fc2-445f-9d5b-7f862bc159ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151609 Jun 20 07:30:08.638709 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 818/1751] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:08 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:09.138518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6feb5d2a-366c-4b65-86a1-9935dec96340 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:09.139129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6feb5d2a-366c-4b65-86a1-9935dec96340 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:09.145487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6feb5d2a-366c-4b65-86a1-9935dec96340 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:09.145929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6feb5d2a-366c-4b65-86a1-9935dec96340 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:09.146685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6feb5d2a-366c-4b65-86a1-9935dec96340 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:09.147116 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6feb5d2a-366c-4b65-86a1-9935dec96340 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:09.161683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:30:09.274642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6feb5d2a-366c-4b65-86a1-9935dec96340 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:09.282446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6feb5d2a-366c-4b65-86a1-9935dec96340 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147742 Jun 20 07:30:09.283004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 934/1752] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:09 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:09.657644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4593a8d0-739f-4052-a91d-4806ce50faf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:09.658266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4593a8d0-739f-4052-a91d-4806ce50faf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:09.665350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4593a8d0-739f-4052-a91d-4806ce50faf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:09.665805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4593a8d0-739f-4052-a91d-4806ce50faf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:09.666568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4593a8d0-739f-4052-a91d-4806ce50faf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:09.667009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4593a8d0-739f-4052-a91d-4806ce50faf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:09.796311 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4593a8d0-739f-4052-a91d-4806ce50faf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:09.804744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4593a8d0-739f-4052-a91d-4806ce50faf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:09.806251 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4593a8d0-739f-4052-a91d-4806ce50faf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:09.807413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4593a8d0-739f-4052-a91d-4806ce50faf1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153737 Jun 20 07:30:09.807978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 819/1753] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:09 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:10.299782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b5c1be39-ce10-44a6-b6cb-e70cb82efec2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:10.300480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b5c1be39-ce10-44a6-b6cb-e70cb82efec2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:10.307511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5c1be39-ce10-44a6-b6cb-e70cb82efec2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:10.307955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5c1be39-ce10-44a6-b6cb-e70cb82efec2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:10.308783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5c1be39-ce10-44a6-b6cb-e70cb82efec2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:10.309200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5c1be39-ce10-44a6-b6cb-e70cb82efec2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:10.435611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b5c1be39-ce10-44a6-b6cb-e70cb82efec2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:10.443634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b5c1be39-ce10-44a6-b6cb-e70cb82efec2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147777 Jun 20 07:30:10.444358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 935/1754] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:10 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:10.826002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-083886f0-0aae-4749-ade3-41b552ef5697 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:10.826626 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-083886f0-0aae-4749-ade3-41b552ef5697 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:10.833071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-083886f0-0aae-4749-ade3-41b552ef5697 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:10.833522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-083886f0-0aae-4749-ade3-41b552ef5697 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:10.834780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-083886f0-0aae-4749-ade3-41b552ef5697 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:10.835221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-083886f0-0aae-4749-ade3-41b552ef5697 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:10.964771 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-083886f0-0aae-4749-ade3-41b552ef5697 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:10.973191 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-083886f0-0aae-4749-ade3-41b552ef5697 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:10.974705 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-083886f0-0aae-4749-ade3-41b552ef5697 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:10.976490 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-083886f0-0aae-4749-ade3-41b552ef5697 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154395 Jun 20 07:30:10.979009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 820/1755] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:10 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:11.461370 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c8861569-0fc7-45fb-9d46-8e4316aa3f54 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:11.462010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c8861569-0fc7-45fb-9d46-8e4316aa3f54 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:11.468525 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8861569-0fc7-45fb-9d46-8e4316aa3f54 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:11.468970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8861569-0fc7-45fb-9d46-8e4316aa3f54 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:11.469769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8861569-0fc7-45fb-9d46-8e4316aa3f54 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:11.470236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8861569-0fc7-45fb-9d46-8e4316aa3f54 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:11.598728 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c8861569-0fc7-45fb-9d46-8e4316aa3f54 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:11.606505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c8861569-0fc7-45fb-9d46-8e4316aa3f54 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149607 Jun 20 07:30:11.607062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 936/1756] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:11 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:11.996313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2058b63e-16de-4ec2-aadd-141d2b43c133 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:11.996936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2058b63e-16de-4ec2-aadd-141d2b43c133 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:12.003834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2058b63e-16de-4ec2-aadd-141d2b43c133 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:12.005273 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2058b63e-16de-4ec2-aadd-141d2b43c133 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:12.006338 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2058b63e-16de-4ec2-aadd-141d2b43c133 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:12.006785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2058b63e-16de-4ec2-aadd-141d2b43c133 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:12.138258 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2058b63e-16de-4ec2-aadd-141d2b43c133 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:12.146636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2058b63e-16de-4ec2-aadd-141d2b43c133 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:12.148160 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2058b63e-16de-4ec2-aadd-141d2b43c133 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:12.149326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2058b63e-16de-4ec2-aadd-141d2b43c133 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.158485 Jun 20 07:30:12.149884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 821/1757] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:11 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:12.623918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ec9983ff-e366-488a-8cd4-15694999432f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:12.624473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ec9983ff-e366-488a-8cd4-15694999432f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:12.631241 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ec9983ff-e366-488a-8cd4-15694999432f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:12.631691 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ec9983ff-e366-488a-8cd4-15694999432f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:12.632484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ec9983ff-e366-488a-8cd4-15694999432f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:12.632920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ec9983ff-e366-488a-8cd4-15694999432f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:12.759636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ec9983ff-e366-488a-8cd4-15694999432f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:12.767546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ec9983ff-e366-488a-8cd4-15694999432f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147593 Jun 20 07:30:12.768140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 937/1758] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:12 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:13.166646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-47732f2d-bc2b-4c6f-9f3d-e641616031f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:13.167200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-47732f2d-bc2b-4c6f-9f3d-e641616031f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:13.169535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:30:13.175043 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47732f2d-bc2b-4c6f-9f3d-e641616031f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:13.175493 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47732f2d-bc2b-4c6f-9f3d-e641616031f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:13.176291 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47732f2d-bc2b-4c6f-9f3d-e641616031f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:13.176731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47732f2d-bc2b-4c6f-9f3d-e641616031f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:13.302248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-47732f2d-bc2b-4c6f-9f3d-e641616031f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:13.311154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-47732f2d-bc2b-4c6f-9f3d-e641616031f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:13.312680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-47732f2d-bc2b-4c6f-9f3d-e641616031f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:13.313834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-47732f2d-bc2b-4c6f-9f3d-e641616031f5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151095 Jun 20 07:30:13.314394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 822/1759] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:13 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:13.785069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d7d02ba7-900c-484b-acb3-c7bba0f5ad87 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:13.785678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d7d02ba7-900c-484b-acb3-c7bba0f5ad87 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:13.792813 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7d02ba7-900c-484b-acb3-c7bba0f5ad87 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:13.793255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7d02ba7-900c-484b-acb3-c7bba0f5ad87 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:13.794006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7d02ba7-900c-484b-acb3-c7bba0f5ad87 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:13.794466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7d02ba7-900c-484b-acb3-c7bba0f5ad87 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:13.923360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d7d02ba7-900c-484b-acb3-c7bba0f5ad87 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:13.931362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d7d02ba7-900c-484b-acb3-c7bba0f5ad87 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150151 Jun 20 07:30:13.931925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 938/1760] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:13 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:14.332982 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f1671c38-6e0f-4bb0-b01f-c13f623f3f24 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:14.333517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f1671c38-6e0f-4bb0-b01f-c13f623f3f24 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:14.340589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1671c38-6e0f-4bb0-b01f-c13f623f3f24 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:14.341033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1671c38-6e0f-4bb0-b01f-c13f623f3f24 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:14.341780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1671c38-6e0f-4bb0-b01f-c13f623f3f24 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:14.342390 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1671c38-6e0f-4bb0-b01f-c13f623f3f24 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:14.473874 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f1671c38-6e0f-4bb0-b01f-c13f623f3f24 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:14.482600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f1671c38-6e0f-4bb0-b01f-c13f623f3f24 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:14.484134 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f1671c38-6e0f-4bb0-b01f-c13f623f3f24 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:14.485281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f1671c38-6e0f-4bb0-b01f-c13f623f3f24 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.156288 Jun 20 07:30:14.485841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 823/1761] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:14 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:14.947868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-03b537df-cf0d-49a6-8599-022f3b0c67e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:14.948505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-03b537df-cf0d-49a6-8599-022f3b0c67e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:14.950788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=52 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:30:14.956194 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03b537df-cf0d-49a6-8599-022f3b0c67e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:14.956644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03b537df-cf0d-49a6-8599-022f3b0c67e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:14.957405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03b537df-cf0d-49a6-8599-022f3b0c67e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:14.957838 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-03b537df-cf0d-49a6-8599-022f3b0c67e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:15.096165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-03b537df-cf0d-49a6-8599-022f3b0c67e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:15.104552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-03b537df-cf0d-49a6-8599-022f3b0c67e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.160488 Jun 20 07:30:15.105114 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 939/1762] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:14 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:15.503751 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ea11fb6-a532-4049-a0ce-c9fba9b4f219 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:15.504416 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3ea11fb6-a532-4049-a0ce-c9fba9b4f219 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:15.511255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ea11fb6-a532-4049-a0ce-c9fba9b4f219 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:15.511697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ea11fb6-a532-4049-a0ce-c9fba9b4f219 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:15.512479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ea11fb6-a532-4049-a0ce-c9fba9b4f219 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:15.512911 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ea11fb6-a532-4049-a0ce-c9fba9b4f219 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:15.638688 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3ea11fb6-a532-4049-a0ce-c9fba9b4f219 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:15.647523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3ea11fb6-a532-4049-a0ce-c9fba9b4f219 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:15.649043 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3ea11fb6-a532-4049-a0ce-c9fba9b4f219 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:15.650194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3ea11fb6-a532-4049-a0ce-c9fba9b4f219 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150312 Jun 20 07:30:15.650745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 824/1763] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:15 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:16.121955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-134034fa-14e7-42cf-9c1b-2d6149d3bd1b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:16.122568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-134034fa-14e7-42cf-9c1b-2d6149d3bd1b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:16.129055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-134034fa-14e7-42cf-9c1b-2d6149d3bd1b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:16.129502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-134034fa-14e7-42cf-9c1b-2d6149d3bd1b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:16.130257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-134034fa-14e7-42cf-9c1b-2d6149d3bd1b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:16.130944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-134034fa-14e7-42cf-9c1b-2d6149d3bd1b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:16.264535 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-134034fa-14e7-42cf-9c1b-2d6149d3bd1b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:16.272350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-134034fa-14e7-42cf-9c1b-2d6149d3bd1b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.154210 Jun 20 07:30:16.272907 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 940/1764] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:16 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:16.668172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4d9fe1ea-7cf6-4b22-868e-2f39f2c8c8b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:16.668802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4d9fe1ea-7cf6-4b22-868e-2f39f2c8c8b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:16.675281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d9fe1ea-7cf6-4b22-868e-2f39f2c8c8b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:16.675733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d9fe1ea-7cf6-4b22-868e-2f39f2c8c8b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:16.676523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d9fe1ea-7cf6-4b22-868e-2f39f2c8c8b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:16.676965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d9fe1ea-7cf6-4b22-868e-2f39f2c8c8b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:16.820375 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d9fe1ea-7cf6-4b22-868e-2f39f2c8c8b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:16.826468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d9fe1ea-7cf6-4b22-868e-2f39f2c8c8b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:16.827972 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d9fe1ea-7cf6-4b22-868e-2f39f2c8c8b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:16.829156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4d9fe1ea-7cf6-4b22-868e-2f39f2c8c8b7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.164879 Jun 20 07:30:16.829720 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 825/1765] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:16 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:17.289104 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-addd95fa-6baa-4c1b-8d2e-c4927d68e932 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:17.289724 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-addd95fa-6baa-4c1b-8d2e-c4927d68e932 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:17.296448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-addd95fa-6baa-4c1b-8d2e-c4927d68e932 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:17.296908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-addd95fa-6baa-4c1b-8d2e-c4927d68e932 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:17.297680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-addd95fa-6baa-4c1b-8d2e-c4927d68e932 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:17.298296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-addd95fa-6baa-4c1b-8d2e-c4927d68e932 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:17.426871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-addd95fa-6baa-4c1b-8d2e-c4927d68e932 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:17.434896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-addd95fa-6baa-4c1b-8d2e-c4927d68e932 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149594 Jun 20 07:30:17.435789 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 941/1766] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:17 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:17.848145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca96d86a-ffdb-4c87-903c-2296b4fadba7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:17.848717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca96d86a-ffdb-4c87-903c-2296b4fadba7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:17.855168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca96d86a-ffdb-4c87-903c-2296b4fadba7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:17.855622 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca96d86a-ffdb-4c87-903c-2296b4fadba7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:17.856408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca96d86a-ffdb-4c87-903c-2296b4fadba7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:17.856909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca96d86a-ffdb-4c87-903c-2296b4fadba7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:17.989795 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca96d86a-ffdb-4c87-903c-2296b4fadba7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:17.998881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca96d86a-ffdb-4c87-903c-2296b4fadba7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:18.000461 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca96d86a-ffdb-4c87-903c-2296b4fadba7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:18.001646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca96d86a-ffdb-4c87-903c-2296b4fadba7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.157466 Jun 20 07:30:18.002202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 826/1767] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:17 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:18.452486 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b7ad9f8f-049f-4d1d-ac67-79b68989fa62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:18.453103 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b7ad9f8f-049f-4d1d-ac67-79b68989fa62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:18.460081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7ad9f8f-049f-4d1d-ac67-79b68989fa62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:18.460560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7ad9f8f-049f-4d1d-ac67-79b68989fa62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:18.461322 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7ad9f8f-049f-4d1d-ac67-79b68989fa62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:18.461761 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7ad9f8f-049f-4d1d-ac67-79b68989fa62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:18.587349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b7ad9f8f-049f-4d1d-ac67-79b68989fa62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:18.595271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b7ad9f8f-049f-4d1d-ac67-79b68989fa62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146599 Jun 20 07:30:18.595837 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 942/1768] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:18 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:19.020333 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-286f11f7-302c-4993-ba4f-cc164a6eaf39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:19.020958 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-286f11f7-302c-4993-ba4f-cc164a6eaf39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:19.028007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-286f11f7-302c-4993-ba4f-cc164a6eaf39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:19.028495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-286f11f7-302c-4993-ba4f-cc164a6eaf39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:19.029273 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-286f11f7-302c-4993-ba4f-cc164a6eaf39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:19.029709 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-286f11f7-302c-4993-ba4f-cc164a6eaf39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:19.159354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-286f11f7-302c-4993-ba4f-cc164a6eaf39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:19.167783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-286f11f7-302c-4993-ba4f-cc164a6eaf39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:19.169313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-286f11f7-302c-4993-ba4f-cc164a6eaf39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:19.170478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-286f11f7-302c-4993-ba4f-cc164a6eaf39 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154135 Jun 20 07:30:19.171046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 827/1769] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:19 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:19.612462 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b7d2ffad-924d-40dd-a751-a30ec3fdb9ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:19.613008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b7d2ffad-924d-40dd-a751-a30ec3fdb9ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:19.619452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7d2ffad-924d-40dd-a751-a30ec3fdb9ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:19.619890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7d2ffad-924d-40dd-a751-a30ec3fdb9ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:19.620671 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7d2ffad-924d-40dd-a751-a30ec3fdb9ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:19.621099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b7d2ffad-924d-40dd-a751-a30ec3fdb9ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:19.750803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b7d2ffad-924d-40dd-a751-a30ec3fdb9ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:19.759570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b7d2ffad-924d-40dd-a751-a30ec3fdb9ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151113 Jun 20 07:30:19.760154 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 943/1770] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:19 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:20.189711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dbb42bda-237f-435d-8869-0a35658539fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:20.190453 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dbb42bda-237f-435d-8869-0a35658539fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:20.196495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dbb42bda-237f-435d-8869-0a35658539fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:20.196946 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dbb42bda-237f-435d-8869-0a35658539fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:20.197714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dbb42bda-237f-435d-8869-0a35658539fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:20.198157 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dbb42bda-237f-435d-8869-0a35658539fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:20.336613 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dbb42bda-237f-435d-8869-0a35658539fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:20.344874 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dbb42bda-237f-435d-8869-0a35658539fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:20.346396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dbb42bda-237f-435d-8869-0a35658539fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:20.347578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dbb42bda-237f-435d-8869-0a35658539fb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.162050 Jun 20 07:30:20.348159 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 828/1771] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:20 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:20.776764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-09429ced-964e-42c1-aaa5-707fb2a10db8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:20.777386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-09429ced-964e-42c1-aaa5-707fb2a10db8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:20.783793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09429ced-964e-42c1-aaa5-707fb2a10db8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:20.784269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09429ced-964e-42c1-aaa5-707fb2a10db8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:20.785025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09429ced-964e-42c1-aaa5-707fb2a10db8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:20.785459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09429ced-964e-42c1-aaa5-707fb2a10db8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:20.912981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-09429ced-964e-42c1-aaa5-707fb2a10db8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:20.920850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-09429ced-964e-42c1-aaa5-707fb2a10db8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147892 Jun 20 07:30:20.921424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 944/1772] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:20 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:21.368482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ce37377d-d87f-4219-afc0-b6b7b2ba04d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:21.369266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ce37377d-d87f-4219-afc0-b6b7b2ba04d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:21.375739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce37377d-d87f-4219-afc0-b6b7b2ba04d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:21.376214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce37377d-d87f-4219-afc0-b6b7b2ba04d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:21.376971 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce37377d-d87f-4219-afc0-b6b7b2ba04d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:21.377399 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce37377d-d87f-4219-afc0-b6b7b2ba04d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:21.393041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:30:21.505065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce37377d-d87f-4219-afc0-b6b7b2ba04d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:21.515139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce37377d-d87f-4219-afc0-b6b7b2ba04d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:21.516681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce37377d-d87f-4219-afc0-b6b7b2ba04d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:21.517828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ce37377d-d87f-4219-afc0-b6b7b2ba04d7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155103 Jun 20 07:30:21.518411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 829/1773] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:21 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:21.937901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f7ba39b5-2ca4-4935-8935-dc34274978f4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:21.938550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f7ba39b5-2ca4-4935-8935-dc34274978f4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:21.945063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7ba39b5-2ca4-4935-8935-dc34274978f4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:21.945515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7ba39b5-2ca4-4935-8935-dc34274978f4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:21.946277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7ba39b5-2ca4-4935-8935-dc34274978f4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:21.946711 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7ba39b5-2ca4-4935-8935-dc34274978f4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:22.085736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f7ba39b5-2ca4-4935-8935-dc34274978f4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:22.093573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f7ba39b5-2ca4-4935-8935-dc34274978f4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.159531 Jun 20 07:30:22.094140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 945/1774] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:21 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:22.540611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-35d05e8c-c665-49a2-b768-eb140b6e4b2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:22.540611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-35d05e8c-c665-49a2-b768-eb140b6e4b2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:22.547485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35d05e8c-c665-49a2-b768-eb140b6e4b2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:22.547884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35d05e8c-c665-49a2-b768-eb140b6e4b2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:22.548746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35d05e8c-c665-49a2-b768-eb140b6e4b2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:22.549789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35d05e8c-c665-49a2-b768-eb140b6e4b2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:22.756845 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-35d05e8c-c665-49a2-b768-eb140b6e4b2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:22.766245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-35d05e8c-c665-49a2-b768-eb140b6e4b2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:22.767752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-35d05e8c-c665-49a2-b768-eb140b6e4b2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:22.768960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-35d05e8c-c665-49a2-b768-eb140b6e4b2c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.236232 Jun 20 07:30:22.769723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 830/1775] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:23.111164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1a5daf99-9ed0-4173-ad93-a396d6f416d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:23.111777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a5daf99-9ed0-4173-ad93-a396d6f416d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:23.118837 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a5daf99-9ed0-4173-ad93-a396d6f416d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:23.119283 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a5daf99-9ed0-4173-ad93-a396d6f416d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:23.120044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a5daf99-9ed0-4173-ad93-a396d6f416d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:23.120510 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a5daf99-9ed0-4173-ad93-a396d6f416d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:23.250061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1a5daf99-9ed0-4173-ad93-a396d6f416d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:23.258245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1a5daf99-9ed0-4173-ad93-a396d6f416d0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151229 Jun 20 07:30:23.258814 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 946/1776] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:23 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:30:23.788431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1e9d4a63-1803-4b98-8e0b-672849abbcf0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:23.789046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1e9d4a63-1803-4b98-8e0b-672849abbcf0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:23.795515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e9d4a63-1803-4b98-8e0b-672849abbcf0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:23.795907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e9d4a63-1803-4b98-8e0b-672849abbcf0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:23.796698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e9d4a63-1803-4b98-8e0b-672849abbcf0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:23.797134 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e9d4a63-1803-4b98-8e0b-672849abbcf0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:23.924813 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1e9d4a63-1803-4b98-8e0b-672849abbcf0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:23.933376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1e9d4a63-1803-4b98-8e0b-672849abbcf0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:23.934890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1e9d4a63-1803-4b98-8e0b-672849abbcf0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:23.936056 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1e9d4a63-1803-4b98-8e0b-672849abbcf0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152191 Jun 20 07:30:23.936643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 831/1777] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:23 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:24.278916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a1d4565c-42cc-4acf-ad79-ed726fe32633 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:24.279539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a1d4565c-42cc-4acf-ad79-ed726fe32633 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:24.286373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1d4565c-42cc-4acf-ad79-ed726fe32633 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:24.286833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1d4565c-42cc-4acf-ad79-ed726fe32633 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:24.287601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1d4565c-42cc-4acf-ad79-ed726fe32633 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:24.288037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1d4565c-42cc-4acf-ad79-ed726fe32633 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:24.416459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1d4565c-42cc-4acf-ad79-ed726fe32633 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:24.424419 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a1d4565c-42cc-4acf-ad79-ed726fe32633 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.153463 Jun 20 07:30:24.425218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 947/1778] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:24 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:24.954817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ae2ce9fe-f81d-468c-b553-0892e3469801 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:24.955525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ae2ce9fe-f81d-468c-b553-0892e3469801 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:24.962414 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ae2ce9fe-f81d-468c-b553-0892e3469801 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:24.962900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ae2ce9fe-f81d-468c-b553-0892e3469801 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:24.963665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ae2ce9fe-f81d-468c-b553-0892e3469801 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:24.964127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ae2ce9fe-f81d-468c-b553-0892e3469801 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:25.093632 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ae2ce9fe-f81d-468c-b553-0892e3469801 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:25.102707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ae2ce9fe-f81d-468c-b553-0892e3469801 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:25.104234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ae2ce9fe-f81d-468c-b553-0892e3469801 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:25.105406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ae2ce9fe-f81d-468c-b553-0892e3469801 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154608 Jun 20 07:30:25.105964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 832/1779] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:24 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:25.442005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-29b6f9d0-c9c6-41e9-a6b7-7a991d96742f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:25.442615 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-29b6f9d0-c9c6-41e9-a6b7-7a991d96742f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:25.449780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29b6f9d0-c9c6-41e9-a6b7-7a991d96742f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:25.450225 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29b6f9d0-c9c6-41e9-a6b7-7a991d96742f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:25.450983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29b6f9d0-c9c6-41e9-a6b7-7a991d96742f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:25.451415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29b6f9d0-c9c6-41e9-a6b7-7a991d96742f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:25.579691 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29b6f9d0-c9c6-41e9-a6b7-7a991d96742f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:25.588283 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-29b6f9d0-c9c6-41e9-a6b7-7a991d96742f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150159 Jun 20 07:30:25.588850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 948/1780] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:25 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:26.123762 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f071751b-615a-4267-8f22-29d264428723 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:26.124420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f071751b-615a-4267-8f22-29d264428723 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:26.131915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f071751b-615a-4267-8f22-29d264428723 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:26.132389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f071751b-615a-4267-8f22-29d264428723 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:26.133153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f071751b-615a-4267-8f22-29d264428723 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:26.133587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f071751b-615a-4267-8f22-29d264428723 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:26.258090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f071751b-615a-4267-8f22-29d264428723 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:26.266537 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f071751b-615a-4267-8f22-29d264428723 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:26.268168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f071751b-615a-4267-8f22-29d264428723 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:26.269340 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f071751b-615a-4267-8f22-29d264428723 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149554 Jun 20 07:30:26.269902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 833/1781] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:26 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:26.605784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5ed5bdfb-c00b-429f-bf28-6bb37b7f6b6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:26.606401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5ed5bdfb-c00b-429f-bf28-6bb37b7f6b6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:26.612930 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5ed5bdfb-c00b-429f-bf28-6bb37b7f6b6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:26.613383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5ed5bdfb-c00b-429f-bf28-6bb37b7f6b6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:26.614145 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5ed5bdfb-c00b-429f-bf28-6bb37b7f6b6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:26.614585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5ed5bdfb-c00b-429f-bf28-6bb37b7f6b6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:26.752437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5ed5bdfb-c00b-429f-bf28-6bb37b7f6b6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:26.760410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5ed5bdfb-c00b-429f-bf28-6bb37b7f6b6a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.158473 Jun 20 07:30:26.761150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 949/1782] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:26 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:27.286923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-35f2cf0b-ab52-4db5-bcfd-0eff10b3cdd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:27.287449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-35f2cf0b-ab52-4db5-bcfd-0eff10b3cdd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:27.293855 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35f2cf0b-ab52-4db5-bcfd-0eff10b3cdd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:27.294300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35f2cf0b-ab52-4db5-bcfd-0eff10b3cdd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:27.295050 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35f2cf0b-ab52-4db5-bcfd-0eff10b3cdd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:27.295487 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35f2cf0b-ab52-4db5-bcfd-0eff10b3cdd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:27.655353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-35f2cf0b-ab52-4db5-bcfd-0eff10b3cdd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:27.664173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-35f2cf0b-ab52-4db5-bcfd-0eff10b3cdd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:27.665640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-35f2cf0b-ab52-4db5-bcfd-0eff10b3cdd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:27.666799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-35f2cf0b-ab52-4db5-bcfd-0eff10b3cdd0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.383865 Jun 20 07:30:27.667353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 834/1783] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:27 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:27.776296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4afe2799-1e3e-4b3d-90ac-37e614182fd6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:27.776891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4afe2799-1e3e-4b3d-90ac-37e614182fd6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:27.783322 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4afe2799-1e3e-4b3d-90ac-37e614182fd6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:27.783776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4afe2799-1e3e-4b3d-90ac-37e614182fd6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:27.784572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4afe2799-1e3e-4b3d-90ac-37e614182fd6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:27.785011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4afe2799-1e3e-4b3d-90ac-37e614182fd6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:27.910144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4afe2799-1e3e-4b3d-90ac-37e614182fd6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:27.918454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4afe2799-1e3e-4b3d-90ac-37e614182fd6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146210 Jun 20 07:30:27.919018 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 950/1784] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:27 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:28.685385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-731062df-b521-4b5a-ba23-7f6bf791b23a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:28.685934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-731062df-b521-4b5a-ba23-7f6bf791b23a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:28.692503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-731062df-b521-4b5a-ba23-7f6bf791b23a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:28.692958 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-731062df-b521-4b5a-ba23-7f6bf791b23a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:28.693729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-731062df-b521-4b5a-ba23-7f6bf791b23a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:28.694175 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-731062df-b521-4b5a-ba23-7f6bf791b23a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:28.824704 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-731062df-b521-4b5a-ba23-7f6bf791b23a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:28.832996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-731062df-b521-4b5a-ba23-7f6bf791b23a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:28.835033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-731062df-b521-4b5a-ba23-7f6bf791b23a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:28.836234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-731062df-b521-4b5a-ba23-7f6bf791b23a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154789 Jun 20 07:30:28.836794 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 835/1785] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:28 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:28.935053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-67830e12-3f2f-4be7-b9f1-6d3c3da1764b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:28.935703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-67830e12-3f2f-4be7-b9f1-6d3c3da1764b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:28.942165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67830e12-3f2f-4be7-b9f1-6d3c3da1764b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:28.942606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67830e12-3f2f-4be7-b9f1-6d3c3da1764b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:28.943381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67830e12-3f2f-4be7-b9f1-6d3c3da1764b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:28.943809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67830e12-3f2f-4be7-b9f1-6d3c3da1764b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:28.946278 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:30:29.074273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-67830e12-3f2f-4be7-b9f1-6d3c3da1764b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:29.082143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-67830e12-3f2f-4be7-b9f1-6d3c3da1764b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150973 Jun 20 07:30:29.082706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 951/1786] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:28 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:29.855320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a47f527d-cc5a-4641-9843-c2cff003c615 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:29.856017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a47f527d-cc5a-4641-9843-c2cff003c615 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:29.862960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a47f527d-cc5a-4641-9843-c2cff003c615 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:29.863419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a47f527d-cc5a-4641-9843-c2cff003c615 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:29.864214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a47f527d-cc5a-4641-9843-c2cff003c615 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:29.864668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a47f527d-cc5a-4641-9843-c2cff003c615 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:29.997436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a47f527d-cc5a-4641-9843-c2cff003c615 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:30.006934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a47f527d-cc5a-4641-9843-c2cff003c615 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:30.008772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a47f527d-cc5a-4641-9843-c2cff003c615 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:30.010305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a47f527d-cc5a-4641-9843-c2cff003c615 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.159181 Jun 20 07:30:30.011019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 836/1787] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:29 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:30.098745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-828742e3-917f-4bf1-b5c7-efc75f64ebd4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:30.099907 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-828742e3-917f-4bf1-b5c7-efc75f64ebd4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:30.106483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-828742e3-917f-4bf1-b5c7-efc75f64ebd4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:30.106935 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-828742e3-917f-4bf1-b5c7-efc75f64ebd4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:30.107723 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-828742e3-917f-4bf1-b5c7-efc75f64ebd4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:30.108196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-828742e3-917f-4bf1-b5c7-efc75f64ebd4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:30.236706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-828742e3-917f-4bf1-b5c7-efc75f64ebd4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:30.245482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-828742e3-917f-4bf1-b5c7-efc75f64ebd4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150619 Jun 20 07:30:30.246041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 952/1788] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:30 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:31.028238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ce91a607-22a4-46e1-a42a-868b4bc44ce4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:31.028858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ce91a607-22a4-46e1-a42a-868b4bc44ce4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:31.035232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce91a607-22a4-46e1-a42a-868b4bc44ce4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:31.035689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce91a607-22a4-46e1-a42a-868b4bc44ce4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:31.036474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce91a607-22a4-46e1-a42a-868b4bc44ce4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:31.040619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce91a607-22a4-46e1-a42a-868b4bc44ce4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:31.163885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce91a607-22a4-46e1-a42a-868b4bc44ce4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:31.172167 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce91a607-22a4-46e1-a42a-868b4bc44ce4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:31.173670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce91a607-22a4-46e1-a42a-868b4bc44ce4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:31.175707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ce91a607-22a4-46e1-a42a-868b4bc44ce4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150584 Jun 20 07:30:31.176677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 837/1789] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:31 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:31.262693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-887e3d2e-7f55-4943-b387-1ed984656cbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:31.263311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-887e3d2e-7f55-4943-b387-1ed984656cbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:31.269733 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-887e3d2e-7f55-4943-b387-1ed984656cbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:31.270193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-887e3d2e-7f55-4943-b387-1ed984656cbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:31.270922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-887e3d2e-7f55-4943-b387-1ed984656cbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:31.271361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-887e3d2e-7f55-4943-b387-1ed984656cbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:31.405489 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-887e3d2e-7f55-4943-b387-1ed984656cbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:31.413799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-887e3d2e-7f55-4943-b387-1ed984656cbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.154976 Jun 20 07:30:31.414416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 953/1790] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:31 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:32.195247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d5c21c1d-ed81-46c7-a3a8-aa445b251f02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:32.195872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d5c21c1d-ed81-46c7-a3a8-aa445b251f02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:32.202358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5c21c1d-ed81-46c7-a3a8-aa445b251f02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:32.202809 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5c21c1d-ed81-46c7-a3a8-aa445b251f02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:32.203569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5c21c1d-ed81-46c7-a3a8-aa445b251f02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:32.204012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5c21c1d-ed81-46c7-a3a8-aa445b251f02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:32.339945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d5c21c1d-ed81-46c7-a3a8-aa445b251f02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:32.348278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d5c21c1d-ed81-46c7-a3a8-aa445b251f02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:32.349819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d5c21c1d-ed81-46c7-a3a8-aa445b251f02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:32.350964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d5c21c1d-ed81-46c7-a3a8-aa445b251f02 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.160172 Jun 20 07:30:32.351509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 838/1791] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:32 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:32.430573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-83cd687d-5435-4f9c-8e9a-b127206bc345 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:32.431179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-83cd687d-5435-4f9c-8e9a-b127206bc345 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:32.437916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83cd687d-5435-4f9c-8e9a-b127206bc345 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:32.438356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83cd687d-5435-4f9c-8e9a-b127206bc345 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:32.439098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83cd687d-5435-4f9c-8e9a-b127206bc345 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:32.439525 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83cd687d-5435-4f9c-8e9a-b127206bc345 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:32.561981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:30:32.562196 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:30:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:30:32.575176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-83cd687d-5435-4f9c-8e9a-b127206bc345 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:32.583302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-83cd687d-5435-4f9c-8e9a-b127206bc345 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.156567 Jun 20 07:30:32.583867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 954/1792] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:32 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:33.369365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8d35c03c-5457-4687-ad86-99c197dc11a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:33.370284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8d35c03c-5457-4687-ad86-99c197dc11a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:33.376714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d35c03c-5457-4687-ad86-99c197dc11a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:33.377158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d35c03c-5457-4687-ad86-99c197dc11a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:33.377920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d35c03c-5457-4687-ad86-99c197dc11a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:33.378374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d35c03c-5457-4687-ad86-99c197dc11a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:33.511454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d35c03c-5457-4687-ad86-99c197dc11a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:33.519981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d35c03c-5457-4687-ad86-99c197dc11a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:33.522165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d35c03c-5457-4687-ad86-99c197dc11a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:33.524830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8d35c03c-5457-4687-ad86-99c197dc11a8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.159392 Jun 20 07:30:33.525367 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 839/1793] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:33 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:30:33.601411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-10134cb8-cded-4b66-bd6c-63ee347f2821 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:33.601959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-10134cb8-cded-4b66-bd6c-63ee347f2821 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:33.608572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10134cb8-cded-4b66-bd6c-63ee347f2821 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:33.609024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10134cb8-cded-4b66-bd6c-63ee347f2821 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:33.609794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10134cb8-cded-4b66-bd6c-63ee347f2821 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:33.610235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10134cb8-cded-4b66-bd6c-63ee347f2821 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:33.741401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-10134cb8-cded-4b66-bd6c-63ee347f2821 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:33.749633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-10134cb8-cded-4b66-bd6c-63ee347f2821 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.152788 Jun 20 07:30:33.750206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 955/1794] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:33 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:34.543480 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11576dd0-49b0-4f6d-a83d-8dbb24a6e487 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:34.544192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-11576dd0-49b0-4f6d-a83d-8dbb24a6e487 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:34.551356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11576dd0-49b0-4f6d-a83d-8dbb24a6e487 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:34.551812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11576dd0-49b0-4f6d-a83d-8dbb24a6e487 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:34.553233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11576dd0-49b0-4f6d-a83d-8dbb24a6e487 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:34.553671 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11576dd0-49b0-4f6d-a83d-8dbb24a6e487 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:34.688646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-11576dd0-49b0-4f6d-a83d-8dbb24a6e487 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:34.697644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-11576dd0-49b0-4f6d-a83d-8dbb24a6e487 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:34.699157 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-11576dd0-49b0-4f6d-a83d-8dbb24a6e487 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:34.700393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-11576dd0-49b0-4f6d-a83d-8dbb24a6e487 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.160803 Jun 20 07:30:34.700943 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 840/1795] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:34 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:34.778258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b6609fdd-e7db-4898-bc11-5cfba1302895 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:34.778858 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b6609fdd-e7db-4898-bc11-5cfba1302895 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:34.785390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6609fdd-e7db-4898-bc11-5cfba1302895 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:34.785832 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6609fdd-e7db-4898-bc11-5cfba1302895 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:34.787200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6609fdd-e7db-4898-bc11-5cfba1302895 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:34.787620 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6609fdd-e7db-4898-bc11-5cfba1302895 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:34.924497 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b6609fdd-e7db-4898-bc11-5cfba1302895 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:34.931470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b6609fdd-e7db-4898-bc11-5cfba1302895 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.157212 Jun 20 07:30:34.932081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 956/1796] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:34 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:35.718819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dc0659f2-2637-4a1c-9cdc-b68c807c599f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:35.719674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dc0659f2-2637-4a1c-9cdc-b68c807c599f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:35.726120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc0659f2-2637-4a1c-9cdc-b68c807c599f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:35.726575 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc0659f2-2637-4a1c-9cdc-b68c807c599f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:35.727345 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc0659f2-2637-4a1c-9cdc-b68c807c599f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:35.727784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc0659f2-2637-4a1c-9cdc-b68c807c599f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:35.862850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dc0659f2-2637-4a1c-9cdc-b68c807c599f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:35.872087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dc0659f2-2637-4a1c-9cdc-b68c807c599f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:35.873782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dc0659f2-2637-4a1c-9cdc-b68c807c599f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:35.874984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dc0659f2-2637-4a1c-9cdc-b68c807c599f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.160193 Jun 20 07:30:35.875575 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 841/1797] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:35 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:35.948709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fc9df3aa-fb1c-4db5-b93c-9569041fdab8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:35.949327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fc9df3aa-fb1c-4db5-b93c-9569041fdab8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:35.956020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc9df3aa-fb1c-4db5-b93c-9569041fdab8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:35.956507 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc9df3aa-fb1c-4db5-b93c-9569041fdab8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:35.957279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc9df3aa-fb1c-4db5-b93c-9569041fdab8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:35.957713 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc9df3aa-fb1c-4db5-b93c-9569041fdab8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:36.091828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fc9df3aa-fb1c-4db5-b93c-9569041fdab8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:36.100525 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fc9df3aa-fb1c-4db5-b93c-9569041fdab8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.155587 Jun 20 07:30:36.101093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 957/1798] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:35 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:36.893693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c3cb82c2-1ded-4c83-88b5-35dedb217601 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:36.894314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c3cb82c2-1ded-4c83-88b5-35dedb217601 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:36.901817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3cb82c2-1ded-4c83-88b5-35dedb217601 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:36.902271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3cb82c2-1ded-4c83-88b5-35dedb217601 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:36.903045 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3cb82c2-1ded-4c83-88b5-35dedb217601 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:36.903489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3cb82c2-1ded-4c83-88b5-35dedb217601 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:37.047624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3cb82c2-1ded-4c83-88b5-35dedb217601 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:37.057223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3cb82c2-1ded-4c83-88b5-35dedb217601 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:37.058776 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3cb82c2-1ded-4c83-88b5-35dedb217601 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:37.059996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c3cb82c2-1ded-4c83-88b5-35dedb217601 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.170288 Jun 20 07:30:37.060758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 842/1799] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:36 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:37.118251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42ec3c25-5f8c-4537-922a-5b108045e4ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:37.118856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-42ec3c25-5f8c-4537-922a-5b108045e4ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:37.125664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42ec3c25-5f8c-4537-922a-5b108045e4ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:37.126106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42ec3c25-5f8c-4537-922a-5b108045e4ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:37.127073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42ec3c25-5f8c-4537-922a-5b108045e4ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:37.127510 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42ec3c25-5f8c-4537-922a-5b108045e4ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:37.259071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-42ec3c25-5f8c-4537-922a-5b108045e4ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:37.268379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-42ec3c25-5f8c-4537-922a-5b108045e4ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.154488 Jun 20 07:30:37.269119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 958/1800] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:37 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:38.078861 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c38852f8-b69f-4f5b-bd9f-0b4bffc68a42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:38.079481 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c38852f8-b69f-4f5b-bd9f-0b4bffc68a42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:38.086769 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c38852f8-b69f-4f5b-bd9f-0b4bffc68a42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:38.087222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c38852f8-b69f-4f5b-bd9f-0b4bffc68a42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:38.087999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c38852f8-b69f-4f5b-bd9f-0b4bffc68a42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:38.088464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c38852f8-b69f-4f5b-bd9f-0b4bffc68a42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:38.219490 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c38852f8-b69f-4f5b-bd9f-0b4bffc68a42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:38.228031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c38852f8-b69f-4f5b-bd9f-0b4bffc68a42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:38.229724 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c38852f8-b69f-4f5b-bd9f-0b4bffc68a42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:38.230892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c38852f8-b69f-4f5b-bd9f-0b4bffc68a42 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.155943 Jun 20 07:30:38.231444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 843/1801] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:38 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:38.289917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c8660b80-b198-4ecc-a864-85312009d1d6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:38.290684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c8660b80-b198-4ecc-a864-85312009d1d6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:38.298207 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8660b80-b198-4ecc-a864-85312009d1d6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:38.298701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8660b80-b198-4ecc-a864-85312009d1d6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:38.299665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8660b80-b198-4ecc-a864-85312009d1d6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:38.300193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c8660b80-b198-4ecc-a864-85312009d1d6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:38.446825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c8660b80-b198-4ecc-a864-85312009d1d6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:38.455457 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c8660b80-b198-4ecc-a864-85312009d1d6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.169423 Jun 20 07:30:38.456025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 959/1802] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:38 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:39.248725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-924c42c9-5c5d-49b4-9976-f40fd34026ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:39.249363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-924c42c9-5c5d-49b4-9976-f40fd34026ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:39.256088 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-924c42c9-5c5d-49b4-9976-f40fd34026ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:39.256696 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-924c42c9-5c5d-49b4-9976-f40fd34026ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:39.257458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-924c42c9-5c5d-49b4-9976-f40fd34026ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:39.257895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-924c42c9-5c5d-49b4-9976-f40fd34026ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:39.402436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-924c42c9-5c5d-49b4-9976-f40fd34026ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:39.422464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-924c42c9-5c5d-49b4-9976-f40fd34026ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:39.428132 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-924c42c9-5c5d-49b4-9976-f40fd34026ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:39.428132 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-924c42c9-5c5d-49b4-9976-f40fd34026ce tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.180747 Jun 20 07:30:39.430110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 844/1803] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:39 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:39.440315 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eec31615-a263-4285-918f-000329da5bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:39.440856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eec31615-a263-4285-918f-000329da5bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:39.449469 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eec31615-a263-4285-918f-000329da5bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:39.452123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eec31615-a263-4285-918f-000329da5bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:39.453166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eec31615-a263-4285-918f-000329da5bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:39.454089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eec31615-a263-4285-918f-000329da5bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:39.475358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-97cc5bdf-00f9-46c4-884c-edc4ddc2b4ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:39.476691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-97cc5bdf-00f9-46c4-884c-edc4ddc2b4ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:39.483129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eec31615-a263-4285-918f-000329da5bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:30:39.486419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97cc5bdf-00f9-46c4-884c-edc4ddc2b4ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:39.486881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97cc5bdf-00f9-46c4-884c-edc4ddc2b4ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:39.487649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97cc5bdf-00f9-46c4-884c-edc4ddc2b4ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:39.488100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97cc5bdf-00f9-46c4-884c-edc4ddc2b4ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:39.599368 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eec31615-a263-4285-918f-000329da5bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "DELETE /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 204 len: 0 microversion: 2.1 time: 0.173184 Jun 20 07:30:39.602090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 960/1804] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:30:39 2022] DELETE /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:30:39.610987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4b41743d-7422-4aa6-8b93-c5d727fc6188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:39.611802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4b41743d-7422-4aa6-8b93-c5d727fc6188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:39.618458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b41743d-7422-4aa6-8b93-c5d727fc6188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:39.618914 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b41743d-7422-4aa6-8b93-c5d727fc6188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:39.619849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b41743d-7422-4aa6-8b93-c5d727fc6188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:39.620358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b41743d-7422-4aa6-8b93-c5d727fc6188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:39.735784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-97cc5bdf-00f9-46c4-884c-edc4ddc2b4ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:39.747982 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-97cc5bdf-00f9-46c4-884c-edc4ddc2b4ad tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.278019 Jun 20 07:30:39.748647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 845/1805] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:39 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:30:39.806263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4b41743d-7422-4aa6-8b93-c5d727fc6188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:39.814220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4b41743d-7422-4aa6-8b93-c5d727fc6188 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1718 microversion: 2.1 time: 0.207974 Jun 20 07:30:39.814776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 961/1806] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:39 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1718 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:40.445206 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-45b5935d-2102-4954-90ff-11141f655ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:40.445827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-45b5935d-2102-4954-90ff-11141f655ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:40.452428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45b5935d-2102-4954-90ff-11141f655ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:40.452883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45b5935d-2102-4954-90ff-11141f655ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:40.453678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45b5935d-2102-4954-90ff-11141f655ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:40.454122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45b5935d-2102-4954-90ff-11141f655ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:40.458036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:30:40.674421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45b5935d-2102-4954-90ff-11141f655ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:40.683052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45b5935d-2102-4954-90ff-11141f655ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:40.684556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45b5935d-2102-4954-90ff-11141f655ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:40.685705 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-45b5935d-2102-4954-90ff-11141f655ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.245652 Jun 20 07:30:40.686267 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 846/1807] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:40 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:40.766120 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-caf96adb-6edd-4b20-921d-16641c1349b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:40.767491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-caf96adb-6edd-4b20-921d-16641c1349b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:40.775358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caf96adb-6edd-4b20-921d-16641c1349b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:40.775806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caf96adb-6edd-4b20-921d-16641c1349b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:40.776598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caf96adb-6edd-4b20-921d-16641c1349b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:40.777026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caf96adb-6edd-4b20-921d-16641c1349b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:40.832223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fa7cfac0-7df3-4aa9-91c5-b3ba56cdc935 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:40.832842 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fa7cfac0-7df3-4aa9-91c5-b3ba56cdc935 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:40.839653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa7cfac0-7df3-4aa9-91c5-b3ba56cdc935 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:40.840101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa7cfac0-7df3-4aa9-91c5-b3ba56cdc935 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:40.840912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa7cfac0-7df3-4aa9-91c5-b3ba56cdc935 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:40.841846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa7cfac0-7df3-4aa9-91c5-b3ba56cdc935 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:40.954383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fa7cfac0-7df3-4aa9-91c5-b3ba56cdc935 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:40.962348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fa7cfac0-7df3-4aa9-91c5-b3ba56cdc935 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1651 microversion: 2.1 time: 0.134296 Jun 20 07:30:40.963120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 847/1808] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:40 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1651 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:41.061374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-caf96adb-6edd-4b20-921d-16641c1349b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:41.070329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-caf96adb-6edd-4b20-921d-16641c1349b7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.308002 Jun 20 07:30:41.071010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 962/1809] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:40 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:41.233017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-c25f6237-d6ee-4fcf-9fdc-6a239a691516 req-8aa76694-ee92-43fa-8a90-42ff3194984c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184f7c82-c8b4-45cf-ba43-b6f17794e153", "name": "network-vif-deleted", "tag": "9f060390-c538-4ca5-a4da-a0ff281045f1"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:30:41.243048 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-c25f6237-d6ee-4fcf-9fdc-6a239a691516 req-8aa76694-ee92-43fa-8a90-42ff3194984c service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:41.243824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-c25f6237-d6ee-4fcf-9fdc-6a239a691516 req-8aa76694-ee92-43fa-8a90-42ff3194984c service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:41.265283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-c25f6237-d6ee-4fcf-9fdc-6a239a691516 req-8aa76694-ee92-43fa-8a90-42ff3194984c service nova] Creating event network-vif-deleted:9f060390-c538-4ca5-a4da-a0ff281045f1 for instance 184f7c82-c8b4-45cf-ba43-b6f17794e153 on hv-cinder-77819 Jun 20 07:30:41.289789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-c25f6237-d6ee-4fcf-9fdc-6a239a691516 req-8aa76694-ee92-43fa-8a90-42ff3194984c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061372 Jun 20 07:30:41.293253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 848/1810] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:30:41.704867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e435fff5-c267-4539-8123-a70d3b30e094 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:41.706059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e435fff5-c267-4539-8123-a70d3b30e094 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:41.712730 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e435fff5-c267-4539-8123-a70d3b30e094 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:41.713254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e435fff5-c267-4539-8123-a70d3b30e094 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:41.714085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e435fff5-c267-4539-8123-a70d3b30e094 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:41.714587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e435fff5-c267-4539-8123-a70d3b30e094 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:41.851583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e435fff5-c267-4539-8123-a70d3b30e094 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:41.859992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e435fff5-c267-4539-8123-a70d3b30e094 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:41.861514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e435fff5-c267-4539-8123-a70d3b30e094 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:41.862671 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e435fff5-c267-4539-8123-a70d3b30e094 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.161758 Jun 20 07:30:41.863230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 963/1811] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:41 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:41.979978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-168b2074-0e9a-42d1-a965-f9c98428a983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:41.980535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-168b2074-0e9a-42d1-a965-f9c98428a983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:41.987441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-168b2074-0e9a-42d1-a965-f9c98428a983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:41.987900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-168b2074-0e9a-42d1-a965-f9c98428a983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:41.988709 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-168b2074-0e9a-42d1-a965-f9c98428a983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:41.989156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-168b2074-0e9a-42d1-a965-f9c98428a983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:42.056211 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-168b2074-0e9a-42d1-a965-f9c98428a983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:42.065305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-168b2074-0e9a-42d1-a965-f9c98428a983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.090000 Jun 20 07:30:42.065959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 849/1812] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:41 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:42.087338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-db2c49e9-c2c8-449d-a778-6bdaaa3472a6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:42.088531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-db2c49e9-c2c8-449d-a778-6bdaaa3472a6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:42.094634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db2c49e9-c2c8-449d-a778-6bdaaa3472a6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:42.095085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db2c49e9-c2c8-449d-a778-6bdaaa3472a6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:42.095852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db2c49e9-c2c8-449d-a778-6bdaaa3472a6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:42.096366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db2c49e9-c2c8-449d-a778-6bdaaa3472a6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:42.240705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-db2c49e9-c2c8-449d-a778-6bdaaa3472a6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:42.248552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-db2c49e9-c2c8-449d-a778-6bdaaa3472a6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.165659 Jun 20 07:30:42.249116 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 964/1813] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:42 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:42.882227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e74ac1fe-dd70-4d11-a46e-31f43311ad08 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:42.882836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e74ac1fe-dd70-4d11-a46e-31f43311ad08 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:42.888857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e74ac1fe-dd70-4d11-a46e-31f43311ad08 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:42.889295 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e74ac1fe-dd70-4d11-a46e-31f43311ad08 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:42.890036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e74ac1fe-dd70-4d11-a46e-31f43311ad08 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:42.890466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e74ac1fe-dd70-4d11-a46e-31f43311ad08 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:43.014501 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e74ac1fe-dd70-4d11-a46e-31f43311ad08 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:43.024439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e74ac1fe-dd70-4d11-a46e-31f43311ad08 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:43.025928 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e74ac1fe-dd70-4d11-a46e-31f43311ad08 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:43.027226 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e74ac1fe-dd70-4d11-a46e-31f43311ad08 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149667 Jun 20 07:30:43.028002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 850/1814] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:43.083176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a61214b3-87c2-423a-93ff-4c8a1e195caa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:43.083904 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a61214b3-87c2-423a-93ff-4c8a1e195caa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:43.091712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a61214b3-87c2-423a-93ff-4c8a1e195caa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:43.092242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a61214b3-87c2-423a-93ff-4c8a1e195caa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:43.093156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a61214b3-87c2-423a-93ff-4c8a1e195caa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:43.093654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a61214b3-87c2-423a-93ff-4c8a1e195caa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:43.156956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a61214b3-87c2-423a-93ff-4c8a1e195caa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:43.164810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a61214b3-87c2-423a-93ff-4c8a1e195caa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086221 Jun 20 07:30:43.165381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 965/1815] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:43 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:43.265525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ca4c1af-86e2-473b-a768-2e27858180e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:43.266147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3ca4c1af-86e2-473b-a768-2e27858180e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:43.268064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=58 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:30:43.273587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ca4c1af-86e2-473b-a768-2e27858180e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:43.274039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ca4c1af-86e2-473b-a768-2e27858180e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:43.274804 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ca4c1af-86e2-473b-a768-2e27858180e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:43.275244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ca4c1af-86e2-473b-a768-2e27858180e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:43.399253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3ca4c1af-86e2-473b-a768-2e27858180e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:43.407309 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3ca4c1af-86e2-473b-a768-2e27858180e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145652 Jun 20 07:30:43.407875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 851/1816] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:43 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:44.045603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e2fa791b-9838-4fd6-8ffb-c3542f197077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:44.046219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e2fa791b-9838-4fd6-8ffb-c3542f197077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:44.052240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2fa791b-9838-4fd6-8ffb-c3542f197077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:44.052687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2fa791b-9838-4fd6-8ffb-c3542f197077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:44.053472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2fa791b-9838-4fd6-8ffb-c3542f197077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:44.053906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2fa791b-9838-4fd6-8ffb-c3542f197077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:44.056501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:30:44.181352 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e2fa791b-9838-4fd6-8ffb-c3542f197077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:44.181953 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-94af1be0-0b24-4e9a-ab10-3bae806d3e4e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:44.182364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-94af1be0-0b24-4e9a-ab10-3bae806d3e4e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:44.189217 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94af1be0-0b24-4e9a-ab10-3bae806d3e4e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:44.189948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94af1be0-0b24-4e9a-ab10-3bae806d3e4e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:44.190091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e2fa791b-9838-4fd6-8ffb-c3542f197077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:44.191168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94af1be0-0b24-4e9a-ab10-3bae806d3e4e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:44.191695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e2fa791b-9838-4fd6-8ffb-c3542f197077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:44.191919 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-94af1be0-0b24-4e9a-ab10-3bae806d3e4e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:44.193442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e2fa791b-9838-4fd6-8ffb-c3542f197077 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.151734 Jun 20 07:30:44.194053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 966/1817] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:44 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:44.258514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-94af1be0-0b24-4e9a-ab10-3bae806d3e4e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:44.266678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-94af1be0-0b24-4e9a-ab10-3bae806d3e4e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.088984 Jun 20 07:30:44.267244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 852/1818] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:44 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:30:44.424851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-29fc39f9-9b2e-4b81-9a0a-a226118c1af4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:44.425494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-29fc39f9-9b2e-4b81-9a0a-a226118c1af4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:44.431461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29fc39f9-9b2e-4b81-9a0a-a226118c1af4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:44.431910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29fc39f9-9b2e-4b81-9a0a-a226118c1af4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:44.432708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29fc39f9-9b2e-4b81-9a0a-a226118c1af4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:44.433143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29fc39f9-9b2e-4b81-9a0a-a226118c1af4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:44.558903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29fc39f9-9b2e-4b81-9a0a-a226118c1af4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:44.566788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-29fc39f9-9b2e-4b81-9a0a-a226118c1af4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145833 Jun 20 07:30:44.567956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 967/1819] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:44 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:45.216041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-79ca3e5e-211c-479c-9abd-5803630fc0e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:45.216685 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-79ca3e5e-211c-479c-9abd-5803630fc0e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:45.223117 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79ca3e5e-211c-479c-9abd-5803630fc0e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:45.224072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79ca3e5e-211c-479c-9abd-5803630fc0e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:45.224848 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79ca3e5e-211c-479c-9abd-5803630fc0e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:45.225284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-79ca3e5e-211c-479c-9abd-5803630fc0e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:45.284141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-878401ed-a1ec-4d48-90b8-9570da8c5b39 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:45.284754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-878401ed-a1ec-4d48-90b8-9570da8c5b39 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:45.287778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:30:45.293459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-878401ed-a1ec-4d48-90b8-9570da8c5b39 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:45.293898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-878401ed-a1ec-4d48-90b8-9570da8c5b39 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:45.294661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-878401ed-a1ec-4d48-90b8-9570da8c5b39 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:45.295097 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-878401ed-a1ec-4d48-90b8-9570da8c5b39 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:45.366624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-878401ed-a1ec-4d48-90b8-9570da8c5b39 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:45.373989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-878401ed-a1ec-4d48-90b8-9570da8c5b39 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.093831 Jun 20 07:30:45.374555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 968/1820] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:45 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:30:45.380016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-79ca3e5e-211c-479c-9abd-5803630fc0e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:45.388495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-79ca3e5e-211c-479c-9abd-5803630fc0e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:45.390008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-79ca3e5e-211c-479c-9abd-5803630fc0e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:45.391156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-79ca3e5e-211c-479c-9abd-5803630fc0e8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.179350 Jun 20 07:30:45.391697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 853/1821] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:45 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:45.584597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a95dbe7c-b091-4650-b697-498f2f21926e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:45.585202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a95dbe7c-b091-4650-b697-498f2f21926e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:45.591077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a95dbe7c-b091-4650-b697-498f2f21926e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:45.591518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a95dbe7c-b091-4650-b697-498f2f21926e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:45.592289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a95dbe7c-b091-4650-b697-498f2f21926e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:45.592719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a95dbe7c-b091-4650-b697-498f2f21926e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:45.719091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a95dbe7c-b091-4650-b697-498f2f21926e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:45.726954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a95dbe7c-b091-4650-b697-498f2f21926e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146646 Jun 20 07:30:45.727524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 969/1822] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:45 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:46.390756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dfe76b13-ddaa-49c1-8d3b-3e6d06db1319 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:46.391377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dfe76b13-ddaa-49c1-8d3b-3e6d06db1319 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:46.397883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfe76b13-ddaa-49c1-8d3b-3e6d06db1319 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:46.398324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfe76b13-ddaa-49c1-8d3b-3e6d06db1319 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:46.399074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfe76b13-ddaa-49c1-8d3b-3e6d06db1319 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:46.399507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfe76b13-ddaa-49c1-8d3b-3e6d06db1319 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:46.409720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2ca26ca8-78d5-41c6-aeac-40b7260d474e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:46.410329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2ca26ca8-78d5-41c6-aeac-40b7260d474e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:46.417405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ca26ca8-78d5-41c6-aeac-40b7260d474e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:46.417855 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ca26ca8-78d5-41c6-aeac-40b7260d474e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:46.418615 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ca26ca8-78d5-41c6-aeac-40b7260d474e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:46.419048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ca26ca8-78d5-41c6-aeac-40b7260d474e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:46.461430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dfe76b13-ddaa-49c1-8d3b-3e6d06db1319 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:46.469384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dfe76b13-ddaa-49c1-8d3b-3e6d06db1319 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082496 Jun 20 07:30:46.469955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 854/1823] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:46 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:46.556318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2ca26ca8-78d5-41c6-aeac-40b7260d474e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:46.564771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2ca26ca8-78d5-41c6-aeac-40b7260d474e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:46.566270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2ca26ca8-78d5-41c6-aeac-40b7260d474e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:46.567465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2ca26ca8-78d5-41c6-aeac-40b7260d474e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.161601 Jun 20 07:30:46.568030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 970/1824] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:46 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:30:46.744536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db9739f9-0b68-4ff3-bd01-8ea7ac55dcac tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:46.745149 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-db9739f9-0b68-4ff3-bd01-8ea7ac55dcac tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:46.751057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db9739f9-0b68-4ff3-bd01-8ea7ac55dcac tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:46.751495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db9739f9-0b68-4ff3-bd01-8ea7ac55dcac tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:46.752277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db9739f9-0b68-4ff3-bd01-8ea7ac55dcac tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:46.752708 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db9739f9-0b68-4ff3-bd01-8ea7ac55dcac tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:46.878599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db9739f9-0b68-4ff3-bd01-8ea7ac55dcac tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:46.886824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db9739f9-0b68-4ff3-bd01-8ea7ac55dcac tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146177 Jun 20 07:30:46.887382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 855/1825] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:46 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:47.486762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4fffd188-e1d5-4399-8e60-cbd55fa88164 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:47.487381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4fffd188-e1d5-4399-8e60-cbd55fa88164 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:47.493869 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4fffd188-e1d5-4399-8e60-cbd55fa88164 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:47.494319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4fffd188-e1d5-4399-8e60-cbd55fa88164 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:47.495085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4fffd188-e1d5-4399-8e60-cbd55fa88164 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:47.495523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4fffd188-e1d5-4399-8e60-cbd55fa88164 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:47.555786 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4fffd188-e1d5-4399-8e60-cbd55fa88164 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:47.563639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4fffd188-e1d5-4399-8e60-cbd55fa88164 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080746 Jun 20 07:30:47.564232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 971/1826] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:47 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:47.586494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3affea66-5b53-45bf-8960-592513eb0eb3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:47.587118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3affea66-5b53-45bf-8960-592513eb0eb3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:47.593775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3affea66-5b53-45bf-8960-592513eb0eb3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:47.594228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3affea66-5b53-45bf-8960-592513eb0eb3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:47.594994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3affea66-5b53-45bf-8960-592513eb0eb3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:47.595437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3affea66-5b53-45bf-8960-592513eb0eb3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:47.723579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3affea66-5b53-45bf-8960-592513eb0eb3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:47.732011 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3affea66-5b53-45bf-8960-592513eb0eb3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:47.733544 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3affea66-5b53-45bf-8960-592513eb0eb3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:47.734705 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3affea66-5b53-45bf-8960-592513eb0eb3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152150 Jun 20 07:30:47.735268 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 856/1827] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:47 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:47.904392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7b0658ed-0fe7-40b2-ae55-2d7f2a2072a5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:47.905009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7b0658ed-0fe7-40b2-ae55-2d7f2a2072a5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:47.910969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b0658ed-0fe7-40b2-ae55-2d7f2a2072a5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:47.911422 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b0658ed-0fe7-40b2-ae55-2d7f2a2072a5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:47.912744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b0658ed-0fe7-40b2-ae55-2d7f2a2072a5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:47.913185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b0658ed-0fe7-40b2-ae55-2d7f2a2072a5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:48.036507 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b0658ed-0fe7-40b2-ae55-2d7f2a2072a5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:48.044898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7b0658ed-0fe7-40b2-ae55-2d7f2a2072a5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.144448 Jun 20 07:30:48.045465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 972/1828] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:47 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:48.580457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3c6d4fb1-6d22-421e-b0d8-1ec0d090f8dd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:48.581097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3c6d4fb1-6d22-421e-b0d8-1ec0d090f8dd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:48.587081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c6d4fb1-6d22-421e-b0d8-1ec0d090f8dd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:48.587631 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c6d4fb1-6d22-421e-b0d8-1ec0d090f8dd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:48.588288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c6d4fb1-6d22-421e-b0d8-1ec0d090f8dd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:48.588721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c6d4fb1-6d22-421e-b0d8-1ec0d090f8dd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:48.649242 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c6d4fb1-6d22-421e-b0d8-1ec0d090f8dd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:48.657081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3c6d4fb1-6d22-421e-b0d8-1ec0d090f8dd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080454 Jun 20 07:30:48.657636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 857/1829] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:48 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:48.753739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a3a84eda-5677-4589-b1ec-f53fa881ce2e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:48.754358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a3a84eda-5677-4589-b1ec-f53fa881ce2e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:48.761104 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3a84eda-5677-4589-b1ec-f53fa881ce2e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:48.761552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3a84eda-5677-4589-b1ec-f53fa881ce2e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:48.762315 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3a84eda-5677-4589-b1ec-f53fa881ce2e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:48.762749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3a84eda-5677-4589-b1ec-f53fa881ce2e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:48.891753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a3a84eda-5677-4589-b1ec-f53fa881ce2e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:48.900082 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a3a84eda-5677-4589-b1ec-f53fa881ce2e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:48.901559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a3a84eda-5677-4589-b1ec-f53fa881ce2e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:48.902721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a3a84eda-5677-4589-b1ec-f53fa881ce2e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.152961 Jun 20 07:30:48.903276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 973/1830] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:48 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:49.062400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f319d40f-9779-4d66-903f-eaeac291ca88 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:49.063029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f319d40f-9779-4d66-903f-eaeac291ca88 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:49.069121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f319d40f-9779-4d66-903f-eaeac291ca88 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:49.069576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f319d40f-9779-4d66-903f-eaeac291ca88 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:49.070338 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f319d40f-9779-4d66-903f-eaeac291ca88 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:49.070776 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f319d40f-9779-4d66-903f-eaeac291ca88 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:49.198320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f319d40f-9779-4d66-903f-eaeac291ca88 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:49.206148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f319d40f-9779-4d66-903f-eaeac291ca88 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147623 Jun 20 07:30:49.206711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 858/1831] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:49 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:49.674031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0815b371-910b-4e57-a717-40beea2ea763 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:49.674649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0815b371-910b-4e57-a717-40beea2ea763 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:49.680707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0815b371-910b-4e57-a717-40beea2ea763 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:49.681162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0815b371-910b-4e57-a717-40beea2ea763 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:49.681924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0815b371-910b-4e57-a717-40beea2ea763 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:49.682361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0815b371-910b-4e57-a717-40beea2ea763 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:49.745128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0815b371-910b-4e57-a717-40beea2ea763 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:49.752972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0815b371-910b-4e57-a717-40beea2ea763 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082754 Jun 20 07:30:49.753541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 974/1832] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:49 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:49.921589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a60f51e8-bdcb-4c9c-a238-7adb859f6e03 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:49.922205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a60f51e8-bdcb-4c9c-a238-7adb859f6e03 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:49.929017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a60f51e8-bdcb-4c9c-a238-7adb859f6e03 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:49.929411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a60f51e8-bdcb-4c9c-a238-7adb859f6e03 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:49.930182 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a60f51e8-bdcb-4c9c-a238-7adb859f6e03 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:49.930600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a60f51e8-bdcb-4c9c-a238-7adb859f6e03 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:50.060446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a60f51e8-bdcb-4c9c-a238-7adb859f6e03 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:50.069446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a60f51e8-bdcb-4c9c-a238-7adb859f6e03 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:50.070928 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a60f51e8-bdcb-4c9c-a238-7adb859f6e03 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:50.072076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a60f51e8-bdcb-4c9c-a238-7adb859f6e03 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154522 Jun 20 07:30:50.072655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 859/1833] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:49 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:50.222968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fb954bb2-d7f7-4598-8b47-e9c5927cf593 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:50.223560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fb954bb2-d7f7-4598-8b47-e9c5927cf593 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:50.230447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb954bb2-d7f7-4598-8b47-e9c5927cf593 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:50.230903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb954bb2-d7f7-4598-8b47-e9c5927cf593 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:50.231667 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb954bb2-d7f7-4598-8b47-e9c5927cf593 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:50.232119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb954bb2-d7f7-4598-8b47-e9c5927cf593 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:50.359590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fb954bb2-d7f7-4598-8b47-e9c5927cf593 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:50.368960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fb954bb2-d7f7-4598-8b47-e9c5927cf593 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149897 Jun 20 07:30:50.369536 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 975/1834] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:50 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:50.770387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b42351b-7e94-47f8-8305-7bbdb49300cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:50.771042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b42351b-7e94-47f8-8305-7bbdb49300cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:50.777099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b42351b-7e94-47f8-8305-7bbdb49300cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:50.777547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b42351b-7e94-47f8-8305-7bbdb49300cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:50.778310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b42351b-7e94-47f8-8305-7bbdb49300cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:50.778751 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b42351b-7e94-47f8-8305-7bbdb49300cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:50.841531 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b42351b-7e94-47f8-8305-7bbdb49300cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:50.849589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b42351b-7e94-47f8-8305-7bbdb49300cf tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083103 Jun 20 07:30:50.850154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 860/1835] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:50 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:51.090356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c065c22f-5c47-47c4-ac2d-5de6a50a6e33 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:51.090965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c065c22f-5c47-47c4-ac2d-5de6a50a6e33 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:51.096972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c065c22f-5c47-47c4-ac2d-5de6a50a6e33 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:51.097425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c065c22f-5c47-47c4-ac2d-5de6a50a6e33 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:51.098183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c065c22f-5c47-47c4-ac2d-5de6a50a6e33 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:51.098621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c065c22f-5c47-47c4-ac2d-5de6a50a6e33 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:51.223797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c065c22f-5c47-47c4-ac2d-5de6a50a6e33 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:51.233167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c065c22f-5c47-47c4-ac2d-5de6a50a6e33 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:51.234661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c065c22f-5c47-47c4-ac2d-5de6a50a6e33 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:51.235823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c065c22f-5c47-47c4-ac2d-5de6a50a6e33 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149397 Jun 20 07:30:51.236430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 976/1836] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:51 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:51.386480 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c47a70b3-7db7-4f3a-a75a-0119a00ff9cf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:51.387029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c47a70b3-7db7-4f3a-a75a-0119a00ff9cf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:51.393542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c47a70b3-7db7-4f3a-a75a-0119a00ff9cf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:51.393984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c47a70b3-7db7-4f3a-a75a-0119a00ff9cf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:51.394731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c47a70b3-7db7-4f3a-a75a-0119a00ff9cf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:51.395160 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c47a70b3-7db7-4f3a-a75a-0119a00ff9cf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:51.527814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c47a70b3-7db7-4f3a-a75a-0119a00ff9cf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:51.535657 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c47a70b3-7db7-4f3a-a75a-0119a00ff9cf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.153108 Jun 20 07:30:51.536247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 861/1837] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:51 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:51.866900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-df8db0ff-8a43-4e5c-9cb3-102359365711 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:51.867536 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-df8db0ff-8a43-4e5c-9cb3-102359365711 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:51.873613 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df8db0ff-8a43-4e5c-9cb3-102359365711 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:51.874058 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df8db0ff-8a43-4e5c-9cb3-102359365711 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:51.874809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df8db0ff-8a43-4e5c-9cb3-102359365711 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:51.875236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df8db0ff-8a43-4e5c-9cb3-102359365711 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:51.937880 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-df8db0ff-8a43-4e5c-9cb3-102359365711 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:51.945705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-df8db0ff-8a43-4e5c-9cb3-102359365711 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083365 Jun 20 07:30:51.946260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 977/1838] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:51 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:52.254940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b7d89f38-9619-4277-9d69-32bfa4ca9276 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:52.255819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b7d89f38-9619-4277-9d69-32bfa4ca9276 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:52.261850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7d89f38-9619-4277-9d69-32bfa4ca9276 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:52.262300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7d89f38-9619-4277-9d69-32bfa4ca9276 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:52.263059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7d89f38-9619-4277-9d69-32bfa4ca9276 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:52.263497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b7d89f38-9619-4277-9d69-32bfa4ca9276 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:52.393342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b7d89f38-9619-4277-9d69-32bfa4ca9276 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:52.402376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b7d89f38-9619-4277-9d69-32bfa4ca9276 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:52.403866 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b7d89f38-9619-4277-9d69-32bfa4ca9276 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:52.405038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b7d89f38-9619-4277-9d69-32bfa4ca9276 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.154007 Jun 20 07:30:52.405657 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 862/1839] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:52 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:52.553267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e080567c-3ac8-4b2a-97f1-13b1b1d5f1bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:52.553873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e080567c-3ac8-4b2a-97f1-13b1b1d5f1bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:52.560330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e080567c-3ac8-4b2a-97f1-13b1b1d5f1bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:52.560773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e080567c-3ac8-4b2a-97f1-13b1b1d5f1bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:52.561525 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e080567c-3ac8-4b2a-97f1-13b1b1d5f1bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:52.561954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e080567c-3ac8-4b2a-97f1-13b1b1d5f1bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:52.704287 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e080567c-3ac8-4b2a-97f1-13b1b1d5f1bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:52.712825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e080567c-3ac8-4b2a-97f1-13b1b1d5f1bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.163924 Jun 20 07:30:52.713405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 978/1840] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:52 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:52.963476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6d6e46fb-9606-4b4b-b058-e9aecddc14d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:52.964052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6d6e46fb-9606-4b4b-b058-e9aecddc14d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:52.970144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d6e46fb-9606-4b4b-b058-e9aecddc14d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:52.970588 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d6e46fb-9606-4b4b-b058-e9aecddc14d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:52.971355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d6e46fb-9606-4b4b-b058-e9aecddc14d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:52.971788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d6e46fb-9606-4b4b-b058-e9aecddc14d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:52.987815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:30:53.042945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6d6e46fb-9606-4b4b-b058-e9aecddc14d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:53.050999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6d6e46fb-9606-4b4b-b058-e9aecddc14d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.091485 Jun 20 07:30:53.051565 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 863/1841] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:52 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:53.423373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ad60f0e6-b879-45db-baad-651cfbb72967 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:53.424013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ad60f0e6-b879-45db-baad-651cfbb72967 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:53.430688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad60f0e6-b879-45db-baad-651cfbb72967 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:53.431133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad60f0e6-b879-45db-baad-651cfbb72967 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:53.431889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad60f0e6-b879-45db-baad-651cfbb72967 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:53.432348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad60f0e6-b879-45db-baad-651cfbb72967 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:53.561635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad60f0e6-b879-45db-baad-651cfbb72967 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:53.570492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad60f0e6-b879-45db-baad-651cfbb72967 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:53.571973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad60f0e6-b879-45db-baad-651cfbb72967 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:53.573167 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ad60f0e6-b879-45db-baad-651cfbb72967 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.153703 Jun 20 07:30:53.573729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 979/1842] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:53 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:53.732871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5dbd3e41-105e-46dc-bf21-bbcd27d4d6e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:53.733495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5dbd3e41-105e-46dc-bf21-bbcd27d4d6e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:53.740509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5dbd3e41-105e-46dc-bf21-bbcd27d4d6e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:53.740960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5dbd3e41-105e-46dc-bf21-bbcd27d4d6e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:53.741722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5dbd3e41-105e-46dc-bf21-bbcd27d4d6e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:53.742158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5dbd3e41-105e-46dc-bf21-bbcd27d4d6e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:53.870534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5dbd3e41-105e-46dc-bf21-bbcd27d4d6e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:53.878413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5dbd3e41-105e-46dc-bf21-bbcd27d4d6e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149426 Jun 20 07:30:53.878988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 864/1843] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:53 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:54.068061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-11979dfe-7c42-4a35-be3e-1995da55bfe1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:54.068701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-11979dfe-7c42-4a35-be3e-1995da55bfe1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:54.074747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-11979dfe-7c42-4a35-be3e-1995da55bfe1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:54.075190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-11979dfe-7c42-4a35-be3e-1995da55bfe1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:54.075934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-11979dfe-7c42-4a35-be3e-1995da55bfe1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:54.076400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-11979dfe-7c42-4a35-be3e-1995da55bfe1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:54.136511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-11979dfe-7c42-4a35-be3e-1995da55bfe1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:54.144233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-11979dfe-7c42-4a35-be3e-1995da55bfe1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079958 Jun 20 07:30:54.144790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 980/1844] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:54 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:54.590715 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1a08c518-cd8c-4920-87ef-a8b599090127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:54.591360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1a08c518-cd8c-4920-87ef-a8b599090127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:54.597482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a08c518-cd8c-4920-87ef-a8b599090127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:54.597932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a08c518-cd8c-4920-87ef-a8b599090127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:54.598691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a08c518-cd8c-4920-87ef-a8b599090127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:54.599151 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a08c518-cd8c-4920-87ef-a8b599090127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:54.724454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a08c518-cd8c-4920-87ef-a8b599090127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:54.732779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a08c518-cd8c-4920-87ef-a8b599090127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:54.734283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a08c518-cd8c-4920-87ef-a8b599090127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:54.735443 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1a08c518-cd8c-4920-87ef-a8b599090127 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.148624 Jun 20 07:30:54.736005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 865/1845] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:54 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:54.895136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-00b3fb4a-b561-46bf-a9f2-6382610416ca tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:54.895758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-00b3fb4a-b561-46bf-a9f2-6382610416ca tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:54.902263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00b3fb4a-b561-46bf-a9f2-6382610416ca tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:54.902712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00b3fb4a-b561-46bf-a9f2-6382610416ca tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:54.903471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00b3fb4a-b561-46bf-a9f2-6382610416ca tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:54.903910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00b3fb4a-b561-46bf-a9f2-6382610416ca tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:55.032243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-00b3fb4a-b561-46bf-a9f2-6382610416ca tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:55.040742 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-00b3fb4a-b561-46bf-a9f2-6382610416ca tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149451 Jun 20 07:30:55.041308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 981/1846] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:54 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:55.160151 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c4e417ef-7d64-4b73-85f2-49521f5006a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:55.160774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c4e417ef-7d64-4b73-85f2-49521f5006a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:55.167437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4e417ef-7d64-4b73-85f2-49521f5006a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:55.167892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4e417ef-7d64-4b73-85f2-49521f5006a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:55.168697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4e417ef-7d64-4b73-85f2-49521f5006a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:55.169140 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4e417ef-7d64-4b73-85f2-49521f5006a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:55.228978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c4e417ef-7d64-4b73-85f2-49521f5006a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:55.238079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c4e417ef-7d64-4b73-85f2-49521f5006a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081875 Jun 20 07:30:55.238650 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 866/1847] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:55 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:55.754479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-10e77153-9c11-44f6-87b3-6d67ebd784a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:55.755415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-10e77153-9c11-44f6-87b3-6d67ebd784a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:55.761578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10e77153-9c11-44f6-87b3-6d67ebd784a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:55.762017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10e77153-9c11-44f6-87b3-6d67ebd784a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:55.762770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10e77153-9c11-44f6-87b3-6d67ebd784a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:55.763199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10e77153-9c11-44f6-87b3-6d67ebd784a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:55.888862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-10e77153-9c11-44f6-87b3-6d67ebd784a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:55.891022 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:30:55.898715 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-10e77153-9c11-44f6-87b3-6d67ebd784a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:55.900225 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-10e77153-9c11-44f6-87b3-6d67ebd784a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:55.901369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-10e77153-9c11-44f6-87b3-6d67ebd784a4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150818 Jun 20 07:30:55.901923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 982/1848] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:55 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:56.057466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9abf111d-5492-4755-badc-141b9df5e91f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:56.058084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9abf111d-5492-4755-badc-141b9df5e91f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:56.064060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9abf111d-5492-4755-badc-141b9df5e91f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:56.064583 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9abf111d-5492-4755-badc-141b9df5e91f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:56.065341 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9abf111d-5492-4755-badc-141b9df5e91f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:56.065780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9abf111d-5492-4755-badc-141b9df5e91f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:56.195849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9abf111d-5492-4755-badc-141b9df5e91f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:56.203752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9abf111d-5492-4755-badc-141b9df5e91f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150156 Jun 20 07:30:56.204345 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 867/1849] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:56 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:56.254903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d22df813-a258-404d-946f-ff4276852261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:56.256294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d22df813-a258-404d-946f-ff4276852261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:56.262869 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d22df813-a258-404d-946f-ff4276852261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:56.263312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d22df813-a258-404d-946f-ff4276852261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:56.264071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d22df813-a258-404d-946f-ff4276852261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:56.264527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d22df813-a258-404d-946f-ff4276852261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:56.324449 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d22df813-a258-404d-946f-ff4276852261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:56.332264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d22df813-a258-404d-946f-ff4276852261 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081114 Jun 20 07:30:56.332816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 983/1850] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:56 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:56.920517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-927c6bde-acde-452c-bc6d-c55bf96ef3fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:56.921137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-927c6bde-acde-452c-bc6d-c55bf96ef3fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:56.927759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-927c6bde-acde-452c-bc6d-c55bf96ef3fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:56.928248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-927c6bde-acde-452c-bc6d-c55bf96ef3fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:56.929008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-927c6bde-acde-452c-bc6d-c55bf96ef3fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:56.929445 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-927c6bde-acde-452c-bc6d-c55bf96ef3fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:57.065459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-927c6bde-acde-452c-bc6d-c55bf96ef3fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:57.073784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-927c6bde-acde-452c-bc6d-c55bf96ef3fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:57.075277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-927c6bde-acde-452c-bc6d-c55bf96ef3fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:57.076475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-927c6bde-acde-452c-bc6d-c55bf96ef3fc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.159852 Jun 20 07:30:57.077033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 868/1851] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:56 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:57.221494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dd192aee-aa8a-4a75-a9c6-d5d9be02cf2d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:57.222099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dd192aee-aa8a-4a75-a9c6-d5d9be02cf2d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:57.228619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd192aee-aa8a-4a75-a9c6-d5d9be02cf2d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:57.229064 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd192aee-aa8a-4a75-a9c6-d5d9be02cf2d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:57.229824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd192aee-aa8a-4a75-a9c6-d5d9be02cf2d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:57.230442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd192aee-aa8a-4a75-a9c6-d5d9be02cf2d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:57.351150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e3219681-02a3-42d6-99f6-5a33c74ec904 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:57.351888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e3219681-02a3-42d6-99f6-5a33c74ec904 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:57.359216 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3219681-02a3-42d6-99f6-5a33c74ec904 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:57.359675 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3219681-02a3-42d6-99f6-5a33c74ec904 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:57.360490 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3219681-02a3-42d6-99f6-5a33c74ec904 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:57.360929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3219681-02a3-42d6-99f6-5a33c74ec904 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:57.366836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dd192aee-aa8a-4a75-a9c6-d5d9be02cf2d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:57.374698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dd192aee-aa8a-4a75-a9c6-d5d9be02cf2d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.157063 Jun 20 07:30:57.375264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 984/1852] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:57 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:57.422405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e3219681-02a3-42d6-99f6-5a33c74ec904 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:57.430248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e3219681-02a3-42d6-99f6-5a33c74ec904 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084517 Jun 20 07:30:57.430804 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 869/1853] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:57 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:30:58.094792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-490ad872-c6fa-43af-b55e-d31609d5f7eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:58.095406 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-490ad872-c6fa-43af-b55e-d31609d5f7eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:58.101740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-490ad872-c6fa-43af-b55e-d31609d5f7eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:58.102219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-490ad872-c6fa-43af-b55e-d31609d5f7eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:58.102980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-490ad872-c6fa-43af-b55e-d31609d5f7eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:58.103419 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-490ad872-c6fa-43af-b55e-d31609d5f7eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:58.227035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-490ad872-c6fa-43af-b55e-d31609d5f7eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:58.235384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-490ad872-c6fa-43af-b55e-d31609d5f7eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:58.236929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-490ad872-c6fa-43af-b55e-d31609d5f7eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:58.238096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-490ad872-c6fa-43af-b55e-d31609d5f7eb tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.147214 Jun 20 07:30:58.238653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 985/1854] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:58 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:58.391269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-09bba34e-23d8-42b9-bff7-c1a1ac8151b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:58.391916 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-09bba34e-23d8-42b9-bff7-c1a1ac8151b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:58.398621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09bba34e-23d8-42b9-bff7-c1a1ac8151b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:58.399057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09bba34e-23d8-42b9-bff7-c1a1ac8151b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:58.399812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09bba34e-23d8-42b9-bff7-c1a1ac8151b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:58.400346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09bba34e-23d8-42b9-bff7-c1a1ac8151b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:58.446630 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b2f86320-a0bc-4615-a38a-0f3096a16b32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:58.447244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b2f86320-a0bc-4615-a38a-0f3096a16b32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:58.453673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2f86320-a0bc-4615-a38a-0f3096a16b32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:58.454124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2f86320-a0bc-4615-a38a-0f3096a16b32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:58.454891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2f86320-a0bc-4615-a38a-0f3096a16b32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:58.455332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b2f86320-a0bc-4615-a38a-0f3096a16b32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:58.531123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b2f86320-a0bc-4615-a38a-0f3096a16b32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:58.541154 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b2f86320-a0bc-4615-a38a-0f3096a16b32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.098044 Jun 20 07:30:58.542073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 986/1855] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:58 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:30:58.554864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-09bba34e-23d8-42b9-bff7-c1a1ac8151b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:58.562938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-09bba34e-23d8-42b9-bff7-c1a1ac8151b1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.175570 Jun 20 07:30:58.563508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 870/1856] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:58 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:30:59.257096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8c1489eb-9571-43aa-8583-4631294d395f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:59.257711 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8c1489eb-9571-43aa-8583-4631294d395f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:59.263802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c1489eb-9571-43aa-8583-4631294d395f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:59.264349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c1489eb-9571-43aa-8583-4631294d395f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:59.265113 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c1489eb-9571-43aa-8583-4631294d395f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:59.265549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c1489eb-9571-43aa-8583-4631294d395f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:59.389901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8c1489eb-9571-43aa-8583-4631294d395f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:59.398248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8c1489eb-9571-43aa-8583-4631294d395f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:59.399743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8c1489eb-9571-43aa-8583-4631294d395f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:59.400927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8c1489eb-9571-43aa-8583-4631294d395f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.148000 Jun 20 07:30:59.401487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 987/1857] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:30:59 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:30:59.558153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ae2ad9c-c4b2-441e-8792-d6e04d0cce60 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:59.558769 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1ae2ad9c-c4b2-441e-8792-d6e04d0cce60 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:59.565410 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ae2ad9c-c4b2-441e-8792-d6e04d0cce60 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:59.565860 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ae2ad9c-c4b2-441e-8792-d6e04d0cce60 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:59.566619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ae2ad9c-c4b2-441e-8792-d6e04d0cce60 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:59.567070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ae2ad9c-c4b2-441e-8792-d6e04d0cce60 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:59.579552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0a76bee5-840e-4e9c-963d-60a4d4e93dbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:30:59.580200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0a76bee5-840e-4e9c-963d-60a4d4e93dbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:30:59.587094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a76bee5-840e-4e9c-963d-60a4d4e93dbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:59.587547 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a76bee5-840e-4e9c-963d-60a4d4e93dbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:59.588340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a76bee5-840e-4e9c-963d-60a4d4e93dbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:30:59.588779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0a76bee5-840e-4e9c-963d-60a4d4e93dbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:30:59.631964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1ae2ad9c-c4b2-441e-8792-d6e04d0cce60 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:59.640201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1ae2ad9c-c4b2-441e-8792-d6e04d0cce60 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085801 Jun 20 07:30:59.640968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 871/1858] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:59 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:30:59.723131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0a76bee5-840e-4e9c-963d-60a4d4e93dbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:30:59.731829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0a76bee5-840e-4e9c-963d-60a4d4e93dbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.156100 Jun 20 07:30:59.732440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 988/1859] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:30:59 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:00.420013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-39cc5997-1dfa-40dd-8386-5bb5e7982443 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:00.420655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-39cc5997-1dfa-40dd-8386-5bb5e7982443 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:00.426666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39cc5997-1dfa-40dd-8386-5bb5e7982443 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:00.427612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39cc5997-1dfa-40dd-8386-5bb5e7982443 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:00.428390 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39cc5997-1dfa-40dd-8386-5bb5e7982443 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:00.428821 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39cc5997-1dfa-40dd-8386-5bb5e7982443 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:00.554476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-39cc5997-1dfa-40dd-8386-5bb5e7982443 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:00.562747 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-39cc5997-1dfa-40dd-8386-5bb5e7982443 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:00.564253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-39cc5997-1dfa-40dd-8386-5bb5e7982443 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:00.565413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-39cc5997-1dfa-40dd-8386-5bb5e7982443 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.149325 Jun 20 07:31:00.566062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 872/1860] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:00 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:00.656425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9a30d36e-8cfb-494a-b174-650ad1f0b9f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:00.656974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9a30d36e-8cfb-494a-b174-650ad1f0b9f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:00.663988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a30d36e-8cfb-494a-b174-650ad1f0b9f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:00.664469 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a30d36e-8cfb-494a-b174-650ad1f0b9f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:00.665232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a30d36e-8cfb-494a-b174-650ad1f0b9f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:00.665670 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a30d36e-8cfb-494a-b174-650ad1f0b9f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:00.731276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9a30d36e-8cfb-494a-b174-650ad1f0b9f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:00.739416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9a30d36e-8cfb-494a-b174-650ad1f0b9f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086947 Jun 20 07:31:00.740003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 989/1861] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:00 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:00.748257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73147ed5-110d-483b-bd8e-92feab04c4e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:00.748903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73147ed5-110d-483b-bd8e-92feab04c4e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:00.755619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73147ed5-110d-483b-bd8e-92feab04c4e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:00.756066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73147ed5-110d-483b-bd8e-92feab04c4e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:00.756842 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73147ed5-110d-483b-bd8e-92feab04c4e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:00.757275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73147ed5-110d-483b-bd8e-92feab04c4e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:00.883067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73147ed5-110d-483b-bd8e-92feab04c4e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:00.890973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73147ed5-110d-483b-bd8e-92feab04c4e3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146544 Jun 20 07:31:00.891534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 873/1862] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:00 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:01.585115 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6cd71cba-5aed-48ee-8ae9-65214d73e1c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:01.585717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6cd71cba-5aed-48ee-8ae9-65214d73e1c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:01.591640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6cd71cba-5aed-48ee-8ae9-65214d73e1c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:01.592082 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6cd71cba-5aed-48ee-8ae9-65214d73e1c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:01.592854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6cd71cba-5aed-48ee-8ae9-65214d73e1c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:01.593279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6cd71cba-5aed-48ee-8ae9-65214d73e1c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:01.727876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6cd71cba-5aed-48ee-8ae9-65214d73e1c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:01.736382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6cd71cba-5aed-48ee-8ae9-65214d73e1c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:01.737864 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6cd71cba-5aed-48ee-8ae9-65214d73e1c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:01.739007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6cd71cba-5aed-48ee-8ae9-65214d73e1c1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.158412 Jun 20 07:31:01.739556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 990/1863] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:01 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:01.757426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db5cdedc-5fa3-456f-a139-927b299f068f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:01.758039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-db5cdedc-5fa3-456f-a139-927b299f068f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:01.764415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db5cdedc-5fa3-456f-a139-927b299f068f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:01.764856 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db5cdedc-5fa3-456f-a139-927b299f068f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:01.765605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db5cdedc-5fa3-456f-a139-927b299f068f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:01.766038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db5cdedc-5fa3-456f-a139-927b299f068f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:01.831507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db5cdedc-5fa3-456f-a139-927b299f068f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:01.839392 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db5cdedc-5fa3-456f-a139-927b299f068f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086572 Jun 20 07:31:01.839896 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 874/1864] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:01 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:01.907913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a241d7b2-6611-4252-9453-22086a9697be tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:01.908573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a241d7b2-6611-4252-9453-22086a9697be tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:01.914687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a241d7b2-6611-4252-9453-22086a9697be tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:01.915139 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a241d7b2-6611-4252-9453-22086a9697be tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:01.915899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a241d7b2-6611-4252-9453-22086a9697be tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:01.916366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a241d7b2-6611-4252-9453-22086a9697be tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:02.044215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a241d7b2-6611-4252-9453-22086a9697be tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:02.051998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a241d7b2-6611-4252-9453-22086a9697be tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147889 Jun 20 07:31:02.052599 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 991/1865] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:01 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:02.757844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1827d06e-c7f7-423f-bbfa-fadf3fa4e450 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:02.758464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1827d06e-c7f7-423f-bbfa-fadf3fa4e450 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:02.764988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1827d06e-c7f7-423f-bbfa-fadf3fa4e450 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:02.765436 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1827d06e-c7f7-423f-bbfa-fadf3fa4e450 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:02.766195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1827d06e-c7f7-423f-bbfa-fadf3fa4e450 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:02.766629 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1827d06e-c7f7-423f-bbfa-fadf3fa4e450 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:02.858665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7fc42684-58fc-4e6b-ac0f-5b4fb98687a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:02.859368 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7fc42684-58fc-4e6b-ac0f-5b4fb98687a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:02.866049 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fc42684-58fc-4e6b-ac0f-5b4fb98687a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:02.866572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fc42684-58fc-4e6b-ac0f-5b4fb98687a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:02.867408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fc42684-58fc-4e6b-ac0f-5b4fb98687a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:02.867917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fc42684-58fc-4e6b-ac0f-5b4fb98687a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:02.892033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1827d06e-c7f7-423f-bbfa-fadf3fa4e450 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:02.901339 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1827d06e-c7f7-423f-bbfa-fadf3fa4e450 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:02.902826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1827d06e-c7f7-423f-bbfa-fadf3fa4e450 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:02.903979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1827d06e-c7f7-423f-bbfa-fadf3fa4e450 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.150256 Jun 20 07:31:02.904560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 875/1866] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:02 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:02.931945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7fc42684-58fc-4e6b-ac0f-5b4fb98687a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:02.941428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7fc42684-58fc-4e6b-ac0f-5b4fb98687a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086618 Jun 20 07:31:02.942002 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 992/1867] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:02 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:03.069258 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4cc0119a-c0e6-4dbc-a365-e10fb8e3ad3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:03.069907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4cc0119a-c0e6-4dbc-a365-e10fb8e3ad3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:03.076900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cc0119a-c0e6-4dbc-a365-e10fb8e3ad3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:03.077357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cc0119a-c0e6-4dbc-a365-e10fb8e3ad3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:03.078123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cc0119a-c0e6-4dbc-a365-e10fb8e3ad3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:03.078567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cc0119a-c0e6-4dbc-a365-e10fb8e3ad3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:03.206168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4cc0119a-c0e6-4dbc-a365-e10fb8e3ad3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:03.214563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4cc0119a-c0e6-4dbc-a365-e10fb8e3ad3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149685 Jun 20 07:31:03.215135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 876/1868] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:03 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:03.921757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f7c1aacf-75ee-4b9a-895d-ac8eda0449af tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:03.922364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f7c1aacf-75ee-4b9a-895d-ac8eda0449af tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:03.929502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7c1aacf-75ee-4b9a-895d-ac8eda0449af tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:03.929940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7c1aacf-75ee-4b9a-895d-ac8eda0449af tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:03.930722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7c1aacf-75ee-4b9a-895d-ac8eda0449af tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:03.931155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f7c1aacf-75ee-4b9a-895d-ac8eda0449af tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:03.958625 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ebb80312-7346-4950-893e-1602bf06feed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:03.959169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ebb80312-7346-4950-893e-1602bf06feed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:03.965987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebb80312-7346-4950-893e-1602bf06feed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:03.966523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebb80312-7346-4950-893e-1602bf06feed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:03.967365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebb80312-7346-4950-893e-1602bf06feed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:03.967876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebb80312-7346-4950-893e-1602bf06feed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:04.041789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ebb80312-7346-4950-893e-1602bf06feed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:04.049845 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ebb80312-7346-4950-893e-1602bf06feed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.095048 Jun 20 07:31:04.056866 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 877/1869] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:03 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:04.231690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef67c414-fe80-4b13-9ad7-a1a7fde6ca25 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:04.232249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ef67c414-fe80-4b13-9ad7-a1a7fde6ca25 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:04.238449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef67c414-fe80-4b13-9ad7-a1a7fde6ca25 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:04.238896 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef67c414-fe80-4b13-9ad7-a1a7fde6ca25 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:04.239658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef67c414-fe80-4b13-9ad7-a1a7fde6ca25 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:04.240088 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef67c414-fe80-4b13-9ad7-a1a7fde6ca25 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:04.325772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f7c1aacf-75ee-4b9a-895d-ac8eda0449af tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:04.334718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f7c1aacf-75ee-4b9a-895d-ac8eda0449af tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:04.336275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f7c1aacf-75ee-4b9a-895d-ac8eda0449af tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:04.337438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f7c1aacf-75ee-4b9a-895d-ac8eda0449af tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.419599 Jun 20 07:31:04.337999 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 993/1870] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:03 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:04.414040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ef67c414-fe80-4b13-9ad7-a1a7fde6ca25 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:04.421882 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ef67c414-fe80-4b13-9ad7-a1a7fde6ca25 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.194187 Jun 20 07:31:04.422446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 878/1871] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:04 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:05.066568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-60cb0f30-09cd-4983-afc1-855a912a297f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:05.067223 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-60cb0f30-09cd-4983-afc1-855a912a297f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:05.074310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60cb0f30-09cd-4983-afc1-855a912a297f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:05.074756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60cb0f30-09cd-4983-afc1-855a912a297f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:05.075502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60cb0f30-09cd-4983-afc1-855a912a297f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:05.075931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60cb0f30-09cd-4983-afc1-855a912a297f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:05.136898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-60cb0f30-09cd-4983-afc1-855a912a297f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:05.144653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-60cb0f30-09cd-4983-afc1-855a912a297f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081905 Jun 20 07:31:05.145207 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 994/1872] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:05 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:05.356991 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e9b020af-7d1f-4801-8cd5-94c4d38ce674 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:05.357539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e9b020af-7d1f-4801-8cd5-94c4d38ce674 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:05.363987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9b020af-7d1f-4801-8cd5-94c4d38ce674 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:05.364471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9b020af-7d1f-4801-8cd5-94c4d38ce674 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:05.365252 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9b020af-7d1f-4801-8cd5-94c4d38ce674 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:05.366257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9b020af-7d1f-4801-8cd5-94c4d38ce674 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:05.438863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0fad0d99-92f1-498f-8d44-e6a19b1b529b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:05.439471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0fad0d99-92f1-498f-8d44-e6a19b1b529b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:05.445454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fad0d99-92f1-498f-8d44-e6a19b1b529b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:05.445896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fad0d99-92f1-498f-8d44-e6a19b1b529b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:05.446677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fad0d99-92f1-498f-8d44-e6a19b1b529b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:05.447112 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fad0d99-92f1-498f-8d44-e6a19b1b529b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:05.526213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e9b020af-7d1f-4801-8cd5-94c4d38ce674 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:05.534623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e9b020af-7d1f-4801-8cd5-94c4d38ce674 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:05.536100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e9b020af-7d1f-4801-8cd5-94c4d38ce674 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:05.537973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e9b020af-7d1f-4801-8cd5-94c4d38ce674 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.184308 Jun 20 07:31:05.538451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 879/1873] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:05 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:05.585909 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0fad0d99-92f1-498f-8d44-e6a19b1b529b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:05.593748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0fad0d99-92f1-498f-8d44-e6a19b1b529b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.158901 Jun 20 07:31:05.594306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 995/1874] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:05 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:06.161463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-601938f3-32b0-4b9e-b04b-98f676426e2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:06.162071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-601938f3-32b0-4b9e-b04b-98f676426e2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:06.168047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-601938f3-32b0-4b9e-b04b-98f676426e2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:06.168515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-601938f3-32b0-4b9e-b04b-98f676426e2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:06.169262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-601938f3-32b0-4b9e-b04b-98f676426e2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:06.169693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-601938f3-32b0-4b9e-b04b-98f676426e2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:06.172158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:06.229686 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-601938f3-32b0-4b9e-b04b-98f676426e2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:06.237476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-601938f3-32b0-4b9e-b04b-98f676426e2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079877 Jun 20 07:31:06.238035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 880/1875] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:06 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:06.556989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e90a55e-9760-4c72-98c9-157928e35cda tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:06.557610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7e90a55e-9760-4c72-98c9-157928e35cda tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:06.564276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e90a55e-9760-4c72-98c9-157928e35cda tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:06.564731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e90a55e-9760-4c72-98c9-157928e35cda tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:06.565492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e90a55e-9760-4c72-98c9-157928e35cda tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:06.565929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e90a55e-9760-4c72-98c9-157928e35cda tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:06.610627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-78bd1caf-5027-47d8-b545-606afaf1d71f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:06.611243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-78bd1caf-5027-47d8-b545-606afaf1d71f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:06.618206 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78bd1caf-5027-47d8-b545-606afaf1d71f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:06.618651 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78bd1caf-5027-47d8-b545-606afaf1d71f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:06.619400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78bd1caf-5027-47d8-b545-606afaf1d71f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:06.619834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78bd1caf-5027-47d8-b545-606afaf1d71f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:06.745970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e90a55e-9760-4c72-98c9-157928e35cda tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:06.754612 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e90a55e-9760-4c72-98c9-157928e35cda tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:06.756451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e90a55e-9760-4c72-98c9-157928e35cda tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:06.757620 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7e90a55e-9760-4c72-98c9-157928e35cda tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.205131 Jun 20 07:31:06.758190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 996/1876] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:06 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:06.774610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-78bd1caf-5027-47d8-b545-606afaf1d71f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:06.782712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-78bd1caf-5027-47d8-b545-606afaf1d71f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.175732 Jun 20 07:31:06.783299 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 881/1877] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:06 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:07.253698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-068b8413-dfd8-4151-b474-e3697a7aa7ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:07.254313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-068b8413-dfd8-4151-b474-e3697a7aa7ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:07.260549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-068b8413-dfd8-4151-b474-e3697a7aa7ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:07.260998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-068b8413-dfd8-4151-b474-e3697a7aa7ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:07.261759 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-068b8413-dfd8-4151-b474-e3697a7aa7ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:07.262196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-068b8413-dfd8-4151-b474-e3697a7aa7ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:07.326434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-068b8413-dfd8-4151-b474-e3697a7aa7ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:07.334816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-068b8413-dfd8-4151-b474-e3697a7aa7ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084470 Jun 20 07:31:07.335376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 997/1878] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:07 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:07.775875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5690ca91-b918-41bc-bf79-0928d224da40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:07.776582 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5690ca91-b918-41bc-bf79-0928d224da40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:07.783041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5690ca91-b918-41bc-bf79-0928d224da40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:07.783478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5690ca91-b918-41bc-bf79-0928d224da40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:07.784254 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5690ca91-b918-41bc-bf79-0928d224da40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:07.784682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5690ca91-b918-41bc-bf79-0928d224da40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:07.800088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e866269e-9627-4e8a-bf39-6e19eb981c1d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:07.800720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e866269e-9627-4e8a-bf39-6e19eb981c1d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:07.807519 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e866269e-9627-4e8a-bf39-6e19eb981c1d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:07.807966 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e866269e-9627-4e8a-bf39-6e19eb981c1d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:07.808754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e866269e-9627-4e8a-bf39-6e19eb981c1d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:07.809186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e866269e-9627-4e8a-bf39-6e19eb981c1d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:07.976517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5690ca91-b918-41bc-bf79-0928d224da40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:07.979690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e866269e-9627-4e8a-bf39-6e19eb981c1d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:07.985108 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5690ca91-b918-41bc-bf79-0928d224da40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:07.986594 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5690ca91-b918-41bc-bf79-0928d224da40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:07.987692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e866269e-9627-4e8a-bf39-6e19eb981c1d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.191474 Jun 20 07:31:07.987814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5690ca91-b918-41bc-bf79-0928d224da40 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.215737 Jun 20 07:31:07.988324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 882/1879] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:07 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:07.988588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 998/1880] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:07 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:08.351368 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a5d0770-44ed-4f61-9d7e-fe4dd5f7c1a2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:08.351998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6a5d0770-44ed-4f61-9d7e-fe4dd5f7c1a2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:08.358480 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a5d0770-44ed-4f61-9d7e-fe4dd5f7c1a2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:08.358928 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a5d0770-44ed-4f61-9d7e-fe4dd5f7c1a2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:08.362401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a5d0770-44ed-4f61-9d7e-fe4dd5f7c1a2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:08.362856 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a5d0770-44ed-4f61-9d7e-fe4dd5f7c1a2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:08.578068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6a5d0770-44ed-4f61-9d7e-fe4dd5f7c1a2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:08.585848 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6a5d0770-44ed-4f61-9d7e-fe4dd5f7c1a2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.238325 Jun 20 07:31:08.586407 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 883/1881] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:08 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:09.006360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-605b8343-561c-444b-84b1-c420f2cf702d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:09.006914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8b8dc9c-94b4-4200-8248-16347618b444 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:09.007300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-605b8343-561c-444b-84b1-c420f2cf702d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:09.007416 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8b8dc9c-94b4-4200-8248-16347618b444 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:09.013521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-605b8343-561c-444b-84b1-c420f2cf702d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:09.013690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8b8dc9c-94b4-4200-8248-16347618b444 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:09.013975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-605b8343-561c-444b-84b1-c420f2cf702d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:09.014091 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8b8dc9c-94b4-4200-8248-16347618b444 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:09.014742 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-605b8343-561c-444b-84b1-c420f2cf702d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:09.014853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8b8dc9c-94b4-4200-8248-16347618b444 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:09.015207 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-605b8343-561c-444b-84b1-c420f2cf702d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:09.015420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8b8dc9c-94b4-4200-8248-16347618b444 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:09.029702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:09.212688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-605b8343-561c-444b-84b1-c420f2cf702d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:09.216553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8b8dc9c-94b4-4200-8248-16347618b444 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:09.220663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-605b8343-561c-444b-84b1-c420f2cf702d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.218491 Jun 20 07:31:09.221246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 999/1882] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:09 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:09.225405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8b8dc9c-94b4-4200-8248-16347618b444 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:09.226908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8b8dc9c-94b4-4200-8248-16347618b444 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:09.228061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8b8dc9c-94b4-4200-8248-16347618b444 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.225515 Jun 20 07:31:09.228625 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 884/1883] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:09 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:09.603003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-96173ffe-7df2-4ca7-8062-ac80b361f1c6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:09.603619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-96173ffe-7df2-4ca7-8062-ac80b361f1c6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:09.609663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96173ffe-7df2-4ca7-8062-ac80b361f1c6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:09.610114 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96173ffe-7df2-4ca7-8062-ac80b361f1c6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:09.610881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96173ffe-7df2-4ca7-8062-ac80b361f1c6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:09.611316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96173ffe-7df2-4ca7-8062-ac80b361f1c6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:09.671337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-96173ffe-7df2-4ca7-8062-ac80b361f1c6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:09.679178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-96173ffe-7df2-4ca7-8062-ac80b361f1c6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080627 Jun 20 07:31:09.679745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1000/1884] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:09 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:10.238087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01b45ad4-a2c8-4d37-b4b8-d6e5cb60b558 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:10.238714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01b45ad4-a2c8-4d37-b4b8-d6e5cb60b558 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:10.245810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01b45ad4-a2c8-4d37-b4b8-d6e5cb60b558 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:10.246269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01b45ad4-a2c8-4d37-b4b8-d6e5cb60b558 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:10.246423 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6c508871-315f-4719-9611-4a72ad7be506 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:10.247005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6c508871-315f-4719-9611-4a72ad7be506 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:10.247152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01b45ad4-a2c8-4d37-b4b8-d6e5cb60b558 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:10.247469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01b45ad4-a2c8-4d37-b4b8-d6e5cb60b558 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:10.253309 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c508871-315f-4719-9611-4a72ad7be506 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:10.253754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c508871-315f-4719-9611-4a72ad7be506 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:10.254504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c508871-315f-4719-9611-4a72ad7be506 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:10.255205 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c508871-315f-4719-9611-4a72ad7be506 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:10.447039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01b45ad4-a2c8-4d37-b4b8-d6e5cb60b558 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:10.454232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6c508871-315f-4719-9611-4a72ad7be506 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:10.454949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-01b45ad4-a2c8-4d37-b4b8-d6e5cb60b558 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.220718 Jun 20 07:31:10.455583 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 885/1885] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:10 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:10.463237 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6c508871-315f-4719-9611-4a72ad7be506 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:10.464754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6c508871-315f-4719-9611-4a72ad7be506 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:10.465897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6c508871-315f-4719-9611-4a72ad7be506 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.223299 Jun 20 07:31:10.466434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1001/1886] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:10 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:10.695849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4f1947d1-53b8-46d3-988b-9cb0ae00da66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:10.696494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4f1947d1-53b8-46d3-988b-9cb0ae00da66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:10.702562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f1947d1-53b8-46d3-988b-9cb0ae00da66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:10.703016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f1947d1-53b8-46d3-988b-9cb0ae00da66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:10.703791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f1947d1-53b8-46d3-988b-9cb0ae00da66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:10.704259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4f1947d1-53b8-46d3-988b-9cb0ae00da66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:10.765162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4f1947d1-53b8-46d3-988b-9cb0ae00da66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:10.773443 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4f1947d1-53b8-46d3-988b-9cb0ae00da66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081484 Jun 20 07:31:10.774003 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 886/1887] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:10 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:11.472295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-63ceb8ae-1bcd-499c-a9b1-07f280416239 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:11.472907 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-63ceb8ae-1bcd-499c-a9b1-07f280416239 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:11.479511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63ceb8ae-1bcd-499c-a9b1-07f280416239 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:11.479967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63ceb8ae-1bcd-499c-a9b1-07f280416239 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:11.480750 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63ceb8ae-1bcd-499c-a9b1-07f280416239 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:11.481185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63ceb8ae-1bcd-499c-a9b1-07f280416239 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:11.484706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d30d72af-0990-444b-857a-48214c7dcbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:11.485419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d30d72af-0990-444b-857a-48214c7dcbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:11.492374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d30d72af-0990-444b-857a-48214c7dcbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:11.492820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d30d72af-0990-444b-857a-48214c7dcbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:11.493573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d30d72af-0990-444b-857a-48214c7dcbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:11.494005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d30d72af-0990-444b-857a-48214c7dcbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:11.671284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-63ceb8ae-1bcd-499c-a9b1-07f280416239 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:11.679882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-63ceb8ae-1bcd-499c-a9b1-07f280416239 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.211474 Jun 20 07:31:11.680556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1002/1888] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:11 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:11.682957 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d30d72af-0990-444b-857a-48214c7dcbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:11.691401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d30d72af-0990-444b-857a-48214c7dcbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:11.692945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d30d72af-0990-444b-857a-48214c7dcbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:11.694699 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d30d72af-0990-444b-857a-48214c7dcbad tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.213963 Jun 20 07:31:11.695250 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 887/1889] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:11 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:11.790561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-24f1fc61-83c5-43af-a2b9-bffdea8bc0e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:11.791168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-24f1fc61-83c5-43af-a2b9-bffdea8bc0e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:11.797144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24f1fc61-83c5-43af-a2b9-bffdea8bc0e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:11.797591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24f1fc61-83c5-43af-a2b9-bffdea8bc0e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:11.798345 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24f1fc61-83c5-43af-a2b9-bffdea8bc0e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:11.798775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-24f1fc61-83c5-43af-a2b9-bffdea8bc0e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:11.858927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-24f1fc61-83c5-43af-a2b9-bffdea8bc0e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:11.867328 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-24f1fc61-83c5-43af-a2b9-bffdea8bc0e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080659 Jun 20 07:31:11.867880 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1003/1890] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:11 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:12.698136 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fa9c4cbd-2c22-4163-95a1-a894d71e4669 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:12.698698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fa9c4cbd-2c22-4163-95a1-a894d71e4669 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:12.705747 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa9c4cbd-2c22-4163-95a1-a894d71e4669 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:12.706198 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa9c4cbd-2c22-4163-95a1-a894d71e4669 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:12.707007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa9c4cbd-2c22-4163-95a1-a894d71e4669 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:12.707445 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa9c4cbd-2c22-4163-95a1-a894d71e4669 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:12.714020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6b91a2b8-0fd8-49c6-85e1-2c5fe8ed956e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:12.714628 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6b91a2b8-0fd8-49c6-85e1-2c5fe8ed956e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:12.721028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b91a2b8-0fd8-49c6-85e1-2c5fe8ed956e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:12.721467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b91a2b8-0fd8-49c6-85e1-2c5fe8ed956e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:12.722296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b91a2b8-0fd8-49c6-85e1-2c5fe8ed956e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:12.722727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6b91a2b8-0fd8-49c6-85e1-2c5fe8ed956e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:12.903903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fa9c4cbd-2c22-4163-95a1-a894d71e4669 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:12.911932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fa9c4cbd-2c22-4163-95a1-a894d71e4669 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.217727 Jun 20 07:31:12.912670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 888/1891] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:12 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:12.914795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6b91a2b8-0fd8-49c6-85e1-2c5fe8ed956e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:12.917289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c4e2ae92-a150-4545-9abf-f2e26bd9b831 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:12.917988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c4e2ae92-a150-4545-9abf-f2e26bd9b831 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:12.923893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6b91a2b8-0fd8-49c6-85e1-2c5fe8ed956e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:12.924173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4e2ae92-a150-4545-9abf-f2e26bd9b831 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:12.924641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4e2ae92-a150-4545-9abf-f2e26bd9b831 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:12.925417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4e2ae92-a150-4545-9abf-f2e26bd9b831 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:12.925530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6b91a2b8-0fd8-49c6-85e1-2c5fe8ed956e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:12.925857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4e2ae92-a150-4545-9abf-f2e26bd9b831 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:12.926597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6b91a2b8-0fd8-49c6-85e1-2c5fe8ed956e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.217501 Jun 20 07:31:12.933781 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1004/1892] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:12 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:12.992254 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c4e2ae92-a150-4545-9abf-f2e26bd9b831 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:13.000069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c4e2ae92-a150-4545-9abf-f2e26bd9b831 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086387 Jun 20 07:31:13.000656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 889/1893] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:12 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:13.929003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2de1cc26-66a2-4cf3-8aeb-6710512d2e8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:13.929614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2de1cc26-66a2-4cf3-8aeb-6710512d2e8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:13.936101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2de1cc26-66a2-4cf3-8aeb-6710512d2e8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:13.936575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2de1cc26-66a2-4cf3-8aeb-6710512d2e8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:13.937327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2de1cc26-66a2-4cf3-8aeb-6710512d2e8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:13.937759 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2de1cc26-66a2-4cf3-8aeb-6710512d2e8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:13.946801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-52d77369-8992-43f6-aaf1-63ba201a7be5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:13.947430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-52d77369-8992-43f6-aaf1-63ba201a7be5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:13.949771 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=78 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:13.955435 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52d77369-8992-43f6-aaf1-63ba201a7be5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:13.955887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52d77369-8992-43f6-aaf1-63ba201a7be5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:13.956687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52d77369-8992-43f6-aaf1-63ba201a7be5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:13.957135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52d77369-8992-43f6-aaf1-63ba201a7be5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:14.131140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2de1cc26-66a2-4cf3-8aeb-6710512d2e8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:14.138090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-52d77369-8992-43f6-aaf1-63ba201a7be5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:14.138906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2de1cc26-66a2-4cf3-8aeb-6710512d2e8d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.213714 Jun 20 07:31:14.139477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1005/1894] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:13 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:14.143834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ec36d39-6548-4a7a-8654-256094665a5d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:14.144468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1ec36d39-6548-4a7a-8654-256094665a5d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:14.147215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-52d77369-8992-43f6-aaf1-63ba201a7be5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:14.148744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-52d77369-8992-43f6-aaf1-63ba201a7be5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:14.149903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-52d77369-8992-43f6-aaf1-63ba201a7be5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.207180 Jun 20 07:31:14.150447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 890/1895] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:13 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:14.150809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ec36d39-6548-4a7a-8654-256094665a5d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:14.151260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ec36d39-6548-4a7a-8654-256094665a5d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:14.152020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ec36d39-6548-4a7a-8654-256094665a5d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:14.152485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ec36d39-6548-4a7a-8654-256094665a5d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:14.212693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ec36d39-6548-4a7a-8654-256094665a5d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:14.220378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ec36d39-6548-4a7a-8654-256094665a5d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079944 Jun 20 07:31:14.220950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1006/1896] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:14 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:15.156447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d3a0fe3-cd6e-498d-ada2-bdb9d71fe987 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:15.157063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d3a0fe3-cd6e-498d-ada2-bdb9d71fe987 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:15.164023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d3a0fe3-cd6e-498d-ada2-bdb9d71fe987 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:15.164496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d3a0fe3-cd6e-498d-ada2-bdb9d71fe987 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:15.165257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d3a0fe3-cd6e-498d-ada2-bdb9d71fe987 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:15.165689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d3a0fe3-cd6e-498d-ada2-bdb9d71fe987 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:15.168716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e390b6a-c1b1-4bf7-9a9f-9d75ab417166 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:15.169438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e390b6a-c1b1-4bf7-9a9f-9d75ab417166 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:15.175805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e390b6a-c1b1-4bf7-9a9f-9d75ab417166 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:15.176298 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e390b6a-c1b1-4bf7-9a9f-9d75ab417166 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:15.177063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e390b6a-c1b1-4bf7-9a9f-9d75ab417166 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:15.178149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e390b6a-c1b1-4bf7-9a9f-9d75ab417166 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:15.366139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d3a0fe3-cd6e-498d-ada2-bdb9d71fe987 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:15.370366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e390b6a-c1b1-4bf7-9a9f-9d75ab417166 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:15.374120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d3a0fe3-cd6e-498d-ada2-bdb9d71fe987 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.221549 Jun 20 07:31:15.374685 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 891/1897] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:15 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:15.379059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-50332580-98f7-4e13-b2ec-0d0385d6fd41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:15.379237 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e390b6a-c1b1-4bf7-9a9f-9d75ab417166 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:15.379658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-50332580-98f7-4e13-b2ec-0d0385d6fd41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:15.380971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e390b6a-c1b1-4bf7-9a9f-9d75ab417166 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:15.382161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e390b6a-c1b1-4bf7-9a9f-9d75ab417166 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.217338 Jun 20 07:31:15.382882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1007/1898] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:15 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:15.385723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50332580-98f7-4e13-b2ec-0d0385d6fd41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:15.386172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50332580-98f7-4e13-b2ec-0d0385d6fd41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:15.386926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50332580-98f7-4e13-b2ec-0d0385d6fd41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:15.387358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50332580-98f7-4e13-b2ec-0d0385d6fd41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:15.449969 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-50332580-98f7-4e13-b2ec-0d0385d6fd41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:15.457894 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-50332580-98f7-4e13-b2ec-0d0385d6fd41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082283 Jun 20 07:31:15.458445 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 892/1899] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:15 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:16.390699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4da56263-3f8a-407c-bd42-7e3bbfb7913b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:16.391318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4da56263-3f8a-407c-bd42-7e3bbfb7913b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:16.393657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=80 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:16.398959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4da56263-3f8a-407c-bd42-7e3bbfb7913b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:16.399434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4da56263-3f8a-407c-bd42-7e3bbfb7913b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:16.400222 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4da56263-3f8a-407c-bd42-7e3bbfb7913b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:16.400628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e2ed86eb-7bc8-47b3-b106-fd0a1c695548 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:16.401055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4da56263-3f8a-407c-bd42-7e3bbfb7913b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:16.401245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e2ed86eb-7bc8-47b3-b106-fd0a1c695548 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:16.407516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2ed86eb-7bc8-47b3-b106-fd0a1c695548 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:16.407967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2ed86eb-7bc8-47b3-b106-fd0a1c695548 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:16.408749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2ed86eb-7bc8-47b3-b106-fd0a1c695548 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:16.409179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2ed86eb-7bc8-47b3-b106-fd0a1c695548 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:16.592143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4da56263-3f8a-407c-bd42-7e3bbfb7913b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:16.596232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e2ed86eb-7bc8-47b3-b106-fd0a1c695548 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:16.600680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4da56263-3f8a-407c-bd42-7e3bbfb7913b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.213818 Jun 20 07:31:16.601249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1008/1900] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:16 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:16.605167 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e2ed86eb-7bc8-47b3-b106-fd0a1c695548 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:16.605631 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b32d91d1-a80d-4689-bd21-9c158d2d4900 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:16.606236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b32d91d1-a80d-4689-bd21-9c158d2d4900 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:16.606643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e2ed86eb-7bc8-47b3-b106-fd0a1c695548 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:16.607796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e2ed86eb-7bc8-47b3-b106-fd0a1c695548 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.211215 Jun 20 07:31:16.608375 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 893/1901] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:16 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:16.612138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b32d91d1-a80d-4689-bd21-9c158d2d4900 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:16.612591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b32d91d1-a80d-4689-bd21-9c158d2d4900 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:16.613350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b32d91d1-a80d-4689-bd21-9c158d2d4900 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:16.613786 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b32d91d1-a80d-4689-bd21-9c158d2d4900 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:16.676430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b32d91d1-a80d-4689-bd21-9c158d2d4900 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:16.684991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b32d91d1-a80d-4689-bd21-9c158d2d4900 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082807 Jun 20 07:31:16.685760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1009/1902] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:16 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:17.617965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-28908a00-22aa-4415-883c-56786a9cc17d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:17.618589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-28908a00-22aa-4415-883c-56786a9cc17d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:17.625119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28908a00-22aa-4415-883c-56786a9cc17d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:17.625604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28908a00-22aa-4415-883c-56786a9cc17d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:17.626369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28908a00-22aa-4415-883c-56786a9cc17d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:17.626654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-60cea33e-56ab-4fdd-b85a-2555d7c6104e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:17.627078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28908a00-22aa-4415-883c-56786a9cc17d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:17.627270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-60cea33e-56ab-4fdd-b85a-2555d7c6104e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:17.634793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60cea33e-56ab-4fdd-b85a-2555d7c6104e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:17.635242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60cea33e-56ab-4fdd-b85a-2555d7c6104e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:17.636013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60cea33e-56ab-4fdd-b85a-2555d7c6104e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:17.636479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60cea33e-56ab-4fdd-b85a-2555d7c6104e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:17.822654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-28908a00-22aa-4415-883c-56786a9cc17d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:17.825726 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-60cea33e-56ab-4fdd-b85a-2555d7c6104e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:17.831296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-28908a00-22aa-4415-883c-56786a9cc17d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.217739 Jun 20 07:31:17.831864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 894/1903] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:17 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:17.834163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-60cea33e-56ab-4fdd-b85a-2555d7c6104e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:17.835674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-60cea33e-56ab-4fdd-b85a-2555d7c6104e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:17.836305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb3f8b12-2e10-4f9a-86a3-30b1b7796a47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:17.836828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb3f8b12-2e10-4f9a-86a3-30b1b7796a47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:17.836968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-60cea33e-56ab-4fdd-b85a-2555d7c6104e tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.214137 Jun 20 07:31:17.837751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1010/1904] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:17 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:17.842554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb3f8b12-2e10-4f9a-86a3-30b1b7796a47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:17.843000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb3f8b12-2e10-4f9a-86a3-30b1b7796a47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:17.843756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb3f8b12-2e10-4f9a-86a3-30b1b7796a47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:17.844210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb3f8b12-2e10-4f9a-86a3-30b1b7796a47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:17.904328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb3f8b12-2e10-4f9a-86a3-30b1b7796a47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:17.912635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb3f8b12-2e10-4f9a-86a3-30b1b7796a47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079235 Jun 20 07:31:17.913190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 895/1905] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:17 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:18.848381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e112ae0-4e12-4d2d-ae31-6a0db3c83177 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:18.849002 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e112ae0-4e12-4d2d-ae31-6a0db3c83177 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:18.854657 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-138ab554-eb45-44f1-a049-fa545bd4c2cf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:18.855278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-138ab554-eb45-44f1-a049-fa545bd4c2cf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:18.855564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e112ae0-4e12-4d2d-ae31-6a0db3c83177 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:18.856012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e112ae0-4e12-4d2d-ae31-6a0db3c83177 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:18.856811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e112ae0-4e12-4d2d-ae31-6a0db3c83177 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:18.857246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e112ae0-4e12-4d2d-ae31-6a0db3c83177 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:18.861769 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-138ab554-eb45-44f1-a049-fa545bd4c2cf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:18.862219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-138ab554-eb45-44f1-a049-fa545bd4c2cf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:18.862980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-138ab554-eb45-44f1-a049-fa545bd4c2cf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:18.863417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-138ab554-eb45-44f1-a049-fa545bd4c2cf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:19.049784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6e112ae0-4e12-4d2d-ae31-6a0db3c83177 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:19.050864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-138ab554-eb45-44f1-a049-fa545bd4c2cf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:19.053603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:19.058556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e112ae0-4e12-4d2d-ae31-6a0db3c83177 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.214012 Jun 20 07:31:19.059134 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1011/1906] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:18 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:19.060962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-138ab554-eb45-44f1-a049-fa545bd4c2cf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:19.062469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-138ab554-eb45-44f1-a049-fa545bd4c2cf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:19.063631 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-138ab554-eb45-44f1-a049-fa545bd4c2cf tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.212841 Jun 20 07:31:19.063763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5b8976f5-ef65-43c3-8f3e-1e2f8782d614 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:19.064359 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 896/1907] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:18 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:19.064502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5b8976f5-ef65-43c3-8f3e-1e2f8782d614 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:19.070479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b8976f5-ef65-43c3-8f3e-1e2f8782d614 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:19.070927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b8976f5-ef65-43c3-8f3e-1e2f8782d614 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:19.071675 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b8976f5-ef65-43c3-8f3e-1e2f8782d614 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:19.072103 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b8976f5-ef65-43c3-8f3e-1e2f8782d614 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:19.133781 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5b8976f5-ef65-43c3-8f3e-1e2f8782d614 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:19.141442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5b8976f5-ef65-43c3-8f3e-1e2f8782d614 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081387 Jun 20 07:31:19.141999 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1012/1908] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:19 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:20.076796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a996790a-cb5d-4eb3-b8b0-28beb5110bf8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:20.077445 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a996790a-cb5d-4eb3-b8b0-28beb5110bf8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:20.082646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1de148c3-4d98-41b6-92ca-7882b44af7b3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:20.083269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1de148c3-4d98-41b6-92ca-7882b44af7b3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:20.084312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a996790a-cb5d-4eb3-b8b0-28beb5110bf8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:20.084794 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a996790a-cb5d-4eb3-b8b0-28beb5110bf8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:20.085569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a996790a-cb5d-4eb3-b8b0-28beb5110bf8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:20.086012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a996790a-cb5d-4eb3-b8b0-28beb5110bf8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:20.090302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1de148c3-4d98-41b6-92ca-7882b44af7b3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:20.090754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1de148c3-4d98-41b6-92ca-7882b44af7b3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:20.091522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1de148c3-4d98-41b6-92ca-7882b44af7b3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:20.091953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1de148c3-4d98-41b6-92ca-7882b44af7b3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:20.277742 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a996790a-cb5d-4eb3-b8b0-28beb5110bf8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:20.282306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1de148c3-4d98-41b6-92ca-7882b44af7b3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:20.285695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a996790a-cb5d-4eb3-b8b0-28beb5110bf8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.213028 Jun 20 07:31:20.286268 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 897/1909] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:20 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:20.290700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cb7cc5dd-3ed9-4832-86f5-a7118ba99264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:20.290881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1de148c3-4d98-41b6-92ca-7882b44af7b3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:20.291313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cb7cc5dd-3ed9-4832-86f5-a7118ba99264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:20.292361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1de148c3-4d98-41b6-92ca-7882b44af7b3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:20.293506 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1de148c3-4d98-41b6-92ca-7882b44af7b3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.214686 Jun 20 07:31:20.294220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1013/1910] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:20 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:20.297075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb7cc5dd-3ed9-4832-86f5-a7118ba99264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:20.297524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb7cc5dd-3ed9-4832-86f5-a7118ba99264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:20.298281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb7cc5dd-3ed9-4832-86f5-a7118ba99264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:20.298717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb7cc5dd-3ed9-4832-86f5-a7118ba99264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:20.358745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cb7cc5dd-3ed9-4832-86f5-a7118ba99264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:20.366793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cb7cc5dd-3ed9-4832-86f5-a7118ba99264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079520 Jun 20 07:31:20.367358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 898/1911] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:20 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:21.302868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7a1afa15-e1de-4a4f-bad2-7c2d284f54a2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:21.303474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7a1afa15-e1de-4a4f-bad2-7c2d284f54a2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:21.310106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a1afa15-e1de-4a4f-bad2-7c2d284f54a2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:21.310551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a1afa15-e1de-4a4f-bad2-7c2d284f54a2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:21.311310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a1afa15-e1de-4a4f-bad2-7c2d284f54a2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:21.311571 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ffc7ff66-3654-4517-977b-1ef875d3844f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:21.312016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7a1afa15-e1de-4a4f-bad2-7c2d284f54a2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:21.312233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ffc7ff66-3654-4517-977b-1ef875d3844f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:21.318659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffc7ff66-3654-4517-977b-1ef875d3844f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:21.319146 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffc7ff66-3654-4517-977b-1ef875d3844f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:21.319933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffc7ff66-3654-4517-977b-1ef875d3844f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:21.320381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffc7ff66-3654-4517-977b-1ef875d3844f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:21.502496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7a1afa15-e1de-4a4f-bad2-7c2d284f54a2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:21.505875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ffc7ff66-3654-4517-977b-1ef875d3844f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:21.510807 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7a1afa15-e1de-4a4f-bad2-7c2d284f54a2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.211848 Jun 20 07:31:21.511420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1014/1912] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:21 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:21.514202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ffc7ff66-3654-4517-977b-1ef875d3844f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:21.515712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ffc7ff66-3654-4517-977b-1ef875d3844f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:21.515842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-30d54a80-c1fa-4ef1-a5de-38ba1dc90ab9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:21.516450 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-30d54a80-c1fa-4ef1-a5de-38ba1dc90ab9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:21.516914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ffc7ff66-3654-4517-977b-1ef875d3844f tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.209219 Jun 20 07:31:21.517627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 899/1913] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:21 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:21.522707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30d54a80-c1fa-4ef1-a5de-38ba1dc90ab9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:21.523161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30d54a80-c1fa-4ef1-a5de-38ba1dc90ab9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:21.523931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30d54a80-c1fa-4ef1-a5de-38ba1dc90ab9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:21.524399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-30d54a80-c1fa-4ef1-a5de-38ba1dc90ab9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:21.586706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-30d54a80-c1fa-4ef1-a5de-38ba1dc90ab9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:21.594537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-30d54a80-c1fa-4ef1-a5de-38ba1dc90ab9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082221 Jun 20 07:31:21.595101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1015/1914] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:21 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:22.527529 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ac286b1c-06af-474e-b1ce-4adeedd3d336 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:22.528170 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ac286b1c-06af-474e-b1ce-4adeedd3d336 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:22.534650 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac286b1c-06af-474e-b1ce-4adeedd3d336 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:22.535105 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac286b1c-06af-474e-b1ce-4adeedd3d336 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:22.535526 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8b62593f-63ff-4146-9ed5-b7f0287a90d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:22.535938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac286b1c-06af-474e-b1ce-4adeedd3d336 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:22.536157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8b62593f-63ff-4146-9ed5-b7f0287a90d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:22.536334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac286b1c-06af-474e-b1ce-4adeedd3d336 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:22.542683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b62593f-63ff-4146-9ed5-b7f0287a90d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:22.543124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b62593f-63ff-4146-9ed5-b7f0287a90d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:22.543880 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b62593f-63ff-4146-9ed5-b7f0287a90d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:22.544351 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b62593f-63ff-4146-9ed5-b7f0287a90d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:22.546896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:22.722432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ac286b1c-06af-474e-b1ce-4adeedd3d336 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:22.726356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8b62593f-63ff-4146-9ed5-b7f0287a90d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:22.730455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ac286b1c-06af-474e-b1ce-4adeedd3d336 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.206773 Jun 20 07:31:22.731036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 900/1915] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:22 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:22.735268 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8b62593f-63ff-4146-9ed5-b7f0287a90d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:22.735439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-616b5600-4c22-4f06-b355-679bf1917784 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:22.736013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-616b5600-4c22-4f06-b355-679bf1917784 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:22.736989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8b62593f-63ff-4146-9ed5-b7f0287a90d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:22.738227 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8b62593f-63ff-4146-9ed5-b7f0287a90d5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.206582 Jun 20 07:31:22.738882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1016/1916] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:22 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:22.742507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-616b5600-4c22-4f06-b355-679bf1917784 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:22.742961 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-616b5600-4c22-4f06-b355-679bf1917784 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:22.743735 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-616b5600-4c22-4f06-b355-679bf1917784 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:22.744205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-616b5600-4c22-4f06-b355-679bf1917784 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:22.806972 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-616b5600-4c22-4f06-b355-679bf1917784 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:22.814801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-616b5600-4c22-4f06-b355-679bf1917784 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082795 Jun 20 07:31:22.815361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 901/1917] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:22 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:23.748151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1f8fef98-6160-4b7d-a457-947eb5b6077c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:23.748773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1f8fef98-6160-4b7d-a457-947eb5b6077c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:23.756308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f8fef98-6160-4b7d-a457-947eb5b6077c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:23.756763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f8fef98-6160-4b7d-a457-947eb5b6077c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:23.757524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f8fef98-6160-4b7d-a457-947eb5b6077c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:23.757963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f8fef98-6160-4b7d-a457-947eb5b6077c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:23.758491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a881464c-ec9e-4268-9920-cc7494024052 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:23.759106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a881464c-ec9e-4268-9920-cc7494024052 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:23.765512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a881464c-ec9e-4268-9920-cc7494024052 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:23.765955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a881464c-ec9e-4268-9920-cc7494024052 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:23.766707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a881464c-ec9e-4268-9920-cc7494024052 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:23.767139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a881464c-ec9e-4268-9920-cc7494024052 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:23.951041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f8fef98-6160-4b7d-a457-947eb5b6077c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:23.955051 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a881464c-ec9e-4268-9920-cc7494024052 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:23.959451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1f8fef98-6160-4b7d-a457-947eb5b6077c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.215125 Jun 20 07:31:23.960042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1017/1918] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:23 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:23.963537 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a881464c-ec9e-4268-9920-cc7494024052 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:23.964829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-27fa2f1b-dca6-4da5-996b-4ba5df8d5e24 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:23.965077 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a881464c-ec9e-4268-9920-cc7494024052 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:23.965504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-27fa2f1b-dca6-4da5-996b-4ba5df8d5e24 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:23.966248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a881464c-ec9e-4268-9920-cc7494024052 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.212450 Jun 20 07:31:23.966936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 902/1919] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:23 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:23.971214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27fa2f1b-dca6-4da5-996b-4ba5df8d5e24 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:23.971661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27fa2f1b-dca6-4da5-996b-4ba5df8d5e24 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:23.972445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27fa2f1b-dca6-4da5-996b-4ba5df8d5e24 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:23.972918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-27fa2f1b-dca6-4da5-996b-4ba5df8d5e24 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:24.043324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-27fa2f1b-dca6-4da5-996b-4ba5df8d5e24 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:24.051248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-27fa2f1b-dca6-4da5-996b-4ba5df8d5e24 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.090150 Jun 20 07:31:24.051818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1018/1920] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:23 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:24.976673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-862f88ca-70e6-474e-9c8f-7bcf4e4ebba5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:24.977213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-862f88ca-70e6-474e-9c8f-7bcf4e4ebba5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:24.983985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-862f88ca-70e6-474e-9c8f-7bcf4e4ebba5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:24.984460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-862f88ca-70e6-474e-9c8f-7bcf4e4ebba5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:24.984803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-686c17a5-9dfd-4cab-bbb9-bc623e79f0f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:24.985231 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-862f88ca-70e6-474e-9c8f-7bcf4e4ebba5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:24.985417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-686c17a5-9dfd-4cab-bbb9-bc623e79f0f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:24.985642 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-862f88ca-70e6-474e-9c8f-7bcf4e4ebba5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:24.993407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-686c17a5-9dfd-4cab-bbb9-bc623e79f0f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:24.994025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-686c17a5-9dfd-4cab-bbb9-bc623e79f0f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:24.995409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-686c17a5-9dfd-4cab-bbb9-bc623e79f0f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:24.996259 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-686c17a5-9dfd-4cab-bbb9-bc623e79f0f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:25.177896 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-862f88ca-70e6-474e-9c8f-7bcf4e4ebba5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:25.184728 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-686c17a5-9dfd-4cab-bbb9-bc623e79f0f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:25.185969 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-862f88ca-70e6-474e-9c8f-7bcf4e4ebba5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.213247 Jun 20 07:31:25.186536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 903/1921] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:24 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:25.190902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3c755d0d-3e36-459a-88a3-b0c23d884fdb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:25.191500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3c755d0d-3e36-459a-88a3-b0c23d884fdb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:25.194917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-686c17a5-9dfd-4cab-bbb9-bc623e79f0f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:25.196591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-686c17a5-9dfd-4cab-bbb9-bc623e79f0f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:25.197695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-686c17a5-9dfd-4cab-bbb9-bc623e79f0f3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.216730 Jun 20 07:31:25.197831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c755d0d-3e36-459a-88a3-b0c23d884fdb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:25.198243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c755d0d-3e36-459a-88a3-b0c23d884fdb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:25.198396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1019/1922] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:24 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:25.198999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c755d0d-3e36-459a-88a3-b0c23d884fdb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:25.199430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c755d0d-3e36-459a-88a3-b0c23d884fdb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:25.261146 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c755d0d-3e36-459a-88a3-b0c23d884fdb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:25.269055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3c755d0d-3e36-459a-88a3-b0c23d884fdb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081577 Jun 20 07:31:25.269612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 904/1923] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:25 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:26.203548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3703508b-a396-4849-8db4-94e4b79d57c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:26.204185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3703508b-a396-4849-8db4-94e4b79d57c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:26.211340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3703508b-a396-4849-8db4-94e4b79d57c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:26.211800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3703508b-a396-4849-8db4-94e4b79d57c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:26.212599 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3703508b-a396-4849-8db4-94e4b79d57c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:26.213037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3703508b-a396-4849-8db4-94e4b79d57c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:26.216070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-47a2a972-8d60-4d21-8315-b72ce1980f3a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:26.216713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-47a2a972-8d60-4d21-8315-b72ce1980f3a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:26.223171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47a2a972-8d60-4d21-8315-b72ce1980f3a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:26.223623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47a2a972-8d60-4d21-8315-b72ce1980f3a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:26.224409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47a2a972-8d60-4d21-8315-b72ce1980f3a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:26.224850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47a2a972-8d60-4d21-8315-b72ce1980f3a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:26.407359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3703508b-a396-4849-8db4-94e4b79d57c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:26.410449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-47a2a972-8d60-4d21-8315-b72ce1980f3a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:26.415350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3703508b-a396-4849-8db4-94e4b79d57c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.215693 Jun 20 07:31:26.416048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1020/1924] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:26 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:26.418832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-47a2a972-8d60-4d21-8315-b72ce1980f3a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:26.420346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-47a2a972-8d60-4d21-8315-b72ce1980f3a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:26.420579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-993d051f-4c38-4b9b-8262-e04107440245 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:26.421183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-993d051f-4c38-4b9b-8262-e04107440245 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:26.421501 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-47a2a972-8d60-4d21-8315-b72ce1980f3a tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.209311 Jun 20 07:31:26.422168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 905/1925] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:26 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:26.427017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-993d051f-4c38-4b9b-8262-e04107440245 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:26.427468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-993d051f-4c38-4b9b-8262-e04107440245 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:26.428292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-993d051f-4c38-4b9b-8262-e04107440245 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:26.428793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-993d051f-4c38-4b9b-8262-e04107440245 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:26.489108 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-993d051f-4c38-4b9b-8262-e04107440245 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:26.499788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-993d051f-4c38-4b9b-8262-e04107440245 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082793 Jun 20 07:31:26.500394 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1021/1926] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:26 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:27.432374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2fb777dc-36c7-434e-8529-e8c535010f82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:27.433018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2fb777dc-36c7-434e-8529-e8c535010f82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:27.439171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fb777dc-36c7-434e-8529-e8c535010f82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:27.439422 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-19e4e5f5-bd03-4018-b03d-3ec6b63ceb9b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:27.439834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fb777dc-36c7-434e-8529-e8c535010f82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:27.440035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-19e4e5f5-bd03-4018-b03d-3ec6b63ceb9b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:27.440373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fb777dc-36c7-434e-8529-e8c535010f82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:27.440808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2fb777dc-36c7-434e-8529-e8c535010f82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:27.446701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19e4e5f5-bd03-4018-b03d-3ec6b63ceb9b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:27.447152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19e4e5f5-bd03-4018-b03d-3ec6b63ceb9b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:27.447913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19e4e5f5-bd03-4018-b03d-3ec6b63ceb9b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:27.448372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-19e4e5f5-bd03-4018-b03d-3ec6b63ceb9b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:27.627380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2fb777dc-36c7-434e-8529-e8c535010f82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:27.635970 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2fb777dc-36c7-434e-8529-e8c535010f82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.207411 Jun 20 07:31:27.636555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 906/1927] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:27 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:27.640944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9436dcf5-824c-4f19-a604-cf19b6e91295 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:27.641545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9436dcf5-824c-4f19-a604-cf19b6e91295 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:27.642908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-19e4e5f5-bd03-4018-b03d-3ec6b63ceb9b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:27.649324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9436dcf5-824c-4f19-a604-cf19b6e91295 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:27.650116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9436dcf5-824c-4f19-a604-cf19b6e91295 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:27.651464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9436dcf5-824c-4f19-a604-cf19b6e91295 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:27.651911 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9436dcf5-824c-4f19-a604-cf19b6e91295 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:27.654542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-19e4e5f5-bd03-4018-b03d-3ec6b63ceb9b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:27.656094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-19e4e5f5-bd03-4018-b03d-3ec6b63ceb9b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:27.659666 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-19e4e5f5-bd03-4018-b03d-3ec6b63ceb9b tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.224034 Jun 20 07:31:27.661415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1022/1928] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:27 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:27.713977 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9436dcf5-824c-4f19-a604-cf19b6e91295 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:27.722162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9436dcf5-824c-4f19-a604-cf19b6e91295 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084622 Jun 20 07:31:27.722726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 907/1929] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:27 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:28.652964 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-debb739f-9da4-4f69-a0b5-c6e0d6875770 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:28.653503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-debb739f-9da4-4f69-a0b5-c6e0d6875770 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:28.659917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-debb739f-9da4-4f69-a0b5-c6e0d6875770 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:28.660398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-debb739f-9da4-4f69-a0b5-c6e0d6875770 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:28.661160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-debb739f-9da4-4f69-a0b5-c6e0d6875770 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:28.662126 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-debb739f-9da4-4f69-a0b5-c6e0d6875770 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:28.678624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1bc9d9f5-6408-41ed-83df-23420ad11f12 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:28.679249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1bc9d9f5-6408-41ed-83df-23420ad11f12 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:28.685692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bc9d9f5-6408-41ed-83df-23420ad11f12 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:28.686142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bc9d9f5-6408-41ed-83df-23420ad11f12 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:28.686913 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bc9d9f5-6408-41ed-83df-23420ad11f12 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:28.687352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bc9d9f5-6408-41ed-83df-23420ad11f12 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:28.856731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-debb739f-9da4-4f69-a0b5-c6e0d6875770 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:28.863457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1bc9d9f5-6408-41ed-83df-23420ad11f12 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:28.864698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-debb739f-9da4-4f69-a0b5-c6e0d6875770 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.215645 Jun 20 07:31:28.865270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1023/1930] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:28 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:28.869732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b9809bd1-c66c-4a1f-8580-efffa87178ac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:28.870343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b9809bd1-c66c-4a1f-8580-efffa87178ac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:28.872061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1bc9d9f5-6408-41ed-83df-23420ad11f12 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:28.873634 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1bc9d9f5-6408-41ed-83df-23420ad11f12 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:28.874782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1bc9d9f5-6408-41ed-83df-23420ad11f12 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.200720 Jun 20 07:31:28.875483 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 908/1931] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:28 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:28.876192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9809bd1-c66c-4a1f-8580-efffa87178ac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:28.876649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9809bd1-c66c-4a1f-8580-efffa87178ac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:28.877420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9809bd1-c66c-4a1f-8580-efffa87178ac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:28.877859 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b9809bd1-c66c-4a1f-8580-efffa87178ac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:28.941835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b9809bd1-c66c-4a1f-8580-efffa87178ac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:28.949712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b9809bd1-c66c-4a1f-8580-efffa87178ac tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083470 Jun 20 07:31:28.950279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1024/1932] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:28 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:29.882158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-55211e53-b810-47a4-a65c-6e829fb02cfb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:29.882795 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-55211e53-b810-47a4-a65c-6e829fb02cfb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:29.889513 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55211e53-b810-47a4-a65c-6e829fb02cfb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:29.890018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55211e53-b810-47a4-a65c-6e829fb02cfb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:29.890787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55211e53-b810-47a4-a65c-6e829fb02cfb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:29.891224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55211e53-b810-47a4-a65c-6e829fb02cfb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:29.893364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0c3dc84f-02fb-42ed-899e-17094f6574e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:29.894010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0c3dc84f-02fb-42ed-899e-17094f6574e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:29.900670 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c3dc84f-02fb-42ed-899e-17094f6574e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:29.901119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c3dc84f-02fb-42ed-899e-17094f6574e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:29.901886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c3dc84f-02fb-42ed-899e-17094f6574e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:29.902322 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c3dc84f-02fb-42ed-899e-17094f6574e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:30.098485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-55211e53-b810-47a4-a65c-6e829fb02cfb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:30.102404 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0c3dc84f-02fb-42ed-899e-17094f6574e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:30.107391 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-55211e53-b810-47a4-a65c-6e829fb02cfb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.229359 Jun 20 07:31:30.108202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 909/1933] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:29 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:30.110813 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0c3dc84f-02fb-42ed-899e-17094f6574e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:30.112340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0c3dc84f-02fb-42ed-899e-17094f6574e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:30.112522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-caa48ef5-6f01-4881-b987-9b912bae7416 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:30.113134 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-caa48ef5-6f01-4881-b987-9b912bae7416 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:30.113490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0c3dc84f-02fb-42ed-899e-17094f6574e7 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.224177 Jun 20 07:31:30.114170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1025/1934] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:29 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:30.119504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caa48ef5-6f01-4881-b987-9b912bae7416 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:30.119945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caa48ef5-6f01-4881-b987-9b912bae7416 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:30.120754 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caa48ef5-6f01-4881-b987-9b912bae7416 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:30.121184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caa48ef5-6f01-4881-b987-9b912bae7416 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:30.180975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-caa48ef5-6f01-4881-b987-9b912bae7416 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:30.188702 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-caa48ef5-6f01-4881-b987-9b912bae7416 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079674 Jun 20 07:31:30.189255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 910/1935] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:30 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:31.125012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3a769b76-8183-4eb1-9ec5-eb40cd67845c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:31.125664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3a769b76-8183-4eb1-9ec5-eb40cd67845c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:31.132847 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-461cea82-6e76-46ec-ae5e-4a27dd44fffc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:31.133270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a769b76-8183-4eb1-9ec5-eb40cd67845c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:31.133461 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-461cea82-6e76-46ec-ae5e-4a27dd44fffc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:31.133588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a769b76-8183-4eb1-9ec5-eb40cd67845c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:31.134319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a769b76-8183-4eb1-9ec5-eb40cd67845c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:31.134753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a769b76-8183-4eb1-9ec5-eb40cd67845c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:31.139555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-461cea82-6e76-46ec-ae5e-4a27dd44fffc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:31.140131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-461cea82-6e76-46ec-ae5e-4a27dd44fffc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:31.140892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-461cea82-6e76-46ec-ae5e-4a27dd44fffc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:31.141328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-461cea82-6e76-46ec-ae5e-4a27dd44fffc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:31.329644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-461cea82-6e76-46ec-ae5e-4a27dd44fffc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:31.332747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3a769b76-8183-4eb1-9ec5-eb40cd67845c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:31.338257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-461cea82-6e76-46ec-ae5e-4a27dd44fffc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:31.339767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-461cea82-6e76-46ec-ae5e-4a27dd44fffc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:31.340607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3a769b76-8183-4eb1-9ec5-eb40cd67845c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.219459 Jun 20 07:31:31.340965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-461cea82-6e76-46ec-ae5e-4a27dd44fffc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.212851 Jun 20 07:31:31.342023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1026/1936] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:31 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:31.342261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 911/1937] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:31 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:31.346072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-72bcfedb-ad33-42df-bdbb-e893696742d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:31.346686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-72bcfedb-ad33-42df-bdbb-e893696742d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:31.353745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72bcfedb-ad33-42df-bdbb-e893696742d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:31.354190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72bcfedb-ad33-42df-bdbb-e893696742d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:31.354980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72bcfedb-ad33-42df-bdbb-e893696742d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:31.355413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-72bcfedb-ad33-42df-bdbb-e893696742d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:31.420170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-72bcfedb-ad33-42df-bdbb-e893696742d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:31.428744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-72bcfedb-ad33-42df-bdbb-e893696742d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086137 Jun 20 07:31:31.429301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1027/1938] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:31 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:32.359686 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-486066a6-2ace-487a-8cdd-a1dd740c8ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:32.360344 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-486066a6-2ace-487a-8cdd-a1dd740c8ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:32.366799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-486066a6-2ace-487a-8cdd-a1dd740c8ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:32.367254 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-486066a6-2ace-487a-8cdd-a1dd740c8ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:32.368022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-486066a6-2ace-487a-8cdd-a1dd740c8ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:32.368502 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-486066a6-2ace-487a-8cdd-a1dd740c8ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:32.409285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f14fd2f5-1653-4703-a4fd-951f03217c5d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:32.409900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f14fd2f5-1653-4703-a4fd-951f03217c5d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:32.416608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f14fd2f5-1653-4703-a4fd-951f03217c5d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:32.417058 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f14fd2f5-1653-4703-a4fd-951f03217c5d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:32.417827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f14fd2f5-1653-4703-a4fd-951f03217c5d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:32.418264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f14fd2f5-1653-4703-a4fd-951f03217c5d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:32.545863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-486066a6-2ace-487a-8cdd-a1dd740c8ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:32.555081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-486066a6-2ace-487a-8cdd-a1dd740c8ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:32.556775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-486066a6-2ace-487a-8cdd-a1dd740c8ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:32.557949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-486066a6-2ace-487a-8cdd-a1dd740c8ee8 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.202237 Jun 20 07:31:32.558517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 912/1939] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:32 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:32.562872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ee1691c0-48be-44f3-8505-8ace52ee84fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:32.563486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ee1691c0-48be-44f3-8505-8ace52ee84fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:32.569961 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee1691c0-48be-44f3-8505-8ace52ee84fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:32.570419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee1691c0-48be-44f3-8505-8ace52ee84fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:32.571192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee1691c0-48be-44f3-8505-8ace52ee84fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:32.571637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee1691c0-48be-44f3-8505-8ace52ee84fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:32.575889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f14fd2f5-1653-4703-a4fd-951f03217c5d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:32.584059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f14fd2f5-1653-4703-a4fd-951f03217c5d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.178525 Jun 20 07:31:32.584691 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1028/1940] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:32 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:32.586213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:32.632924 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ee1691c0-48be-44f3-8505-8ace52ee84fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:32.640667 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ee1691c0-48be-44f3-8505-8ace52ee84fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081210 Jun 20 07:31:32.641233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 913/1941] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:32 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:33.576946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0761a5f7-726a-4c91-a049-74f1291ca8aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:33.577552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0761a5f7-726a-4c91-a049-74f1291ca8aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:33.584520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0761a5f7-726a-4c91-a049-74f1291ca8aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:33.584967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0761a5f7-726a-4c91-a049-74f1291ca8aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:33.585725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0761a5f7-726a-4c91-a049-74f1291ca8aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:33.586160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0761a5f7-726a-4c91-a049-74f1291ca8aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:33.601768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e155ee35-9d21-4787-881e-f85ad07de7d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:33.602418 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e155ee35-9d21-4787-881e-f85ad07de7d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:33.608903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e155ee35-9d21-4787-881e-f85ad07de7d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:33.609361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e155ee35-9d21-4787-881e-f85ad07de7d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:33.610135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e155ee35-9d21-4787-881e-f85ad07de7d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:33.610576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e155ee35-9d21-4787-881e-f85ad07de7d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:33.779501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0761a5f7-726a-4c91-a049-74f1291ca8aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:33.786047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e155ee35-9d21-4787-881e-f85ad07de7d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:33.788181 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0761a5f7-726a-4c91-a049-74f1291ca8aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:33.789791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0761a5f7-726a-4c91-a049-74f1291ca8aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:33.790950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0761a5f7-726a-4c91-a049-74f1291ca8aa tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.217934 Jun 20 07:31:33.791504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1029/1942] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:33 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:33.794062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e155ee35-9d21-4787-881e-f85ad07de7d2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.196718 Jun 20 07:31:33.794919 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 914/1943] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:33 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:33.795870 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-413e6488-2a9d-4776-a1bc-999ad30d0129 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:33.796503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-413e6488-2a9d-4776-a1bc-999ad30d0129 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:33.802269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-413e6488-2a9d-4776-a1bc-999ad30d0129 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:33.802711 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-413e6488-2a9d-4776-a1bc-999ad30d0129 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:33.803465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-413e6488-2a9d-4776-a1bc-999ad30d0129 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:33.803895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-413e6488-2a9d-4776-a1bc-999ad30d0129 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:33.863212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-413e6488-2a9d-4776-a1bc-999ad30d0129 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:33.871018 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-413e6488-2a9d-4776-a1bc-999ad30d0129 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.078576 Jun 20 07:31:33.871573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1030/1944] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:33 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:34.809376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-892bad8b-ae7f-4ea1-b547-f8a5c0bda455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:34.809999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-892bad8b-ae7f-4ea1-b547-f8a5c0bda455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:34.810531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-61478232-db15-431f-a6b5-28922f4125ec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:34.811150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-61478232-db15-431f-a6b5-28922f4125ec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:34.816752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-892bad8b-ae7f-4ea1-b547-f8a5c0bda455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:34.817117 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61478232-db15-431f-a6b5-28922f4125ec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:34.817239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-892bad8b-ae7f-4ea1-b547-f8a5c0bda455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:34.817621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61478232-db15-431f-a6b5-28922f4125ec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:34.818028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-892bad8b-ae7f-4ea1-b547-f8a5c0bda455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:34.818466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-892bad8b-ae7f-4ea1-b547-f8a5c0bda455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:34.819106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61478232-db15-431f-a6b5-28922f4125ec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:34.819549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61478232-db15-431f-a6b5-28922f4125ec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:35.010518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-892bad8b-ae7f-4ea1-b547-f8a5c0bda455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:35.013411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-61478232-db15-431f-a6b5-28922f4125ec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:35.019104 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-892bad8b-ae7f-4ea1-b547-f8a5c0bda455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:35.021119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-892bad8b-ae7f-4ea1-b547-f8a5c0bda455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:35.021929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-61478232-db15-431f-a6b5-28922f4125ec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.215386 Jun 20 07:31:35.022273 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-892bad8b-ae7f-4ea1-b547-f8a5c0bda455 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.216817 Jun 20 07:31:35.022500 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1031/1945] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:34 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:35.022985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 915/1946] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:34 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:35.027018 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fd9aa887-cbe8-4752-b94c-30f272a3c522 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:35.027627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fd9aa887-cbe8-4752-b94c-30f272a3c522 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:35.033335 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd9aa887-cbe8-4752-b94c-30f272a3c522 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:35.033785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd9aa887-cbe8-4752-b94c-30f272a3c522 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:35.034544 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd9aa887-cbe8-4752-b94c-30f272a3c522 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:35.034982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd9aa887-cbe8-4752-b94c-30f272a3c522 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:35.094320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fd9aa887-cbe8-4752-b94c-30f272a3c522 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:35.096455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:35.103830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fd9aa887-cbe8-4752-b94c-30f272a3c522 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080385 Jun 20 07:31:35.104429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1032/1947] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:35 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:36.039470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-91c02ef7-d4a6-445b-9300-ab053b580e3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:36.040083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-91c02ef7-d4a6-445b-9300-ab053b580e3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:36.040908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c1517ec-7d5b-4419-9706-1495b179a76d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:36.041533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2c1517ec-7d5b-4419-9706-1495b179a76d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:36.046582 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91c02ef7-d4a6-445b-9300-ab053b580e3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:36.047032 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91c02ef7-d4a6-445b-9300-ab053b580e3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:36.047783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91c02ef7-d4a6-445b-9300-ab053b580e3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:36.048072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c1517ec-7d5b-4419-9706-1495b179a76d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:36.048247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91c02ef7-d4a6-445b-9300-ab053b580e3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:36.048562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c1517ec-7d5b-4419-9706-1495b179a76d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:36.049325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c1517ec-7d5b-4419-9706-1495b179a76d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:36.049763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c1517ec-7d5b-4419-9706-1495b179a76d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:36.237598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-91c02ef7-d4a6-445b-9300-ab053b580e3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:36.241615 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c1517ec-7d5b-4419-9706-1495b179a76d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:36.246276 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-91c02ef7-d4a6-445b-9300-ab053b580e3c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.211143 Jun 20 07:31:36.246937 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 916/1948] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:36 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:36.250339 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c1517ec-7d5b-4419-9706-1495b179a76d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:36.251330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a5a42740-58d0-46ac-9b1a-6eeb09a77c3c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:36.251836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c1517ec-7d5b-4419-9706-1495b179a76d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:36.251979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a5a42740-58d0-46ac-9b1a-6eeb09a77c3c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:36.253021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2c1517ec-7d5b-4419-9706-1495b179a76d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.215945 Jun 20 07:31:36.253695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1033/1949] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:36 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:36.264419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5a42740-58d0-46ac-9b1a-6eeb09a77c3c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:36.264895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5a42740-58d0-46ac-9b1a-6eeb09a77c3c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:36.265689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5a42740-58d0-46ac-9b1a-6eeb09a77c3c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:36.266121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5a42740-58d0-46ac-9b1a-6eeb09a77c3c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:36.330819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a5a42740-58d0-46ac-9b1a-6eeb09a77c3c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:36.339172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a5a42740-58d0-46ac-9b1a-6eeb09a77c3c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.091294 Jun 20 07:31:36.339738 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 917/1950] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:36 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:37.262667 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f4739798-5212-4ded-b763-798ec7f16202 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:37.263286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f4739798-5212-4ded-b763-798ec7f16202 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:37.269978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4739798-5212-4ded-b763-798ec7f16202 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:37.270462 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4739798-5212-4ded-b763-798ec7f16202 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:37.271226 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4739798-5212-4ded-b763-798ec7f16202 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:37.271555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad584732-d9db-433a-aa77-dd26f6862b18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:37.271965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4739798-5212-4ded-b763-798ec7f16202 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:37.272207 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ad584732-d9db-433a-aa77-dd26f6862b18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:37.278665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad584732-d9db-433a-aa77-dd26f6862b18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:37.279117 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad584732-d9db-433a-aa77-dd26f6862b18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:37.279879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad584732-d9db-433a-aa77-dd26f6862b18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:37.280355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad584732-d9db-433a-aa77-dd26f6862b18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:37.699162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f4739798-5212-4ded-b763-798ec7f16202 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:37.703166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad584732-d9db-433a-aa77-dd26f6862b18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:37.707519 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f4739798-5212-4ded-b763-798ec7f16202 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.448638 Jun 20 07:31:37.708528 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1034/1951] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:37 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:37.713106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a7db0631-7a40-48da-9714-95599eb265a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:37.713716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a7db0631-7a40-48da-9714-95599eb265a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:37.719509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7db0631-7a40-48da-9714-95599eb265a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:37.719956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7db0631-7a40-48da-9714-95599eb265a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:37.720260 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad584732-d9db-433a-aa77-dd26f6862b18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:37.720752 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7db0631-7a40-48da-9714-95599eb265a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:37.721189 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7db0631-7a40-48da-9714-95599eb265a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:37.721776 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad584732-d9db-433a-aa77-dd26f6862b18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:37.722937 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ad584732-d9db-433a-aa77-dd26f6862b18 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.455432 Jun 20 07:31:37.724319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 918/1952] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:37 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:37.782007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a7db0631-7a40-48da-9714-95599eb265a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:37.790554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a7db0631-7a40-48da-9714-95599eb265a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080976 Jun 20 07:31:37.791147 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1035/1953] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:37 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:38.724569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-906b1753-c794-491d-b3c1-5c5d350543e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:38.725191 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-906b1753-c794-491d-b3c1-5c5d350543e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:38.731676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-906b1753-c794-491d-b3c1-5c5d350543e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:38.732161 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-906b1753-c794-491d-b3c1-5c5d350543e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:38.732930 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-906b1753-c794-491d-b3c1-5c5d350543e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:38.733373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-906b1753-c794-491d-b3c1-5c5d350543e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:38.742145 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3f11dbf0-c5f0-42de-b8f4-12202bb38798 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:38.742756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3f11dbf0-c5f0-42de-b8f4-12202bb38798 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:38.749143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f11dbf0-c5f0-42de-b8f4-12202bb38798 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:38.749584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f11dbf0-c5f0-42de-b8f4-12202bb38798 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:38.750333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f11dbf0-c5f0-42de-b8f4-12202bb38798 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:38.750764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3f11dbf0-c5f0-42de-b8f4-12202bb38798 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:38.930902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-906b1753-c794-491d-b3c1-5c5d350543e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:38.934433 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3f11dbf0-c5f0-42de-b8f4-12202bb38798 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:38.938909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-906b1753-c794-491d-b3c1-5c5d350543e1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.218233 Jun 20 07:31:38.939488 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 919/1954] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:38 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:38.942641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3f11dbf0-c5f0-42de-b8f4-12202bb38798 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:38.943962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf6dc070-f391-4860-bfe2-5e6599e1668e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:38.944374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3f11dbf0-c5f0-42de-b8f4-12202bb38798 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:38.944674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bf6dc070-f391-4860-bfe2-5e6599e1668e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:38.945640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3f11dbf0-c5f0-42de-b8f4-12202bb38798 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.207867 Jun 20 07:31:38.946418 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1036/1955] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:38 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:38.950719 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf6dc070-f391-4860-bfe2-5e6599e1668e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:38.951170 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf6dc070-f391-4860-bfe2-5e6599e1668e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:38.951939 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf6dc070-f391-4860-bfe2-5e6599e1668e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:38.952403 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf6dc070-f391-4860-bfe2-5e6599e1668e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:39.012060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bf6dc070-f391-4860-bfe2-5e6599e1668e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:39.020171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bf6dc070-f391-4860-bfe2-5e6599e1668e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079725 Jun 20 07:31:39.020758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 920/1956] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:38 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:39.955971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-50bcd649-1609-4599-a908-f8e8b98784bf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:39.956894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-50bcd649-1609-4599-a908-f8e8b98784bf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:39.963879 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50bcd649-1609-4599-a908-f8e8b98784bf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:39.964286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50bcd649-1609-4599-a908-f8e8b98784bf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:39.964574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-78373f72-e26a-4716-ad07-f7830e2e4537 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:39.965057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50bcd649-1609-4599-a908-f8e8b98784bf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:39.965170 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-78373f72-e26a-4716-ad07-f7830e2e4537 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:39.965479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50bcd649-1609-4599-a908-f8e8b98784bf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:39.971446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78373f72-e26a-4716-ad07-f7830e2e4537 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:39.971889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78373f72-e26a-4716-ad07-f7830e2e4537 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:39.972882 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78373f72-e26a-4716-ad07-f7830e2e4537 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:39.973350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78373f72-e26a-4716-ad07-f7830e2e4537 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:40.164005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-50bcd649-1609-4599-a908-f8e8b98784bf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:40.168220 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-78373f72-e26a-4716-ad07-f7830e2e4537 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:40.172231 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-50bcd649-1609-4599-a908-f8e8b98784bf tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.220124 Jun 20 07:31:40.172804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1037/1957] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:39 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:40.177187 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-78373f72-e26a-4716-ad07-f7830e2e4537 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:40.177677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8a9d8f62-9753-4885-b9e4-4a53a00804c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:40.178289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8a9d8f62-9753-4885-b9e4-4a53a00804c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:40.178701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-78373f72-e26a-4716-ad07-f7830e2e4537 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:40.179867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-78373f72-e26a-4716-ad07-f7830e2e4537 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.219839 Jun 20 07:31:40.180599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 921/1958] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:39 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:40.184041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a9d8f62-9753-4885-b9e4-4a53a00804c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:40.184529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a9d8f62-9753-4885-b9e4-4a53a00804c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:40.185290 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a9d8f62-9753-4885-b9e4-4a53a00804c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:40.185726 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a9d8f62-9753-4885-b9e4-4a53a00804c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:40.245429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8a9d8f62-9753-4885-b9e4-4a53a00804c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:40.253253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8a9d8f62-9753-4885-b9e4-4a53a00804c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079516 Jun 20 07:31:40.253812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1038/1959] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:40 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:41.189920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f79a9fe1-a1f9-49d1-9692-6a388a3239e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:41.190570 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f79a9fe1-a1f9-49d1-9692-6a388a3239e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:41.197586 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f79a9fe1-a1f9-49d1-9692-6a388a3239e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:41.198042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f79a9fe1-a1f9-49d1-9692-6a388a3239e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:41.198577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-50fb3c78-a283-46e0-9298-18f95ba3cdba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:41.199025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f79a9fe1-a1f9-49d1-9692-6a388a3239e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:41.199195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-50fb3c78-a283-46e0-9298-18f95ba3cdba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:41.199310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f79a9fe1-a1f9-49d1-9692-6a388a3239e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:41.205602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50fb3c78-a283-46e0-9298-18f95ba3cdba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:41.206050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50fb3c78-a283-46e0-9298-18f95ba3cdba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:41.206825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50fb3c78-a283-46e0-9298-18f95ba3cdba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:41.207251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50fb3c78-a283-46e0-9298-18f95ba3cdba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:41.385463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f79a9fe1-a1f9-49d1-9692-6a388a3239e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:41.392579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-50fb3c78-a283-46e0-9298-18f95ba3cdba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:41.393544 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f79a9fe1-a1f9-49d1-9692-6a388a3239e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.207602 Jun 20 07:31:41.394115 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 922/1960] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:41 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:41.399023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0f822404-40b6-437b-bc61-f122d32377c0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:41.399635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0f822404-40b6-437b-bc61-f122d32377c0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:41.402244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-50fb3c78-a283-46e0-9298-18f95ba3cdba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:41.403786 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-50fb3c78-a283-46e0-9298-18f95ba3cdba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:41.405010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-50fb3c78-a283-46e0-9298-18f95ba3cdba tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.210313 Jun 20 07:31:41.405487 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f822404-40b6-437b-bc61-f122d32377c0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:41.405619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1039/1961] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:41 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:41.405973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f822404-40b6-437b-bc61-f122d32377c0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:41.406745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f822404-40b6-437b-bc61-f122d32377c0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:41.407188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f822404-40b6-437b-bc61-f122d32377c0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:41.467550 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0f822404-40b6-437b-bc61-f122d32377c0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:41.475512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0f822404-40b6-437b-bc61-f122d32377c0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080452 Jun 20 07:31:41.476082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 923/1962] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:41 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:42.410383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-af40ef2c-0902-492b-8372-0c3f8689785d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:42.411038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-af40ef2c-0902-492b-8372-0c3f8689785d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:42.417577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af40ef2c-0902-492b-8372-0c3f8689785d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:42.418028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af40ef2c-0902-492b-8372-0c3f8689785d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:42.418790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af40ef2c-0902-492b-8372-0c3f8689785d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:42.419228 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-af40ef2c-0902-492b-8372-0c3f8689785d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:42.423842 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-80a593ff-86f1-4dfe-9953-c8333621a3e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:42.424591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-80a593ff-86f1-4dfe-9953-c8333621a3e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:42.431560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80a593ff-86f1-4dfe-9953-c8333621a3e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:42.432257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80a593ff-86f1-4dfe-9953-c8333621a3e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:42.433031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80a593ff-86f1-4dfe-9953-c8333621a3e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:42.433470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80a593ff-86f1-4dfe-9953-c8333621a3e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:42.620705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-af40ef2c-0902-492b-8372-0c3f8689785d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:42.624648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-80a593ff-86f1-4dfe-9953-c8333621a3e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:42.628554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-af40ef2c-0902-492b-8372-0c3f8689785d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.221995 Jun 20 07:31:42.629121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1040/1963] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:42 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:42.633516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-80a593ff-86f1-4dfe-9953-c8333621a3e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:42.633776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a804f68a-4973-4b4f-9d84-5d007fd32a43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:42.634320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a804f68a-4973-4b4f-9d84-5d007fd32a43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:42.635055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-80a593ff-86f1-4dfe-9953-c8333621a3e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:42.636255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-80a593ff-86f1-4dfe-9953-c8333621a3e4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.216293 Jun 20 07:31:42.637042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 924/1964] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:42 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:42.640236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a804f68a-4973-4b4f-9d84-5d007fd32a43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:42.640636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a804f68a-4973-4b4f-9d84-5d007fd32a43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:42.641402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a804f68a-4973-4b4f-9d84-5d007fd32a43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:42.641839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a804f68a-4973-4b4f-9d84-5d007fd32a43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:42.707183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a804f68a-4973-4b4f-9d84-5d007fd32a43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:42.715176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a804f68a-4973-4b4f-9d84-5d007fd32a43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084860 Jun 20 07:31:42.715745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1041/1965] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:42 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:43.644845 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-affa7b77-124e-431d-954a-58c5896b35d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:43.645496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-affa7b77-124e-431d-954a-58c5896b35d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:43.652071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-affa7b77-124e-431d-954a-58c5896b35d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:43.652569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-affa7b77-124e-431d-954a-58c5896b35d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:43.653339 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-affa7b77-124e-431d-954a-58c5896b35d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:43.653782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-affa7b77-124e-431d-954a-58c5896b35d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:43.654099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e08cae9a-0d1d-4321-bdb5-b4f85ddf1607 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:43.654717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e08cae9a-0d1d-4321-bdb5-b4f85ddf1607 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:43.661982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e08cae9a-0d1d-4321-bdb5-b4f85ddf1607 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:43.662431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e08cae9a-0d1d-4321-bdb5-b4f85ddf1607 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:43.663197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e08cae9a-0d1d-4321-bdb5-b4f85ddf1607 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:43.663645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e08cae9a-0d1d-4321-bdb5-b4f85ddf1607 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:43.851021 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-affa7b77-124e-431d-954a-58c5896b35d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:43.853498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e08cae9a-0d1d-4321-bdb5-b4f85ddf1607 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:43.858906 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-affa7b77-124e-431d-954a-58c5896b35d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.217859 Jun 20 07:31:43.859428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 925/1966] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:43 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:43.861963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e08cae9a-0d1d-4321-bdb5-b4f85ddf1607 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:43.863576 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e08cae9a-0d1d-4321-bdb5-b4f85ddf1607 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:43.863876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-959dcaa7-58f2-4173-8dca-38a77223d279 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:43.864554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-959dcaa7-58f2-4173-8dca-38a77223d279 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:43.864805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e08cae9a-0d1d-4321-bdb5-b4f85ddf1607 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.214511 Jun 20 07:31:43.865548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1042/1967] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:43 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:43.871261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-959dcaa7-58f2-4173-8dca-38a77223d279 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:43.871714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-959dcaa7-58f2-4173-8dca-38a77223d279 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:43.872643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-959dcaa7-58f2-4173-8dca-38a77223d279 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:43.873084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-959dcaa7-58f2-4173-8dca-38a77223d279 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:43.933300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-959dcaa7-58f2-4173-8dca-38a77223d279 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:43.941406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-959dcaa7-58f2-4173-8dca-38a77223d279 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080996 Jun 20 07:31:43.941976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 926/1968] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:43 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:44.875992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8cfc1b3a-88e6-4ab9-96c5-040534dbced6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:44.876657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8cfc1b3a-88e6-4ab9-96c5-040534dbced6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:44.883709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8cfc1b3a-88e6-4ab9-96c5-040534dbced6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:44.884195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8cfc1b3a-88e6-4ab9-96c5-040534dbced6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:44.884395 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ed08962-7089-4eac-b6b4-d81347e2d4a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:44.885008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1ed08962-7089-4eac-b6b4-d81347e2d4a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:44.885128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8cfc1b3a-88e6-4ab9-96c5-040534dbced6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:44.885536 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8cfc1b3a-88e6-4ab9-96c5-040534dbced6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:44.887304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=74 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:44.892537 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ed08962-7089-4eac-b6b4-d81347e2d4a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:44.892990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ed08962-7089-4eac-b6b4-d81347e2d4a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:44.893749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ed08962-7089-4eac-b6b4-d81347e2d4a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:44.894180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ed08962-7089-4eac-b6b4-d81347e2d4a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:45.075500 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8cfc1b3a-88e6-4ab9-96c5-040534dbced6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:45.082169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1ed08962-7089-4eac-b6b4-d81347e2d4a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:45.083585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8cfc1b3a-88e6-4ab9-96c5-040534dbced6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.211445 Jun 20 07:31:45.084174 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1043/1969] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:44 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:45.088831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-470d9ea3-cb0d-44db-8701-5789f3c9f26c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:45.089440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-470d9ea3-cb0d-44db-8701-5789f3c9f26c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:45.090733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1ed08962-7089-4eac-b6b4-d81347e2d4a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:45.092247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1ed08962-7089-4eac-b6b4-d81347e2d4a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:45.093471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1ed08962-7089-4eac-b6b4-d81347e2d4a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 200 len: 1799 microversion: 2.20 time: 0.214770 Jun 20 07:31:45.094030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 927/1970] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:44 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 1799 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:45.095190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-470d9ea3-cb0d-44db-8701-5789f3c9f26c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:45.095647 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-470d9ea3-cb0d-44db-8701-5789f3c9f26c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:45.096434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-470d9ea3-cb0d-44db-8701-5789f3c9f26c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:45.096870 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-470d9ea3-cb0d-44db-8701-5789f3c9f26c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:45.112457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5b805960-5b5b-4176-9f7a-ad05a9351421 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '.version_select at 0x7ffa304849d0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:45.130651 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5b805960-5b5b-4176-9f7a-ad05a9351421 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-373797149" status: 204 len: 0 microversion: 2.20 time: 0.021789 Jun 20 07:31:45.131445 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 928/1971] 10.222.0.23 () {60 vars in 1258 bytes} [Mon Jun 20 07:31:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-373797149 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 20 07:31:45.159939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-470d9ea3-cb0d-44db-8701-5789f3c9f26c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:45.168396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-470d9ea3-cb0d-44db-8701-5789f3c9f26c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083245 Jun 20 07:31:45.168955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1044/1972] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:45 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:46.100659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d7e62136-8995-4366-8cfe-de3fa3471f8c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:46.101309 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d7e62136-8995-4366-8cfe-de3fa3471f8c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:46.107726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7e62136-8995-4366-8cfe-de3fa3471f8c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:46.108210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7e62136-8995-4366-8cfe-de3fa3471f8c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:46.108975 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7e62136-8995-4366-8cfe-de3fa3471f8c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:46.109411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d7e62136-8995-4366-8cfe-de3fa3471f8c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:46.185826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cfd7b7c8-578a-40ec-b46a-0eeb6aeae8ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:46.186910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cfd7b7c8-578a-40ec-b46a-0eeb6aeae8ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:46.193481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cfd7b7c8-578a-40ec-b46a-0eeb6aeae8ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:46.194201 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cfd7b7c8-578a-40ec-b46a-0eeb6aeae8ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:46.194971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cfd7b7c8-578a-40ec-b46a-0eeb6aeae8ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:46.195579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cfd7b7c8-578a-40ec-b46a-0eeb6aeae8ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:46.259604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d7e62136-8995-4366-8cfe-de3fa3471f8c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:46.269563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d7e62136-8995-4366-8cfe-de3fa3471f8c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.172791 Jun 20 07:31:46.280172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 929/1973] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:46 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:46.286379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cfd7b7c8-578a-40ec-b46a-0eeb6aeae8ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:46.295255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cfd7b7c8-578a-40ec-b46a-0eeb6aeae8ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.113195 Jun 20 07:31:46.296492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1045/1974] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:46 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:46.419063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-14347b24-cbb4-4426-aca0-61b31ae9d8c5 req-46345555-45c2-45c5-b976-bae02dab8b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e214060-f046-41a1-b243-020c88edde42", "tag": "316c2317-90c4-4b27-bb5e-34a3153b065e"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:31:46.424138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-86899b8f-33a1-4f69-8131-862f50333be2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Action: 'create', calling method: .version_select at 0x7ffa1fcbb280>, body: {"keypair": {"name": "tempest-keypair-1162129095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjOVw1EFI7Ow4iU92pfhlE+aEQoZ9I0xo+xzNRuKwPSlz6XRW5SlJWNRqHs7yAWeBKSjWP+mfy1jItmy0k4Sats/gr4zMFIe5UurBFUDsCnYO7UWtJaTjsEZdaPW1NuAQ=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:31:46.428687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-14347b24-cbb4-4426-aca0-61b31ae9d8c5 req-46345555-45c2-45c5-b976-bae02dab8b1d service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:46.429338 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-14347b24-cbb4-4426-aca0-61b31ae9d8c5 req-46345555-45c2-45c5-b976-bae02dab8b1d service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:46.429955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=76 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:46.440404 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-86899b8f-33a1-4f69-8131-862f50333be2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Getting quotas for project 530da3341ec44dddbab5b0042706ac7b. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:31:46.442075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-14347b24-cbb4-4426-aca0-61b31ae9d8c5 req-46345555-45c2-45c5-b976-bae02dab8b1d service nova] Creating event network-changed:316c2317-90c4-4b27-bb5e-34a3153b065e for instance 0e214060-f046-41a1-b243-020c88edde42 on hv-cinder-77819 Jun 20 07:31:46.444878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-86899b8f-33a1-4f69-8131-862f50333be2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Getting quotas for user 1c618f9ab8bd47a3a9913078f8ae895e and project 530da3341ec44dddbab5b0042706ac7b. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:31:46.448149 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-14347b24-cbb4-4426-aca0-61b31ae9d8c5 req-46345555-45c2-45c5-b976-bae02dab8b1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166348 Jun 20 07:31:46.448960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 930/1975] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:31:46.473788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-86899b8f-33a1-4f69-8131-862f50333be2 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053990 Jun 20 07:31:46.474626 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1046/1976] 10.222.0.23 () {62 vars in 1199 bytes} [Mon Jun 20 07:31:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 20 07:31:47.287331 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-21c2756d-7a43-4ecc-8f59-a7009c86783f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:47.288042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-21c2756d-7a43-4ecc-8f59-a7009c86783f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:47.294960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21c2756d-7a43-4ecc-8f59-a7009c86783f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:47.295672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21c2756d-7a43-4ecc-8f59-a7009c86783f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:47.296648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21c2756d-7a43-4ecc-8f59-a7009c86783f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:47.299084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21c2756d-7a43-4ecc-8f59-a7009c86783f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:47.312557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4860ec97-41cb-457c-a2c7-698dfda94a41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:47.313811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4860ec97-41cb-457c-a2c7-698dfda94a41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:47.326636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4860ec97-41cb-457c-a2c7-698dfda94a41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:47.327146 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4860ec97-41cb-457c-a2c7-698dfda94a41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:47.327932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4860ec97-41cb-457c-a2c7-698dfda94a41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:47.328737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4860ec97-41cb-457c-a2c7-698dfda94a41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:47.439247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4860ec97-41cb-457c-a2c7-698dfda94a41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:47.451452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4860ec97-41cb-457c-a2c7-698dfda94a41 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.142988 Jun 20 07:31:47.452830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1047/1977] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:47 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:47.609576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-21c2756d-7a43-4ecc-8f59-a7009c86783f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:47.612005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:47.620542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-21c2756d-7a43-4ecc-8f59-a7009c86783f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.337328 Jun 20 07:31:47.621802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 931/1978] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:47 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:47.915529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2110107173", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43f7ac38-a22a-45e1-9bdd-77dcc5cb133f"}], "security_groups": [{"name": "tempest-securitygroup--766349001"}], "key_name": "tempest-keypair-1162129095", "user_data": "}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:31:48.088088 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-13932164-f5f9-46fb-b1bb-d8474803c36f req-bf9e9482-c746-4212-a6de-79e08ff312d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e214060-f046-41a1-b243-020c88edde42", "name": "network-vif-deleted", "tag": "316c2317-90c4-4b27-bb5e-34a3153b065e"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:31:48.095992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] validate_networks() for [('43f7ac38-a22a-45e1-9bdd-77dcc5cb133f', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:31:48.100041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-13932164-f5f9-46fb-b1bb-d8474803c36f req-bf9e9482-c746-4212-a6de-79e08ff312d1 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:48.100576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-13932164-f5f9-46fb-b1bb-d8474803c36f req-bf9e9482-c746-4212-a6de-79e08ff312d1 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:48.113364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-13932164-f5f9-46fb-b1bb-d8474803c36f req-bf9e9482-c746-4212-a6de-79e08ff312d1 service nova] Creating event network-vif-deleted:316c2317-90c4-4b27-bb5e-34a3153b065e for instance 0e214060-f046-41a1-b243-020c88edde42 on hv-cinder-77819 Jun 20 07:31:48.119665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-13932164-f5f9-46fb-b1bb-d8474803c36f req-bf9e9482-c746-4212-a6de-79e08ff312d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035541 Jun 20 07:31:48.120290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 932/1979] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:31:48.468999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0dfb56f1-04f7-4e7d-91db-a220e9774fcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:48.469714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0dfb56f1-04f7-4e7d-91db-a220e9774fcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:48.477391 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f1-04f7-4e7d-91db-a220e9774fcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:48.477844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f1-04f7-4e7d-91db-a220e9774fcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:48.478623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f1-04f7-4e7d-91db-a220e9774fcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:48.479064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0dfb56f1-04f7-4e7d-91db-a220e9774fcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:48.568482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0dfb56f1-04f7-4e7d-91db-a220e9774fcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:48.576338 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0dfb56f1-04f7-4e7d-91db-a220e9774fcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.111470 Jun 20 07:31:48.576911 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 933/1980] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:48 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:48.585939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:31:48.586431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:31:48.586823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:31:48.587230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:31:48.587642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:31:48.596907 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:48.597351 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:48.598796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:48.599234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:48.623687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Getting quotas for project 530da3341ec44dddbab5b0042706ac7b. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:31:48.627965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Getting quotas for user 1c618f9ab8bd47a3a9913078f8ae895e and project 530da3341ec44dddbab5b0042706ac7b. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:31:48.638710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8e3c7038-a471-42b2-89fb-caa58c83f72d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:48.639318 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8e3c7038-a471-42b2-89fb-caa58c83f72d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:48.639458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:31:48.641771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:31:48.646045 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e3c7038-a471-42b2-89fb-caa58c83f72d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:48.646491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e3c7038-a471-42b2-89fb-caa58c83f72d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:48.647246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e3c7038-a471-42b2-89fb-caa58c83f72d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:48.647678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e3c7038-a471-42b2-89fb-caa58c83f72d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:48.690193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e895264-f7ba-410f-a032-35f961261ab9 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.778975 Jun 20 07:31:48.690580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1048/1981] 10.222.0.23 () {62 vars in 1187 bytes} [Mon Jun 20 07:31:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 07:31:48.706040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8682f36c-9a24-45c2-a52c-0549776287d4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:48.706040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8682f36c-9a24-45c2-a52c-0549776287d4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:48.769152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8682f36c-9a24-45c2-a52c-0549776287d4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:48.778911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8682f36c-9a24-45c2-a52c-0549776287d4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:48.780575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8682f36c-9a24-45c2-a52c-0549776287d4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:48.781847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8682f36c-9a24-45c2-a52c-0549776287d4 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 200 len: 1282 microversion: 2.20 time: 0.083203 Jun 20 07:31:48.782474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1049/1982] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:48 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 1282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:48.811060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8e3c7038-a471-42b2-89fb-caa58c83f72d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:48.819357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8e3c7038-a471-42b2-89fb-caa58c83f72d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.184474 Jun 20 07:31:48.819924 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 934/1983] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:48 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:49.593316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-61d9cfad-06fe-4661-ae25-3d55b1967065 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:49.594125 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-61d9cfad-06fe-4661-ae25-3d55b1967065 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:49.603124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61d9cfad-06fe-4661-ae25-3d55b1967065 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:49.603653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61d9cfad-06fe-4661-ae25-3d55b1967065 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:49.604596 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61d9cfad-06fe-4661-ae25-3d55b1967065 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:49.605226 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61d9cfad-06fe-4661-ae25-3d55b1967065 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:49.707586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-61d9cfad-06fe-4661-ae25-3d55b1967065 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:49.718511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-61d9cfad-06fe-4661-ae25-3d55b1967065 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.129268 Jun 20 07:31:49.719611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1050/1984] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:49 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:49.800631 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9bb03b8e-e914-4598-9a3b-dcf0111ec66c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:49.801269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9bb03b8e-e914-4598-9a3b-dcf0111ec66c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:49.807463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bb03b8e-e914-4598-9a3b-dcf0111ec66c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:49.807912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bb03b8e-e914-4598-9a3b-dcf0111ec66c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:49.808705 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bb03b8e-e914-4598-9a3b-dcf0111ec66c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:49.809144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9bb03b8e-e914-4598-9a3b-dcf0111ec66c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:49.836688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2dd7cf85-a2bb-40af-9e63-a60b9c608a50 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:49.837295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2dd7cf85-a2bb-40af-9e63-a60b9c608a50 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:49.843523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2dd7cf85-a2bb-40af-9e63-a60b9c608a50 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:49.843904 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2dd7cf85-a2bb-40af-9e63-a60b9c608a50 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:49.844693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2dd7cf85-a2bb-40af-9e63-a60b9c608a50 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:49.845127 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2dd7cf85-a2bb-40af-9e63-a60b9c608a50 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:49.876740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9bb03b8e-e914-4598-9a3b-dcf0111ec66c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:49.884831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9bb03b8e-e914-4598-9a3b-dcf0111ec66c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:49.886308 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9bb03b8e-e914-4598-9a3b-dcf0111ec66c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:49.887400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9bb03b8e-e914-4598-9a3b-dcf0111ec66c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 200 len: 1340 microversion: 2.20 time: 0.090851 Jun 20 07:31:49.888262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 935/1985] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:49 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:50.049088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2dd7cf85-a2bb-40af-9e63-a60b9c608a50 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:50.057398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2dd7cf85-a2bb-40af-9e63-a60b9c608a50 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.225122 Jun 20 07:31:50.060638 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1051/1986] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:49 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:50.735784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5974446e-fcf7-4562-a10e-cebd5890a4f8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:50.736488 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5974446e-fcf7-4562-a10e-cebd5890a4f8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:50.743154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5974446e-fcf7-4562-a10e-cebd5890a4f8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:50.743600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5974446e-fcf7-4562-a10e-cebd5890a4f8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:50.744388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5974446e-fcf7-4562-a10e-cebd5890a4f8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:50.744823 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5974446e-fcf7-4562-a10e-cebd5890a4f8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:50.831401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5974446e-fcf7-4562-a10e-cebd5890a4f8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:50.839531 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5974446e-fcf7-4562-a10e-cebd5890a4f8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.107578 Jun 20 07:31:50.840334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 936/1987] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:50 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:50.905208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b6be2c53-766b-457f-9e2b-693d0153b1a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:50.905937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b6be2c53-766b-457f-9e2b-693d0153b1a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:50.914367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6be2c53-766b-457f-9e2b-693d0153b1a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:50.917530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6be2c53-766b-457f-9e2b-693d0153b1a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:50.918342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6be2c53-766b-457f-9e2b-693d0153b1a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:50.918799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6be2c53-766b-457f-9e2b-693d0153b1a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:50.923161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:51.074670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-62b36aa0-7277-43c0-8a71-d437d5846ef3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:51.075198 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-62b36aa0-7277-43c0-8a71-d437d5846ef3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:51.081484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62b36aa0-7277-43c0-8a71-d437d5846ef3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:51.081942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62b36aa0-7277-43c0-8a71-d437d5846ef3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:51.082725 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62b36aa0-7277-43c0-8a71-d437d5846ef3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:51.083193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62b36aa0-7277-43c0-8a71-d437d5846ef3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:51.388374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b6be2c53-766b-457f-9e2b-693d0153b1a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:51.397176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b6be2c53-766b-457f-9e2b-693d0153b1a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:51.398697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b6be2c53-766b-457f-9e2b-693d0153b1a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:51.399805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b6be2c53-766b-457f-9e2b-693d0153b1a5 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 200 len: 1407 microversion: 2.20 time: 0.498526 Jun 20 07:31:51.400404 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1052/1988] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:50 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 1407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:51.435080 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-62b36aa0-7277-43c0-8a71-d437d5846ef3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:51.443020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-62b36aa0-7277-43c0-8a71-d437d5846ef3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.372332 Jun 20 07:31:51.443589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 937/1989] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:51 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:51.516941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-bbf315e5-bac9-47a1-97ea-0f65dfa4fc52 req-d6f86bbe-7d7c-49d1-b0d8-6a0abcadb50e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdd4118-f626-4b1f-9e5d-154498c4591f", "tag": "3e9ece88-d42e-47fa-af30-ccc61f18eb30"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:31:51.540482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-bbf315e5-bac9-47a1-97ea-0f65dfa4fc52 req-d6f86bbe-7d7c-49d1-b0d8-6a0abcadb50e service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:51.540929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-bbf315e5-bac9-47a1-97ea-0f65dfa4fc52 req-d6f86bbe-7d7c-49d1-b0d8-6a0abcadb50e service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:51.565903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-bbf315e5-bac9-47a1-97ea-0f65dfa4fc52 req-d6f86bbe-7d7c-49d1-b0d8-6a0abcadb50e service nova] Creating event network-changed:3e9ece88-d42e-47fa-af30-ccc61f18eb30 for instance 5fdd4118-f626-4b1f-9e5d-154498c4591f on hv-cinder-77819 Jun 20 07:31:51.571436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-bbf315e5-bac9-47a1-97ea-0f65dfa4fc52 req-d6f86bbe-7d7c-49d1-b0d8-6a0abcadb50e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059054 Jun 20 07:31:51.573328 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1053/1990] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:31:51.856890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-feb9f772-82e7-4773-9896-1b4b1f2774a7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:51.857603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-feb9f772-82e7-4773-9896-1b4b1f2774a7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:51.864057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-feb9f772-82e7-4773-9896-1b4b1f2774a7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:51.864548 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-feb9f772-82e7-4773-9896-1b4b1f2774a7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:51.865329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-feb9f772-82e7-4773-9896-1b4b1f2774a7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:51.865767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-feb9f772-82e7-4773-9896-1b4b1f2774a7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:51.943477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-feb9f772-82e7-4773-9896-1b4b1f2774a7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:51.951536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-feb9f772-82e7-4773-9896-1b4b1f2774a7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.098540 Jun 20 07:31:51.952131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 938/1991] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:51 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:52.418560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c742772-ecfb-4f10-8e90-16bfd0b9a079 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:52.419258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2c742772-ecfb-4f10-8e90-16bfd0b9a079 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:52.425998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c742772-ecfb-4f10-8e90-16bfd0b9a079 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:52.426470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c742772-ecfb-4f10-8e90-16bfd0b9a079 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:52.427834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c742772-ecfb-4f10-8e90-16bfd0b9a079 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:52.428302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c742772-ecfb-4f10-8e90-16bfd0b9a079 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:52.459835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4cd24210-d578-4531-99cf-b99e2a3e50a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:52.460476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4cd24210-d578-4531-99cf-b99e2a3e50a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:52.466451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cd24210-d578-4531-99cf-b99e2a3e50a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:52.466902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cd24210-d578-4531-99cf-b99e2a3e50a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:52.467661 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cd24210-d578-4531-99cf-b99e2a3e50a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:52.468099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4cd24210-d578-4531-99cf-b99e2a3e50a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:52.605033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c742772-ecfb-4f10-8e90-16bfd0b9a079 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:52.613035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c742772-ecfb-4f10-8e90-16bfd0b9a079 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:52.615243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c742772-ecfb-4f10-8e90-16bfd0b9a079 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:52.616479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2c742772-ecfb-4f10-8e90-16bfd0b9a079 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 200 len: 1407 microversion: 2.20 time: 0.202132 Jun 20 07:31:52.617050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1054/1992] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:52 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:52.638414 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4cd24210-d578-4531-99cf-b99e2a3e50a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:52.647286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4cd24210-d578-4531-99cf-b99e2a3e50a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.191175 Jun 20 07:31:52.647797 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 939/1993] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:52 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:52.969098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-92fbdd0a-2c06-4064-90d6-d81af8edf36a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:52.969715 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-92fbdd0a-2c06-4064-90d6-d81af8edf36a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:52.976564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-92fbdd0a-2c06-4064-90d6-d81af8edf36a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:52.977013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-92fbdd0a-2c06-4064-90d6-d81af8edf36a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:52.977789 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-92fbdd0a-2c06-4064-90d6-d81af8edf36a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:52.978229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-92fbdd0a-2c06-4064-90d6-d81af8edf36a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:53.049154 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-92fbdd0a-2c06-4064-90d6-d81af8edf36a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:53.057164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-92fbdd0a-2c06-4064-90d6-d81af8edf36a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.092176 Jun 20 07:31:53.057765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1055/1994] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:52 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:53.635127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4c10558f-9b92-4771-9a6d-8607cd21dbc3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:53.635741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4c10558f-9b92-4771-9a6d-8607cd21dbc3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:53.642358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c10558f-9b92-4771-9a6d-8607cd21dbc3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:53.642809 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c10558f-9b92-4771-9a6d-8607cd21dbc3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:53.643567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c10558f-9b92-4771-9a6d-8607cd21dbc3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:53.644009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4c10558f-9b92-4771-9a6d-8607cd21dbc3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:53.664439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e2114478-20f6-42e3-a722-d625e639b426 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:53.665145 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e2114478-20f6-42e3-a722-d625e639b426 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:53.671762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2114478-20f6-42e3-a722-d625e639b426 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:53.672330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2114478-20f6-42e3-a722-d625e639b426 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:53.673185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2114478-20f6-42e3-a722-d625e639b426 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:53.673695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e2114478-20f6-42e3-a722-d625e639b426 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:53.835752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4c10558f-9b92-4771-9a6d-8607cd21dbc3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:53.843767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4c10558f-9b92-4771-9a6d-8607cd21dbc3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:53.845309 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4c10558f-9b92-4771-9a6d-8607cd21dbc3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:53.846419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4c10558f-9b92-4771-9a6d-8607cd21dbc3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 200 len: 1407 microversion: 2.20 time: 0.215213 Jun 20 07:31:53.846979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 940/1995] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:53 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:53.856725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e2114478-20f6-42e3-a722-d625e639b426 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:53.864537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e2114478-20f6-42e3-a722-d625e639b426 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.204305 Jun 20 07:31:53.865738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1056/1996] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:53 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:54.073853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-458b93a2-86ec-43c5-abe9-480f6600d0ef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:54.074473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-458b93a2-86ec-43c5-abe9-480f6600d0ef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:54.080524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-458b93a2-86ec-43c5-abe9-480f6600d0ef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:54.080982 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-458b93a2-86ec-43c5-abe9-480f6600d0ef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:54.081740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-458b93a2-86ec-43c5-abe9-480f6600d0ef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:54.082179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-458b93a2-86ec-43c5-abe9-480f6600d0ef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:54.142781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-458b93a2-86ec-43c5-abe9-480f6600d0ef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:54.150645 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-458b93a2-86ec-43c5-abe9-480f6600d0ef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080664 Jun 20 07:31:54.151205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 941/1997] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:54 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:54.864872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3b91ecd2-cc32-49a3-bc28-cfce0a2b8c73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:54.865487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3b91ecd2-cc32-49a3-bc28-cfce0a2b8c73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:54.872137 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3b91ecd2-cc32-49a3-bc28-cfce0a2b8c73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:54.872608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3b91ecd2-cc32-49a3-bc28-cfce0a2b8c73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:54.873567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3b91ecd2-cc32-49a3-bc28-cfce0a2b8c73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:54.873995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3b91ecd2-cc32-49a3-bc28-cfce0a2b8c73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:54.881960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-93247b59-56aa-4146-8196-3fd86c86d008 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:54.882576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-93247b59-56aa-4146-8196-3fd86c86d008 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:54.889840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93247b59-56aa-4146-8196-3fd86c86d008 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:54.890292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93247b59-56aa-4146-8196-3fd86c86d008 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:54.891060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93247b59-56aa-4146-8196-3fd86c86d008 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:54.891497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93247b59-56aa-4146-8196-3fd86c86d008 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:55.100932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3b91ecd2-cc32-49a3-bc28-cfce0a2b8c73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:55.105073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-93247b59-56aa-4146-8196-3fd86c86d008 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:55.109119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3b91ecd2-cc32-49a3-bc28-cfce0a2b8c73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:55.110606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3b91ecd2-cc32-49a3-bc28-cfce0a2b8c73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:55.111702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3b91ecd2-cc32-49a3-bc28-cfce0a2b8c73 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 200 len: 1407 microversion: 2.20 time: 0.250769 Jun 20 07:31:55.112291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1057/1998] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:54 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:55.113836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-93247b59-56aa-4146-8196-3fd86c86d008 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.235808 Jun 20 07:31:55.113836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 942/1999] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:54 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:55.167432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-945d1a4a-5466-4518-a2d8-fbc5c1b817a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:55.168089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-945d1a4a-5466-4518-a2d8-fbc5c1b817a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:55.174212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-945d1a4a-5466-4518-a2d8-fbc5c1b817a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:55.174650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-945d1a4a-5466-4518-a2d8-fbc5c1b817a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:55.175399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-945d1a4a-5466-4518-a2d8-fbc5c1b817a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:55.175833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-945d1a4a-5466-4518-a2d8-fbc5c1b817a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:55.241204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-945d1a4a-5466-4518-a2d8-fbc5c1b817a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:55.249766 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-945d1a4a-5466-4518-a2d8-fbc5c1b817a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086159 Jun 20 07:31:55.250551 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1058/2000] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:55 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:55.466845 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-7320b787-cc78-4d11-b29f-8b63ae879016 req-9113cefd-f009-4d8e-b54e-06bd8ad2c778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdd4118-f626-4b1f-9e5d-154498c4591f", "name": "network-vif-plugged", "status": "completed", "tag": "3e9ece88-d42e-47fa-af30-ccc61f18eb30"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:31:55.475412 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-7320b787-cc78-4d11-b29f-8b63ae879016 req-9113cefd-f009-4d8e-b54e-06bd8ad2c778 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:55.475869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-7320b787-cc78-4d11-b29f-8b63ae879016 req-9113cefd-f009-4d8e-b54e-06bd8ad2c778 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:55.487954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-7320b787-cc78-4d11-b29f-8b63ae879016 req-9113cefd-f009-4d8e-b54e-06bd8ad2c778 service nova] Creating event network-vif-plugged:3e9ece88-d42e-47fa-af30-ccc61f18eb30 for instance 5fdd4118-f626-4b1f-9e5d-154498c4591f on hv-cinder-77819 Jun 20 07:31:55.493560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-7320b787-cc78-4d11-b29f-8b63ae879016 req-9113cefd-f009-4d8e-b54e-06bd8ad2c778 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087852 Jun 20 07:31:55.494074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 943/2001] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:31:56.131328 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-05a260ef-65fb-4712-8f34-1880987397f0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:56.131936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-05a260ef-65fb-4712-8f34-1880987397f0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:56.132274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8918ce1-27b9-4b57-ac50-a3b04af0dd89 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:56.133106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8918ce1-27b9-4b57-ac50-a3b04af0dd89 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:56.138515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-05a260ef-65fb-4712-8f34-1880987397f0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:56.138955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-05a260ef-65fb-4712-8f34-1880987397f0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:56.139181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8918ce1-27b9-4b57-ac50-a3b04af0dd89 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:56.139636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8918ce1-27b9-4b57-ac50-a3b04af0dd89 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:56.139772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-05a260ef-65fb-4712-8f34-1880987397f0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:56.140197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-05a260ef-65fb-4712-8f34-1880987397f0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:56.140431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8918ce1-27b9-4b57-ac50-a3b04af0dd89 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:56.140876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8918ce1-27b9-4b57-ac50-a3b04af0dd89 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:56.335354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-05a260ef-65fb-4712-8f34-1880987397f0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:56.338424 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8918ce1-27b9-4b57-ac50-a3b04af0dd89 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:56.343981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-05a260ef-65fb-4712-8f34-1880987397f0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:56.345537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-05a260ef-65fb-4712-8f34-1880987397f0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:56.346374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8918ce1-27b9-4b57-ac50-a3b04af0dd89 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.219473 Jun 20 07:31:56.346645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-05a260ef-65fb-4712-8f34-1880987397f0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 200 len: 1407 microversion: 2.20 time: 0.220002 Jun 20 07:31:56.346946 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 944/2002] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:56 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:56.356806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1059/2003] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:56 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:31:56.357023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a80bb2a4-2606-44b2-af34-d794ddaae6b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:56.357023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a80bb2a4-2606-44b2-af34-d794ddaae6b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:56.357898 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a80bb2a4-2606-44b2-af34-d794ddaae6b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:56.358351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a80bb2a4-2606-44b2-af34-d794ddaae6b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:56.359115 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a80bb2a4-2606-44b2-af34-d794ddaae6b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:56.359560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a80bb2a4-2606-44b2-af34-d794ddaae6b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:56.423449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a80bb2a4-2606-44b2-af34-d794ddaae6b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:56.431370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a80bb2a4-2606-44b2-af34-d794ddaae6b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083492 Jun 20 07:31:56.431929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 945/2004] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:56 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:57.362690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-135e909f-b9cd-4c9e-9671-7d7a2f7cacec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:57.363363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-135e909f-b9cd-4c9e-9671-7d7a2f7cacec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:57.364239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5196b876-0bba-4b03-a815-70f9676985f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:57.365356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5196b876-0bba-4b03-a815-70f9676985f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:57.370471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-135e909f-b9cd-4c9e-9671-7d7a2f7cacec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:57.370918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-135e909f-b9cd-4c9e-9671-7d7a2f7cacec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:57.371623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5196b876-0bba-4b03-a815-70f9676985f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:57.371745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-135e909f-b9cd-4c9e-9671-7d7a2f7cacec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:57.372063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5196b876-0bba-4b03-a815-70f9676985f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:57.372214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-135e909f-b9cd-4c9e-9671-7d7a2f7cacec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:57.372847 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5196b876-0bba-4b03-a815-70f9676985f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:57.373275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5196b876-0bba-4b03-a815-70f9676985f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:57.571990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-135e909f-b9cd-4c9e-9671-7d7a2f7cacec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:57.575900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5196b876-0bba-4b03-a815-70f9676985f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:57.580674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-135e909f-b9cd-4c9e-9671-7d7a2f7cacec tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.221807 Jun 20 07:31:57.581660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1060/2005] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:57 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:57.585261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5196b876-0bba-4b03-a815-70f9676985f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:57.586510 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4085cbf9-614b-4c05-830f-7f420000c1d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:57.586916 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5196b876-0bba-4b03-a815-70f9676985f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:57.587323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4085cbf9-614b-4c05-830f-7f420000c1d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:57.588432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5196b876-0bba-4b03-a815-70f9676985f6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 200 len: 1599 microversion: 2.20 time: 0.228115 Jun 20 07:31:57.589222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 946/2006] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:31:57 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 07:31:57.594886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4085cbf9-614b-4c05-830f-7f420000c1d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:57.595354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4085cbf9-614b-4c05-830f-7f420000c1d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:57.596138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4085cbf9-614b-4c05-830f-7f420000c1d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:57.596570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4085cbf9-614b-4c05-830f-7f420000c1d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:57.606497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fee09fb8-dabf-42bd-9a29-e076368e6457 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:57.606990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fee09fb8-dabf-42bd-9a29-e076368e6457 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:57.613110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fee09fb8-dabf-42bd-9a29-e076368e6457 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:57.613555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fee09fb8-dabf-42bd-9a29-e076368e6457 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:57.614305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fee09fb8-dabf-42bd-9a29-e076368e6457 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:57.615344 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fee09fb8-dabf-42bd-9a29-e076368e6457 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:57.661417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4085cbf9-614b-4c05-830f-7f420000c1d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:57.669955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4085cbf9-614b-4c05-830f-7f420000c1d0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.087111 Jun 20 07:31:57.670533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1061/2007] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:57 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:57.706647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fee09fb8-dabf-42bd-9a29-e076368e6457 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103843 Jun 20 07:31:57.707245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 947/2008] 10.222.0.23 () {60 vars in 1315 bytes} [Mon Jun 20 07:31:57 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:31:58.598485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5362f674-8861-4119-a000-e4ca031c8ce8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:58.602463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5362f674-8861-4119-a000-e4ca031c8ce8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:58.608423 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5362f674-8861-4119-a000-e4ca031c8ce8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:58.609024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5362f674-8861-4119-a000-e4ca031c8ce8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:58.610245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5362f674-8861-4119-a000-e4ca031c8ce8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:58.610758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5362f674-8861-4119-a000-e4ca031c8ce8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:58.611397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-beaf202e-9784-41c4-83fd-29b0f4f93d76 req-87fefb04-36c1-4ba4-ba80-9c8d9183fc12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdd4118-f626-4b1f-9e5d-154498c4591f", "tag": "3e9ece88-d42e-47fa-af30-ccc61f18eb30"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:31:58.611856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:58.620543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-beaf202e-9784-41c4-83fd-29b0f4f93d76 req-87fefb04-36c1-4ba4-ba80-9c8d9183fc12 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:58.620997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-beaf202e-9784-41c4-83fd-29b0f4f93d76 req-87fefb04-36c1-4ba4-ba80-9c8d9183fc12 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:58.632705 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-beaf202e-9784-41c4-83fd-29b0f4f93d76 req-87fefb04-36c1-4ba4-ba80-9c8d9183fc12 service nova] Creating event network-changed:3e9ece88-d42e-47fa-af30-ccc61f18eb30 for instance 5fdd4118-f626-4b1f-9e5d-154498c4591f on hv-cinder-77819 Jun 20 07:31:58.637769 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-beaf202e-9784-41c4-83fd-29b0f4f93d76 req-87fefb04-36c1-4ba4-ba80-9c8d9183fc12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030746 Jun 20 07:31:58.638552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 948/2009] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:31:58.687523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3e5d2300-4528-4375-948a-a5f6c29c5ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:58.688790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3e5d2300-4528-4375-948a-a5f6c29c5ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:58.695379 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e5d2300-4528-4375-948a-a5f6c29c5ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:58.695913 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e5d2300-4528-4375-948a-a5f6c29c5ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:58.697372 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e5d2300-4528-4375-948a-a5f6c29c5ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:58.697915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3e5d2300-4528-4375-948a-a5f6c29c5ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:58.773816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=12 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:58.796930 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3e5d2300-4528-4375-948a-a5f6c29c5ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:58.806818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3e5d2300-4528-4375-948a-a5f6c29c5ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.123570 Jun 20 07:31:58.816314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 949/2010] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:58 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:31:58.873718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5362f674-8861-4119-a000-e4ca031c8ce8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:58.884041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5362f674-8861-4119-a000-e4ca031c8ce8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.288868 Jun 20 07:31:58.892934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1062/2011] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:58 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:59.824277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-76545703-5e9d-4aad-ae60-eb78e9d4f493 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:59.824937 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-76545703-5e9d-4aad-ae60-eb78e9d4f493 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:59.831448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76545703-5e9d-4aad-ae60-eb78e9d4f493 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:59.831898 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76545703-5e9d-4aad-ae60-eb78e9d4f493 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:59.832690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76545703-5e9d-4aad-ae60-eb78e9d4f493 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:59.833129 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76545703-5e9d-4aad-ae60-eb78e9d4f493 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:59.898100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-76545703-5e9d-4aad-ae60-eb78e9d4f493 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:31:59.900393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:31:59.901312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-61077803-4270-414e-86b1-577306e6967b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:31:59.901891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-61077803-4270-414e-86b1-577306e6967b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:31:59.907921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-76545703-5e9d-4aad-ae60-eb78e9d4f493 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.087482 Jun 20 07:31:59.908390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61077803-4270-414e-86b1-577306e6967b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:59.909225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 950/2012] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:59 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:31:59.909388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61077803-4270-414e-86b1-577306e6967b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:31:59.909674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61077803-4270-414e-86b1-577306e6967b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:31:59.910115 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61077803-4270-414e-86b1-577306e6967b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:00.044760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-61077803-4270-414e-86b1-577306e6967b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:00.053360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-61077803-4270-414e-86b1-577306e6967b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.155922 Jun 20 07:32:00.053935 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1063/2013] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:31:59 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:00.925213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a36486d1-9ff3-4dbb-b1c0-26cf469db394 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:00.925833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a36486d1-9ff3-4dbb-b1c0-26cf469db394 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:00.933062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a36486d1-9ff3-4dbb-b1c0-26cf469db394 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:00.933519 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a36486d1-9ff3-4dbb-b1c0-26cf469db394 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:00.934276 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a36486d1-9ff3-4dbb-b1c0-26cf469db394 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:00.934714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a36486d1-9ff3-4dbb-b1c0-26cf469db394 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:00.995603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a36486d1-9ff3-4dbb-b1c0-26cf469db394 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:01.003474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a36486d1-9ff3-4dbb-b1c0-26cf469db394 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082133 Jun 20 07:32:01.004030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 951/2014] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:00 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:01.070049 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-957ef168-2208-497e-ab19-0d080544b6a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:01.070670 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-957ef168-2208-497e-ab19-0d080544b6a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:01.077074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-957ef168-2208-497e-ab19-0d080544b6a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:01.077526 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-957ef168-2208-497e-ab19-0d080544b6a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:01.078289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-957ef168-2208-497e-ab19-0d080544b6a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:01.078728 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-957ef168-2208-497e-ab19-0d080544b6a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:01.206176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-957ef168-2208-497e-ab19-0d080544b6a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:01.214571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-957ef168-2208-497e-ab19-0d080544b6a3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148373 Jun 20 07:32:01.215144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1064/2015] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:01 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:02.020567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-96b37819-b8a3-4f25-9668-91dddbdf4e81 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:02.021714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-96b37819-b8a3-4f25-9668-91dddbdf4e81 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:02.028137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96b37819-b8a3-4f25-9668-91dddbdf4e81 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:02.028592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96b37819-b8a3-4f25-9668-91dddbdf4e81 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:02.029342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96b37819-b8a3-4f25-9668-91dddbdf4e81 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:02.029774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96b37819-b8a3-4f25-9668-91dddbdf4e81 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:02.090660 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-96b37819-b8a3-4f25-9668-91dddbdf4e81 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:02.098418 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-96b37819-b8a3-4f25-9668-91dddbdf4e81 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081703 Jun 20 07:32:02.099037 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 952/2016] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:02 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:02.231301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e334ad5f-ac15-4e68-84a1-d70857305630 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:02.231922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e334ad5f-ac15-4e68-84a1-d70857305630 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:02.238377 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e334ad5f-ac15-4e68-84a1-d70857305630 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:02.238829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e334ad5f-ac15-4e68-84a1-d70857305630 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:02.239593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e334ad5f-ac15-4e68-84a1-d70857305630 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:02.240034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e334ad5f-ac15-4e68-84a1-d70857305630 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:02.366538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e334ad5f-ac15-4e68-84a1-d70857305630 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:02.374441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e334ad5f-ac15-4e68-84a1-d70857305630 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146963 Jun 20 07:32:02.375011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1065/2017] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:02 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:03.115519 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d10ff01-28c1-4cda-b322-a6e3d077604e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:03.116186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1d10ff01-28c1-4cda-b322-a6e3d077604e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:03.122523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d10ff01-28c1-4cda-b322-a6e3d077604e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:03.122968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d10ff01-28c1-4cda-b322-a6e3d077604e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:03.123717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d10ff01-28c1-4cda-b322-a6e3d077604e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:03.124169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d10ff01-28c1-4cda-b322-a6e3d077604e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:03.187071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1d10ff01-28c1-4cda-b322-a6e3d077604e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:03.194864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1d10ff01-28c1-4cda-b322-a6e3d077604e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083863 Jun 20 07:32:03.195411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 953/2018] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:03 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:03.392306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0447d293-5ea9-4376-a161-5a2d9c73cd79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:03.392847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0447d293-5ea9-4376-a161-5a2d9c73cd79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:03.399840 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0447d293-5ea9-4376-a161-5a2d9c73cd79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:03.400327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0447d293-5ea9-4376-a161-5a2d9c73cd79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:03.401087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0447d293-5ea9-4376-a161-5a2d9c73cd79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:03.401524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0447d293-5ea9-4376-a161-5a2d9c73cd79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:03.526385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0447d293-5ea9-4376-a161-5a2d9c73cd79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:03.534731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0447d293-5ea9-4376-a161-5a2d9c73cd79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146339 Jun 20 07:32:03.535342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1066/2019] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:03 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:04.210773 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7692286a-83b9-495c-936b-71f924f935c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:04.211398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7692286a-83b9-495c-936b-71f924f935c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:04.217959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7692286a-83b9-495c-936b-71f924f935c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:04.218415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7692286a-83b9-495c-936b-71f924f935c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:04.219181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7692286a-83b9-495c-936b-71f924f935c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:04.219625 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7692286a-83b9-495c-936b-71f924f935c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:04.279579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7692286a-83b9-495c-936b-71f924f935c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:04.287889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7692286a-83b9-495c-936b-71f924f935c4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080972 Jun 20 07:32:04.288498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 954/2020] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:04 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:04.552943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-49766daa-dcb4-4064-861d-b1ebf94f20e7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:04.553562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-49766daa-dcb4-4064-861d-b1ebf94f20e7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:04.559600 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49766daa-dcb4-4064-861d-b1ebf94f20e7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:04.560050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49766daa-dcb4-4064-861d-b1ebf94f20e7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:04.560840 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49766daa-dcb4-4064-861d-b1ebf94f20e7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:04.561606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49766daa-dcb4-4064-861d-b1ebf94f20e7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:04.923760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-49766daa-dcb4-4064-861d-b1ebf94f20e7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:04.931760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-49766daa-dcb4-4064-861d-b1ebf94f20e7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.383476 Jun 20 07:32:04.932366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1067/2021] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:04 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:05.305070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0e76da4c-4c9a-4cc8-aea9-2e32ed99fdb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:05.305689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0e76da4c-4c9a-4cc8-aea9-2e32ed99fdb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:05.312181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e76da4c-4c9a-4cc8-aea9-2e32ed99fdb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:05.312640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e76da4c-4c9a-4cc8-aea9-2e32ed99fdb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:05.313397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e76da4c-4c9a-4cc8-aea9-2e32ed99fdb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:05.313837 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e76da4c-4c9a-4cc8-aea9-2e32ed99fdb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:05.373332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0e76da4c-4c9a-4cc8-aea9-2e32ed99fdb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:05.381460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0e76da4c-4c9a-4cc8-aea9-2e32ed99fdb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080856 Jun 20 07:32:05.382020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 955/2022] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:05 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:05.948764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d91e40c3-acaa-44a8-860c-efc2f27af5f0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:05.949313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d91e40c3-acaa-44a8-860c-efc2f27af5f0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:05.955899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d91e40c3-acaa-44a8-860c-efc2f27af5f0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:05.956380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d91e40c3-acaa-44a8-860c-efc2f27af5f0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:05.957140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d91e40c3-acaa-44a8-860c-efc2f27af5f0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:05.957578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d91e40c3-acaa-44a8-860c-efc2f27af5f0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:06.082581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d91e40c3-acaa-44a8-860c-efc2f27af5f0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:06.090533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d91e40c3-acaa-44a8-860c-efc2f27af5f0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145759 Jun 20 07:32:06.091112 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1068/2023] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:05 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:06.398049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4d571ff0-c8ef-4d03-b780-0a48f24e6f8e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:06.398707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4d571ff0-c8ef-4d03-b780-0a48f24e6f8e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:06.405351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d571ff0-c8ef-4d03-b780-0a48f24e6f8e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:06.405799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d571ff0-c8ef-4d03-b780-0a48f24e6f8e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:06.406573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d571ff0-c8ef-4d03-b780-0a48f24e6f8e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:06.407028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d571ff0-c8ef-4d03-b780-0a48f24e6f8e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:06.469904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d571ff0-c8ef-4d03-b780-0a48f24e6f8e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:06.477951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4d571ff0-c8ef-4d03-b780-0a48f24e6f8e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083764 Jun 20 07:32:06.478510 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 956/2024] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:06 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:07.107665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eab881b0-078f-4188-855b-62ca8f82a368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:07.108304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eab881b0-078f-4188-855b-62ca8f82a368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:07.114775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eab881b0-078f-4188-855b-62ca8f82a368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:07.115217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eab881b0-078f-4188-855b-62ca8f82a368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:07.115960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eab881b0-078f-4188-855b-62ca8f82a368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:07.116415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eab881b0-078f-4188-855b-62ca8f82a368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:07.131447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:32:07.242954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eab881b0-078f-4188-855b-62ca8f82a368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:07.250783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eab881b0-078f-4188-855b-62ca8f82a368 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146932 Jun 20 07:32:07.251357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1069/2025] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:07 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:07.496675 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0e7459a6-ef76-44d3-ae55-14194035968f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:07.497222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0e7459a6-ef76-44d3-ae55-14194035968f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:07.503854 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e7459a6-ef76-44d3-ae55-14194035968f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:07.504611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e7459a6-ef76-44d3-ae55-14194035968f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:07.505595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e7459a6-ef76-44d3-ae55-14194035968f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:07.506105 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e7459a6-ef76-44d3-ae55-14194035968f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:07.568587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0e7459a6-ef76-44d3-ae55-14194035968f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:07.576987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0e7459a6-ef76-44d3-ae55-14194035968f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084253 Jun 20 07:32:07.577876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 957/2026] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:07 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:08.268095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1094f26d-5059-4307-b698-1ff29babd100 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:08.268737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1094f26d-5059-4307-b698-1ff29babd100 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:08.275245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1094f26d-5059-4307-b698-1ff29babd100 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:08.275693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1094f26d-5059-4307-b698-1ff29babd100 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:08.276480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1094f26d-5059-4307-b698-1ff29babd100 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:08.276925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1094f26d-5059-4307-b698-1ff29babd100 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:08.407217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1094f26d-5059-4307-b698-1ff29babd100 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:08.415818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1094f26d-5059-4307-b698-1ff29babd100 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151654 Jun 20 07:32:08.416424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1070/2027] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:08 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:08.594908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e62f92d8-070e-4894-ba33-8875b2ce7554 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:08.595464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e62f92d8-070e-4894-ba33-8875b2ce7554 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:08.602572 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e62f92d8-070e-4894-ba33-8875b2ce7554 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:08.603025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e62f92d8-070e-4894-ba33-8875b2ce7554 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:08.603787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e62f92d8-070e-4894-ba33-8875b2ce7554 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:08.604261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e62f92d8-070e-4894-ba33-8875b2ce7554 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:08.664979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e62f92d8-070e-4894-ba33-8875b2ce7554 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:08.673118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e62f92d8-070e-4894-ba33-8875b2ce7554 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082104 Jun 20 07:32:08.673676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 958/2028] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:08 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:09.433232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6d4ad82c-eea9-4bfd-b083-7cab38820a86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:09.433834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6d4ad82c-eea9-4bfd-b083-7cab38820a86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:09.440374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d4ad82c-eea9-4bfd-b083-7cab38820a86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:09.440815 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d4ad82c-eea9-4bfd-b083-7cab38820a86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:09.441558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d4ad82c-eea9-4bfd-b083-7cab38820a86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:09.441985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d4ad82c-eea9-4bfd-b083-7cab38820a86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:09.568076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6d4ad82c-eea9-4bfd-b083-7cab38820a86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:09.575944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6d4ad82c-eea9-4bfd-b083-7cab38820a86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146575 Jun 20 07:32:09.576532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1071/2029] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:09 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:09.688923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b7a2372-04da-4c51-9556-4ff8050b8aca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:09.689540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b7a2372-04da-4c51-9556-4ff8050b8aca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:09.696042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b7a2372-04da-4c51-9556-4ff8050b8aca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:09.696587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b7a2372-04da-4c51-9556-4ff8050b8aca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:09.697353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b7a2372-04da-4c51-9556-4ff8050b8aca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:09.697789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b7a2372-04da-4c51-9556-4ff8050b8aca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:09.761739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b7a2372-04da-4c51-9556-4ff8050b8aca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:09.769643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b7a2372-04da-4c51-9556-4ff8050b8aca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084519 Jun 20 07:32:09.770131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 959/2030] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:09 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:10.592604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dd6c28be-637d-4939-adf8-cca4debfd6d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:10.593227 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dd6c28be-637d-4939-adf8-cca4debfd6d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:10.599696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd6c28be-637d-4939-adf8-cca4debfd6d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:10.600705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd6c28be-637d-4939-adf8-cca4debfd6d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:10.601467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd6c28be-637d-4939-adf8-cca4debfd6d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:10.601904 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dd6c28be-637d-4939-adf8-cca4debfd6d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:10.738877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dd6c28be-637d-4939-adf8-cca4debfd6d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:10.746711 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dd6c28be-637d-4939-adf8-cca4debfd6d9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.157892 Jun 20 07:32:10.747270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1072/2031] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:10 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:10.785290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-26409d43-4963-483e-a210-f317d134dd0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:10.785914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-26409d43-4963-483e-a210-f317d134dd0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:10.793106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26409d43-4963-483e-a210-f317d134dd0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:10.793560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26409d43-4963-483e-a210-f317d134dd0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:10.794324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26409d43-4963-483e-a210-f317d134dd0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:10.794769 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26409d43-4963-483e-a210-f317d134dd0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:10.854493 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-26409d43-4963-483e-a210-f317d134dd0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:10.862278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-26409d43-4963-483e-a210-f317d134dd0e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080777 Jun 20 07:32:10.862837 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 960/2032] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:10 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:11.763806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5f9054b9-fa9c-43f3-84df-9335a206b526 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:11.764454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5f9054b9-fa9c-43f3-84df-9335a206b526 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:11.770853 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f9054b9-fa9c-43f3-84df-9335a206b526 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:11.771296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f9054b9-fa9c-43f3-84df-9335a206b526 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:11.773001 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f9054b9-fa9c-43f3-84df-9335a206b526 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:11.773436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f9054b9-fa9c-43f3-84df-9335a206b526 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:11.878802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-588e32af-feda-4743-96ea-8fd6e71c5959 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:11.879713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-588e32af-feda-4743-96ea-8fd6e71c5959 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:11.886923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-588e32af-feda-4743-96ea-8fd6e71c5959 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:11.887379 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-588e32af-feda-4743-96ea-8fd6e71c5959 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:11.888206 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-588e32af-feda-4743-96ea-8fd6e71c5959 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:11.888676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-588e32af-feda-4743-96ea-8fd6e71c5959 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:11.903429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5f9054b9-fa9c-43f3-84df-9335a206b526 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:11.911356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5f9054b9-fa9c-43f3-84df-9335a206b526 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151468 Jun 20 07:32:11.911919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1073/2033] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:11 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:11.949213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-588e32af-feda-4743-96ea-8fd6e71c5959 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:11.957049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-588e32af-feda-4743-96ea-8fd6e71c5959 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082189 Jun 20 07:32:11.957613 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 961/2034] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:11 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:12.927371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f8c74334-56a5-4d5a-ac12-709e12e5d4c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:12.927983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f8c74334-56a5-4d5a-ac12-709e12e5d4c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:12.934592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8c74334-56a5-4d5a-ac12-709e12e5d4c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:12.935039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8c74334-56a5-4d5a-ac12-709e12e5d4c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:12.935805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8c74334-56a5-4d5a-ac12-709e12e5d4c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:12.936276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f8c74334-56a5-4d5a-ac12-709e12e5d4c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:12.974517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-43e8b91e-acde-4292-bca0-09bcd3c427cd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:12.975712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-43e8b91e-acde-4292-bca0-09bcd3c427cd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:12.982362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43e8b91e-acde-4292-bca0-09bcd3c427cd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:12.982811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43e8b91e-acde-4292-bca0-09bcd3c427cd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:12.983582 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43e8b91e-acde-4292-bca0-09bcd3c427cd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:12.984019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43e8b91e-acde-4292-bca0-09bcd3c427cd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:13.055208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-43e8b91e-acde-4292-bca0-09bcd3c427cd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:13.063208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-43e8b91e-acde-4292-bca0-09bcd3c427cd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.092791 Jun 20 07:32:13.063777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 962/2035] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:12 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:13.085260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f8c74334-56a5-4d5a-ac12-709e12e5d4c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:13.093656 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f8c74334-56a5-4d5a-ac12-709e12e5d4c3 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.170063 Jun 20 07:32:13.094226 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1074/2036] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:12 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:14.079364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bb5e0f5d-ff9a-4242-8cb9-8897742dc695 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:14.079989 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bb5e0f5d-ff9a-4242-8cb9-8897742dc695 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:14.086654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb5e0f5d-ff9a-4242-8cb9-8897742dc695 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:14.087109 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb5e0f5d-ff9a-4242-8cb9-8897742dc695 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:14.087886 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb5e0f5d-ff9a-4242-8cb9-8897742dc695 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:14.088365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb5e0f5d-ff9a-4242-8cb9-8897742dc695 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:14.110537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-68826415-95a5-4f2d-ab62-1f036e6a35ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:14.111147 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-68826415-95a5-4f2d-ab62-1f036e6a35ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:14.118253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68826415-95a5-4f2d-ab62-1f036e6a35ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:14.118706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68826415-95a5-4f2d-ab62-1f036e6a35ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:14.119470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68826415-95a5-4f2d-ab62-1f036e6a35ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:14.119903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68826415-95a5-4f2d-ab62-1f036e6a35ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:14.151965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bb5e0f5d-ff9a-4242-8cb9-8897742dc695 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:14.160003 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bb5e0f5d-ff9a-4242-8cb9-8897742dc695 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084467 Jun 20 07:32:14.160630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 963/2037] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:14 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:14.245293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68826415-95a5-4f2d-ab62-1f036e6a35ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:14.253080 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-68826415-95a5-4f2d-ab62-1f036e6a35ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146342 Jun 20 07:32:14.253640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1075/2038] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:14 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:15.177424 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d0d52f16-31f7-464d-859a-460a4dc25c36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:15.178545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d0d52f16-31f7-464d-859a-460a4dc25c36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:15.180886 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:32:15.186578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0d52f16-31f7-464d-859a-460a4dc25c36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:15.187035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0d52f16-31f7-464d-859a-460a4dc25c36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:15.187793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0d52f16-31f7-464d-859a-460a4dc25c36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:15.188262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0d52f16-31f7-464d-859a-460a4dc25c36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:15.250224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d0d52f16-31f7-464d-859a-460a4dc25c36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:15.258801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d0d52f16-31f7-464d-859a-460a4dc25c36 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085350 Jun 20 07:32:15.259373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 964/2039] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:15 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:15.270115 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9218ea43-f45d-49c2-9ac5-fef9914c0dab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:15.270756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9218ea43-f45d-49c2-9ac5-fef9914c0dab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:15.277095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9218ea43-f45d-49c2-9ac5-fef9914c0dab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:15.277540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9218ea43-f45d-49c2-9ac5-fef9914c0dab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:15.278292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9218ea43-f45d-49c2-9ac5-fef9914c0dab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:15.278721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9218ea43-f45d-49c2-9ac5-fef9914c0dab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:15.410828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9218ea43-f45d-49c2-9ac5-fef9914c0dab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:15.418692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9218ea43-f45d-49c2-9ac5-fef9914c0dab tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.152338 Jun 20 07:32:15.419251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1076/2040] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:15 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:16.275422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f9d34742-4097-4e76-b06f-2267df1032ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:16.276133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f9d34742-4097-4e76-b06f-2267df1032ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:16.282632 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9d34742-4097-4e76-b06f-2267df1032ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:16.283079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9d34742-4097-4e76-b06f-2267df1032ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:16.283833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9d34742-4097-4e76-b06f-2267df1032ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:16.284305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f9d34742-4097-4e76-b06f-2267df1032ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:16.344566 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f9d34742-4097-4e76-b06f-2267df1032ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:16.352950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f9d34742-4097-4e76-b06f-2267df1032ed tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081444 Jun 20 07:32:16.353518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 965/2041] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:16 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:16.436481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea29c8b0-382f-44f4-b45e-0ad16a62da53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:16.437096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ea29c8b0-382f-44f4-b45e-0ad16a62da53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:16.440489 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:32:16.444452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea29c8b0-382f-44f4-b45e-0ad16a62da53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:16.444903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea29c8b0-382f-44f4-b45e-0ad16a62da53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:16.445661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea29c8b0-382f-44f4-b45e-0ad16a62da53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:16.446092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea29c8b0-382f-44f4-b45e-0ad16a62da53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:16.571224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea29c8b0-382f-44f4-b45e-0ad16a62da53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:16.579047 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea29c8b0-382f-44f4-b45e-0ad16a62da53 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146445 Jun 20 07:32:16.579612 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1077/2042] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:16 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:17.369835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b54942c9-1a9c-4036-ae3e-55d2b2841436 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:17.370452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b54942c9-1a9c-4036-ae3e-55d2b2841436 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:17.376935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b54942c9-1a9c-4036-ae3e-55d2b2841436 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:17.377386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b54942c9-1a9c-4036-ae3e-55d2b2841436 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:17.378147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b54942c9-1a9c-4036-ae3e-55d2b2841436 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:17.378583 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b54942c9-1a9c-4036-ae3e-55d2b2841436 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:17.442684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b54942c9-1a9c-4036-ae3e-55d2b2841436 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:17.451186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b54942c9-1a9c-4036-ae3e-55d2b2841436 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085274 Jun 20 07:32:17.451746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 966/2043] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:17 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:17.595751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cacdde1f-3c34-4ac0-a7a3-2d9f0729854e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:17.596388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cacdde1f-3c34-4ac0-a7a3-2d9f0729854e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:17.603415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cacdde1f-3c34-4ac0-a7a3-2d9f0729854e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:17.603861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cacdde1f-3c34-4ac0-a7a3-2d9f0729854e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:17.604648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cacdde1f-3c34-4ac0-a7a3-2d9f0729854e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:17.605084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cacdde1f-3c34-4ac0-a7a3-2d9f0729854e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:17.735428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cacdde1f-3c34-4ac0-a7a3-2d9f0729854e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:17.743323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cacdde1f-3c34-4ac0-a7a3-2d9f0729854e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151468 Jun 20 07:32:17.743882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1078/2044] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:17 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:18.468328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7a43fe45-8031-4b92-b30f-fd38249e799e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:18.468965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7a43fe45-8031-4b92-b30f-fd38249e799e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:18.475318 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a43fe45-8031-4b92-b30f-fd38249e799e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:18.475767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a43fe45-8031-4b92-b30f-fd38249e799e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:18.476542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a43fe45-8031-4b92-b30f-fd38249e799e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:18.476970 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7a43fe45-8031-4b92-b30f-fd38249e799e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:18.491710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:32:18.538527 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7a43fe45-8031-4b92-b30f-fd38249e799e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:18.546426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7a43fe45-8031-4b92-b30f-fd38249e799e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081941 Jun 20 07:32:18.546979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 967/2045] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:18 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:18.760502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cd1d2b03-8ca4-4a0a-94fc-e7031fc808bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:18.761115 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cd1d2b03-8ca4-4a0a-94fc-e7031fc808bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:18.767558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd1d2b03-8ca4-4a0a-94fc-e7031fc808bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:18.768005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd1d2b03-8ca4-4a0a-94fc-e7031fc808bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:18.768791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd1d2b03-8ca4-4a0a-94fc-e7031fc808bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:18.769229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cd1d2b03-8ca4-4a0a-94fc-e7031fc808bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:18.897325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cd1d2b03-8ca4-4a0a-94fc-e7031fc808bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:18.905148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cd1d2b03-8ca4-4a0a-94fc-e7031fc808bb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148533 Jun 20 07:32:18.905705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1079/2046] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:18 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:19.563655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eaa5138a-3e0a-4392-8b83-c6a232ca413a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:19.564307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eaa5138a-3e0a-4392-8b83-c6a232ca413a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:19.570558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eaa5138a-3e0a-4392-8b83-c6a232ca413a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:19.571012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eaa5138a-3e0a-4392-8b83-c6a232ca413a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:19.571774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eaa5138a-3e0a-4392-8b83-c6a232ca413a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:19.572241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eaa5138a-3e0a-4392-8b83-c6a232ca413a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:19.631824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eaa5138a-3e0a-4392-8b83-c6a232ca413a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:19.639759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eaa5138a-3e0a-4392-8b83-c6a232ca413a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079802 Jun 20 07:32:19.640352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 968/2047] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:19 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:19.922638 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4e83579f-85bc-48cb-857d-4be87ef6acbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:19.923151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4e83579f-85bc-48cb-857d-4be87ef6acbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:19.929778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e83579f-85bc-48cb-857d-4be87ef6acbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:19.930222 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e83579f-85bc-48cb-857d-4be87ef6acbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:19.930966 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e83579f-85bc-48cb-857d-4be87ef6acbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:19.931391 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4e83579f-85bc-48cb-857d-4be87ef6acbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:20.059583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4e83579f-85bc-48cb-857d-4be87ef6acbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:20.067564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4e83579f-85bc-48cb-857d-4be87ef6acbe tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148828 Jun 20 07:32:20.068152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1080/2048] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:19 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:20.657120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-384b3c3a-b75d-4245-a31a-bb40276ca226 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:20.657743 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-384b3c3a-b75d-4245-a31a-bb40276ca226 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:20.664868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-384b3c3a-b75d-4245-a31a-bb40276ca226 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:20.665261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-384b3c3a-b75d-4245-a31a-bb40276ca226 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:20.666020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-384b3c3a-b75d-4245-a31a-bb40276ca226 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:20.666455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-384b3c3a-b75d-4245-a31a-bb40276ca226 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:20.730008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-384b3c3a-b75d-4245-a31a-bb40276ca226 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:20.737908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-384b3c3a-b75d-4245-a31a-bb40276ca226 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084835 Jun 20 07:32:20.738477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 969/2049] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:20 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:21.085538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f23a30c7-0fd7-438e-98ff-6f4d6d821d58 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:21.086177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f23a30c7-0fd7-438e-98ff-6f4d6d821d58 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:21.092679 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f23a30c7-0fd7-438e-98ff-6f4d6d821d58 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:21.093126 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f23a30c7-0fd7-438e-98ff-6f4d6d821d58 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:21.093882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f23a30c7-0fd7-438e-98ff-6f4d6d821d58 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:21.094320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f23a30c7-0fd7-438e-98ff-6f4d6d821d58 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:21.220520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f23a30c7-0fd7-438e-98ff-6f4d6d821d58 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:21.228716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f23a30c7-0fd7-438e-98ff-6f4d6d821d58 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147676 Jun 20 07:32:21.229287 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1081/2050] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:21 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:21.754578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-45ffe8f2-c57b-4df5-bc2a-1542ed8c7231 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:21.755196 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-45ffe8f2-c57b-4df5-bc2a-1542ed8c7231 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:21.761770 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45ffe8f2-c57b-4df5-bc2a-1542ed8c7231 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:21.762219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45ffe8f2-c57b-4df5-bc2a-1542ed8c7231 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:21.762979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45ffe8f2-c57b-4df5-bc2a-1542ed8c7231 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:21.763419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45ffe8f2-c57b-4df5-bc2a-1542ed8c7231 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:21.825374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45ffe8f2-c57b-4df5-bc2a-1542ed8c7231 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:21.833565 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-45ffe8f2-c57b-4df5-bc2a-1542ed8c7231 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083144 Jun 20 07:32:21.834125 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 970/2051] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:21 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:22.245660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6db9eb43-6460-4a2e-a451-9a85418cd6d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:22.246274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6db9eb43-6460-4a2e-a451-9a85418cd6d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:22.252720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6db9eb43-6460-4a2e-a451-9a85418cd6d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:22.253163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6db9eb43-6460-4a2e-a451-9a85418cd6d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:22.253918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6db9eb43-6460-4a2e-a451-9a85418cd6d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:22.254615 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6db9eb43-6460-4a2e-a451-9a85418cd6d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:22.385213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6db9eb43-6460-4a2e-a451-9a85418cd6d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:22.392996 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6db9eb43-6460-4a2e-a451-9a85418cd6d4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151222 Jun 20 07:32:22.393562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1082/2052] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:22 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:22.850283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3790dd55-054e-44d5-9a03-30cf91fa056e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:22.850899 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3790dd55-054e-44d5-9a03-30cf91fa056e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:22.857354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3790dd55-054e-44d5-9a03-30cf91fa056e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:22.857812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3790dd55-054e-44d5-9a03-30cf91fa056e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:22.858569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3790dd55-054e-44d5-9a03-30cf91fa056e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:22.859004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3790dd55-054e-44d5-9a03-30cf91fa056e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:22.920919 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3790dd55-054e-44d5-9a03-30cf91fa056e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:22.929166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3790dd55-054e-44d5-9a03-30cf91fa056e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082799 Jun 20 07:32:22.929723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 971/2053] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:22 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:23.410482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f6c9ece6-1dac-4ed2-9089-56a92a5494c5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:23.411130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f6c9ece6-1dac-4ed2-9089-56a92a5494c5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:23.418235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6c9ece6-1dac-4ed2-9089-56a92a5494c5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:23.418693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6c9ece6-1dac-4ed2-9089-56a92a5494c5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:23.419450 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6c9ece6-1dac-4ed2-9089-56a92a5494c5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:23.419887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f6c9ece6-1dac-4ed2-9089-56a92a5494c5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:23.545029 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f6c9ece6-1dac-4ed2-9089-56a92a5494c5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:23.552863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f6c9ece6-1dac-4ed2-9089-56a92a5494c5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146219 Jun 20 07:32:23.553433 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1083/2054] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:23 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:23.946305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f8215217-4853-4577-aa69-e30dff5eeba4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:23.946931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f8215217-4853-4577-aa69-e30dff5eeba4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:23.953415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8215217-4853-4577-aa69-e30dff5eeba4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:23.953870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8215217-4853-4577-aa69-e30dff5eeba4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:23.954636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8215217-4853-4577-aa69-e30dff5eeba4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:23.955079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8215217-4853-4577-aa69-e30dff5eeba4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:24.019110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f8215217-4853-4577-aa69-e30dff5eeba4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:24.027702 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f8215217-4853-4577-aa69-e30dff5eeba4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085814 Jun 20 07:32:24.028291 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 972/2055] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:23 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:24.569266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-979f4a59-129c-4b46-8d4c-3cd10288f57f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:24.569863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-979f4a59-129c-4b46-8d4c-3cd10288f57f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:24.576402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-979f4a59-129c-4b46-8d4c-3cd10288f57f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:24.576878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-979f4a59-129c-4b46-8d4c-3cd10288f57f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:24.577640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-979f4a59-129c-4b46-8d4c-3cd10288f57f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:24.578078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-979f4a59-129c-4b46-8d4c-3cd10288f57f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:24.706164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-979f4a59-129c-4b46-8d4c-3cd10288f57f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:24.715196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-979f4a59-129c-4b46-8d4c-3cd10288f57f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149708 Jun 20 07:32:24.715783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1084/2056] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:24 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:25.044555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8cbaa89e-f88b-43d1-8a69-b40c7efbd678 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:25.045179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8cbaa89e-f88b-43d1-8a69-b40c7efbd678 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:25.051606 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cbaa89e-f88b-43d1-8a69-b40c7efbd678 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:25.052062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cbaa89e-f88b-43d1-8a69-b40c7efbd678 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:25.052861 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cbaa89e-f88b-43d1-8a69-b40c7efbd678 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:25.053305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cbaa89e-f88b-43d1-8a69-b40c7efbd678 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:25.112891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8cbaa89e-f88b-43d1-8a69-b40c7efbd678 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:25.120957 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8cbaa89e-f88b-43d1-8a69-b40c7efbd678 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080320 Jun 20 07:32:25.121516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 973/2057] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:25 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:25.733960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6153211e-4ef1-4d3a-85f2-28d80cd30215 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:25.734583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6153211e-4ef1-4d3a-85f2-28d80cd30215 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:25.740956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6153211e-4ef1-4d3a-85f2-28d80cd30215 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:25.741414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6153211e-4ef1-4d3a-85f2-28d80cd30215 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:25.742186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6153211e-4ef1-4d3a-85f2-28d80cd30215 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:25.742624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6153211e-4ef1-4d3a-85f2-28d80cd30215 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:25.879926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6153211e-4ef1-4d3a-85f2-28d80cd30215 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:25.887814 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6153211e-4ef1-4d3a-85f2-28d80cd30215 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.157671 Jun 20 07:32:25.888421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1085/2058] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:25 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:26.137918 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e3441fb5-2655-4b3c-9b3c-b0dbc0f5e132 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:26.138533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e3441fb5-2655-4b3c-9b3c-b0dbc0f5e132 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:26.144965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3441fb5-2655-4b3c-9b3c-b0dbc0f5e132 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:26.145425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3441fb5-2655-4b3c-9b3c-b0dbc0f5e132 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:26.146183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3441fb5-2655-4b3c-9b3c-b0dbc0f5e132 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:26.147174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3441fb5-2655-4b3c-9b3c-b0dbc0f5e132 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:26.209541 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e3441fb5-2655-4b3c-9b3c-b0dbc0f5e132 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:26.217411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e3441fb5-2655-4b3c-9b3c-b0dbc0f5e132 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083277 Jun 20 07:32:26.217974 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 974/2059] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:26 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:26.905148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-76d5f14b-f3d8-4f59-acc8-b3be09095c62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:26.905763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-76d5f14b-f3d8-4f59-acc8-b3be09095c62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:26.912350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76d5f14b-f3d8-4f59-acc8-b3be09095c62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:26.912800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76d5f14b-f3d8-4f59-acc8-b3be09095c62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:26.913562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76d5f14b-f3d8-4f59-acc8-b3be09095c62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:26.914000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-76d5f14b-f3d8-4f59-acc8-b3be09095c62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:26.916495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:32:27.041182 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-76d5f14b-f3d8-4f59-acc8-b3be09095c62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:27.049011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-76d5f14b-f3d8-4f59-acc8-b3be09095c62 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147711 Jun 20 07:32:27.049571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1086/2060] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:26 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:27.234096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ac3483bb-2ff2-4e89-9ecd-6ee2afddbab6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:27.234714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ac3483bb-2ff2-4e89-9ecd-6ee2afddbab6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:27.241251 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac3483bb-2ff2-4e89-9ecd-6ee2afddbab6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:27.241647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac3483bb-2ff2-4e89-9ecd-6ee2afddbab6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:27.242408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac3483bb-2ff2-4e89-9ecd-6ee2afddbab6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:27.242844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac3483bb-2ff2-4e89-9ecd-6ee2afddbab6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:27.309377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ac3483bb-2ff2-4e89-9ecd-6ee2afddbab6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:27.317270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ac3483bb-2ff2-4e89-9ecd-6ee2afddbab6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.087016 Jun 20 07:32:27.317832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 975/2061] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:27 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:28.066229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8e146451-122e-4de8-85c5-833f803b37c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:28.066840 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8e146451-122e-4de8-85c5-833f803b37c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:28.073339 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e146451-122e-4de8-85c5-833f803b37c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:28.073786 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e146451-122e-4de8-85c5-833f803b37c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:28.074536 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e146451-122e-4de8-85c5-833f803b37c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:28.074970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e146451-122e-4de8-85c5-833f803b37c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:28.200270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8e146451-122e-4de8-85c5-833f803b37c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:28.208240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8e146451-122e-4de8-85c5-833f803b37c7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145859 Jun 20 07:32:28.209345 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1087/2062] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:28 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:28.334701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0cc76350-0087-4c6d-8280-a7e149d4a683 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:28.335288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0cc76350-0087-4c6d-8280-a7e149d4a683 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:28.341769 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cc76350-0087-4c6d-8280-a7e149d4a683 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:28.342222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cc76350-0087-4c6d-8280-a7e149d4a683 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:28.342984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cc76350-0087-4c6d-8280-a7e149d4a683 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:28.343428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0cc76350-0087-4c6d-8280-a7e149d4a683 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:28.404294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0cc76350-0087-4c6d-8280-a7e149d4a683 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:28.412255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0cc76350-0087-4c6d-8280-a7e149d4a683 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081971 Jun 20 07:32:28.413304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 976/2063] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:28 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:29.100482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-085f6cde-1af1-4575-b17f-8d92e08ed13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:29.101014 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-085f6cde-1af1-4575-b17f-8d92e08ed13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:29.107740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-085f6cde-1af1-4575-b17f-8d92e08ed13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:29.108232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-085f6cde-1af1-4575-b17f-8d92e08ed13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:29.109174 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-085f6cde-1af1-4575-b17f-8d92e08ed13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:29.109618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-085f6cde-1af1-4575-b17f-8d92e08ed13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:29.133080 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-085f6cde-1af1-4575-b17f-8d92e08ed13d tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f/ips" status: 200 len: 152 microversion: 2.20 time: 0.037286 Jun 20 07:32:29.133639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1088/2064] 10.222.0.23 () {60 vars in 1288 bytes} [Mon Jun 20 07:32:29 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 07:32:29.226180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-edf8c0c4-2296-4a54-aa6a-d4b646960fe7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:29.226833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-edf8c0c4-2296-4a54-aa6a-d4b646960fe7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:29.232862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-edf8c0c4-2296-4a54-aa6a-d4b646960fe7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:29.233319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-edf8c0c4-2296-4a54-aa6a-d4b646960fe7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:29.234082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-edf8c0c4-2296-4a54-aa6a-d4b646960fe7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:29.234524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-edf8c0c4-2296-4a54-aa6a-d4b646960fe7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:29.366555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-edf8c0c4-2296-4a54-aa6a-d4b646960fe7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:29.374422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-edf8c0c4-2296-4a54-aa6a-d4b646960fe7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.152659 Jun 20 07:32:29.374985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 977/2065] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:29 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:29.428919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c21259b9-b2da-4909-b414-075007b5e08e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:29.429528 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c21259b9-b2da-4909-b414-075007b5e08e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:29.435901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c21259b9-b2da-4909-b414-075007b5e08e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:29.436378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c21259b9-b2da-4909-b414-075007b5e08e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:29.437137 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c21259b9-b2da-4909-b414-075007b5e08e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:29.437569 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c21259b9-b2da-4909-b414-075007b5e08e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:29.498283 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c21259b9-b2da-4909-b414-075007b5e08e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:29.506342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c21259b9-b2da-4909-b414-075007b5e08e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081271 Jun 20 07:32:29.506903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1089/2066] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:29 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:30.391040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b97527d3-fcae-4216-862a-ef46244420fb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:30.391663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b97527d3-fcae-4216-862a-ef46244420fb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:30.398228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b97527d3-fcae-4216-862a-ef46244420fb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:30.398680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b97527d3-fcae-4216-862a-ef46244420fb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:30.399444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b97527d3-fcae-4216-862a-ef46244420fb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:30.399882 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b97527d3-fcae-4216-862a-ef46244420fb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:30.523300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c96a31f5-1025-46d5-ae63-a9b5bb254e6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:30.523934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c96a31f5-1025-46d5-ae63-a9b5bb254e6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:30.525380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b97527d3-fcae-4216-862a-ef46244420fb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:30.530561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c96a31f5-1025-46d5-ae63-a9b5bb254e6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:30.531020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c96a31f5-1025-46d5-ae63-a9b5bb254e6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:30.531785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c96a31f5-1025-46d5-ae63-a9b5bb254e6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:30.532253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c96a31f5-1025-46d5-ae63-a9b5bb254e6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:30.533524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b97527d3-fcae-4216-862a-ef46244420fb tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146355 Jun 20 07:32:30.534093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 978/2067] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:30 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:30.608943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c96a31f5-1025-46d5-ae63-a9b5bb254e6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:30.617432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c96a31f5-1025-46d5-ae63-a9b5bb254e6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.098098 Jun 20 07:32:30.617990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1090/2068] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:30 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:31.550668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fb592a6f-1296-454d-a6bb-337f3bc94b63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:31.551287 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fb592a6f-1296-454d-a6bb-337f3bc94b63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:31.557865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb592a6f-1296-454d-a6bb-337f3bc94b63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:31.558319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb592a6f-1296-454d-a6bb-337f3bc94b63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:31.559082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb592a6f-1296-454d-a6bb-337f3bc94b63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:31.559525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb592a6f-1296-454d-a6bb-337f3bc94b63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:31.634796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9fcc52a4-b0a4-4b7e-acec-36e638bb24d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:31.635920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9fcc52a4-b0a4-4b7e-acec-36e638bb24d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:31.642751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fcc52a4-b0a4-4b7e-acec-36e638bb24d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:31.643199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fcc52a4-b0a4-4b7e-acec-36e638bb24d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:31.643960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fcc52a4-b0a4-4b7e-acec-36e638bb24d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:31.644420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9fcc52a4-b0a4-4b7e-acec-36e638bb24d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:31.713625 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fb592a6f-1296-454d-a6bb-337f3bc94b63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:31.715465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9fcc52a4-b0a4-4b7e-acec-36e638bb24d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:31.723830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9fcc52a4-b0a4-4b7e-acec-36e638bb24d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.093271 Jun 20 07:32:31.724719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1091/2069] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:31 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:31.728046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fb592a6f-1296-454d-a6bb-337f3bc94b63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.181208 Jun 20 07:32:31.730587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 979/2070] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:31 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:32.741243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-50f2190a-c472-4f1b-aa91-d6ec63ae78a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:32.741856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-50f2190a-c472-4f1b-aa91-d6ec63ae78a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:32.745255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-33d914e3-1e42-4408-ad3a-b026fffdf68b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:32.745862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-33d914e3-1e42-4408-ad3a-b026fffdf68b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:32.748672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50f2190a-c472-4f1b-aa91-d6ec63ae78a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:32.749128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50f2190a-c472-4f1b-aa91-d6ec63ae78a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:32.749899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50f2190a-c472-4f1b-aa91-d6ec63ae78a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:32.750337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-50f2190a-c472-4f1b-aa91-d6ec63ae78a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:32.752027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33d914e3-1e42-4408-ad3a-b026fffdf68b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:32.752496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33d914e3-1e42-4408-ad3a-b026fffdf68b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:32.753246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33d914e3-1e42-4408-ad3a-b026fffdf68b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:32.753678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-33d914e3-1e42-4408-ad3a-b026fffdf68b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:32.838165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-50f2190a-c472-4f1b-aa91-d6ec63ae78a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:32.846042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-50f2190a-c472-4f1b-aa91-d6ec63ae78a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.109168 Jun 20 07:32:32.846728 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1092/2071] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:32 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:32.903563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-33d914e3-1e42-4408-ad3a-b026fffdf68b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:32.911357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-33d914e3-1e42-4408-ad3a-b026fffdf68b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.169775 Jun 20 07:32:32.912454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 980/2072] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:32 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:33.863322 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-09f3968e-302b-4ec4-bef5-e1747b465b6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:33.863925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-09f3968e-302b-4ec4-bef5-e1747b465b6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:33.870360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09f3968e-302b-4ec4-bef5-e1747b465b6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:33.870801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09f3968e-302b-4ec4-bef5-e1747b465b6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:33.871544 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09f3968e-302b-4ec4-bef5-e1747b465b6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:33.871973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09f3968e-302b-4ec4-bef5-e1747b465b6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:33.929998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba2d157e-42ab-4904-9b40-c13e0fa43c26 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:33.929998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba2d157e-42ab-4904-9b40-c13e0fa43c26 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:33.931736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-09f3968e-302b-4ec4-bef5-e1747b465b6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:33.936590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba2d157e-42ab-4904-9b40-c13e0fa43c26 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:33.937052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba2d157e-42ab-4904-9b40-c13e0fa43c26 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:33.937827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba2d157e-42ab-4904-9b40-c13e0fa43c26 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:33.938453 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba2d157e-42ab-4904-9b40-c13e0fa43c26 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:33.939502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-09f3968e-302b-4ec4-bef5-e1747b465b6e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079997 Jun 20 07:32:33.940060 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1093/2073] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:33 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:34.070793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ba2d157e-42ab-4904-9b40-c13e0fa43c26 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:34.078614 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba2d157e-42ab-4904-9b40-c13e0fa43c26 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.153698 Jun 20 07:32:34.079173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 981/2074] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:33 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:34.957107 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4a3ddc9d-06b2-409d-be1b-48a73abbf09a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:34.957746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4a3ddc9d-06b2-409d-be1b-48a73abbf09a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:34.964286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a3ddc9d-06b2-409d-be1b-48a73abbf09a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:34.964735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a3ddc9d-06b2-409d-be1b-48a73abbf09a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:34.965488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a3ddc9d-06b2-409d-be1b-48a73abbf09a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:34.965920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4a3ddc9d-06b2-409d-be1b-48a73abbf09a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:35.025604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4a3ddc9d-06b2-409d-be1b-48a73abbf09a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:35.033409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4a3ddc9d-06b2-409d-be1b-48a73abbf09a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080315 Jun 20 07:32:35.033975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1094/2075] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:34 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:35.095506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-36ecc095-6d37-428b-bb33-e9c73953fdd7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:35.096141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-36ecc095-6d37-428b-bb33-e9c73953fdd7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:35.102643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36ecc095-6d37-428b-bb33-e9c73953fdd7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:35.103095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36ecc095-6d37-428b-bb33-e9c73953fdd7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:35.103857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36ecc095-6d37-428b-bb33-e9c73953fdd7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:35.104325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36ecc095-6d37-428b-bb33-e9c73953fdd7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:35.229138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-36ecc095-6d37-428b-bb33-e9c73953fdd7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:35.240807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-36ecc095-6d37-428b-bb33-e9c73953fdd7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149166 Jun 20 07:32:35.241401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 982/2076] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:35 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:36.050233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-043c7c19-d006-4071-a083-560dd4c43665 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:36.050845 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-043c7c19-d006-4071-a083-560dd4c43665 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:36.057903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-043c7c19-d006-4071-a083-560dd4c43665 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:36.058351 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-043c7c19-d006-4071-a083-560dd4c43665 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:36.059105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-043c7c19-d006-4071-a083-560dd4c43665 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:36.059540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-043c7c19-d006-4071-a083-560dd4c43665 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:36.122995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-043c7c19-d006-4071-a083-560dd4c43665 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:36.131637 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-043c7c19-d006-4071-a083-560dd4c43665 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085141 Jun 20 07:32:36.132244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1095/2077] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:36 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:36.259585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aeee740a-6020-40fe-b9f8-be35d4bc75b5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:36.260238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aeee740a-6020-40fe-b9f8-be35d4bc75b5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:36.266695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aeee740a-6020-40fe-b9f8-be35d4bc75b5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:36.267148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aeee740a-6020-40fe-b9f8-be35d4bc75b5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:36.267913 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aeee740a-6020-40fe-b9f8-be35d4bc75b5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:36.268381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aeee740a-6020-40fe-b9f8-be35d4bc75b5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:36.394681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aeee740a-6020-40fe-b9f8-be35d4bc75b5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:36.403055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aeee740a-6020-40fe-b9f8-be35d4bc75b5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147315 Jun 20 07:32:36.403618 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 983/2078] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:36 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:37.148559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-78e2daa3-4874-45ef-94ab-c24ba62fae2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:37.149238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-78e2daa3-4874-45ef-94ab-c24ba62fae2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:37.156087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78e2daa3-4874-45ef-94ab-c24ba62fae2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:37.156564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78e2daa3-4874-45ef-94ab-c24ba62fae2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:37.157343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78e2daa3-4874-45ef-94ab-c24ba62fae2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:37.157774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78e2daa3-4874-45ef-94ab-c24ba62fae2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:37.217756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-78e2daa3-4874-45ef-94ab-c24ba62fae2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:37.225477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-78e2daa3-4874-45ef-94ab-c24ba62fae2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080788 Jun 20 07:32:37.226030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1096/2079] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:37 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:37.420676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-00ea7c59-330e-4841-8ff7-8cf8c788001d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:37.421228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-00ea7c59-330e-4841-8ff7-8cf8c788001d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:37.428323 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00ea7c59-330e-4841-8ff7-8cf8c788001d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:37.428778 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00ea7c59-330e-4841-8ff7-8cf8c788001d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:37.429542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00ea7c59-330e-4841-8ff7-8cf8c788001d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:37.429981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00ea7c59-330e-4841-8ff7-8cf8c788001d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:37.433864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:32:37.563222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-00ea7c59-330e-4841-8ff7-8cf8c788001d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:37.572877 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-00ea7c59-330e-4841-8ff7-8cf8c788001d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.156152 Jun 20 07:32:37.573477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 984/2080] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:37 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:38.242124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-43827ff9-9e18-4b42-a713-c53bcaccb0b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:38.242734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-43827ff9-9e18-4b42-a713-c53bcaccb0b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:38.249144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43827ff9-9e18-4b42-a713-c53bcaccb0b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:38.249584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43827ff9-9e18-4b42-a713-c53bcaccb0b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:38.250326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43827ff9-9e18-4b42-a713-c53bcaccb0b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:38.250755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43827ff9-9e18-4b42-a713-c53bcaccb0b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:38.310345 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-43827ff9-9e18-4b42-a713-c53bcaccb0b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:38.318518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-43827ff9-9e18-4b42-a713-c53bcaccb0b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079802 Jun 20 07:32:38.319068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1097/2081] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:38 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:38.589933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01fba3c5-a7f5-43bf-9c8c-a1fab6aff97c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:38.590544 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01fba3c5-a7f5-43bf-9c8c-a1fab6aff97c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:38.596988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01fba3c5-a7f5-43bf-9c8c-a1fab6aff97c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:38.597431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01fba3c5-a7f5-43bf-9c8c-a1fab6aff97c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:38.598174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01fba3c5-a7f5-43bf-9c8c-a1fab6aff97c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:38.598605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01fba3c5-a7f5-43bf-9c8c-a1fab6aff97c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:38.723918 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01fba3c5-a7f5-43bf-9c8c-a1fab6aff97c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:38.731732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-01fba3c5-a7f5-43bf-9c8c-a1fab6aff97c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145634 Jun 20 07:32:38.732468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 985/2082] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:38 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:39.335233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-91b16fa0-e1a7-4ca5-b293-d3facb938f6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:39.335866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-91b16fa0-e1a7-4ca5-b293-d3facb938f6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:39.342280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91b16fa0-e1a7-4ca5-b293-d3facb938f6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:39.342717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91b16fa0-e1a7-4ca5-b293-d3facb938f6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:39.343460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91b16fa0-e1a7-4ca5-b293-d3facb938f6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:39.343885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91b16fa0-e1a7-4ca5-b293-d3facb938f6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:39.404129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-91b16fa0-e1a7-4ca5-b293-d3facb938f6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:39.412554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-91b16fa0-e1a7-4ca5-b293-d3facb938f6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081620 Jun 20 07:32:39.413107 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1098/2083] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:39 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:39.748676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-08d58b60-6f47-472a-9fa9-4f4f6c9e881d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:39.749288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-08d58b60-6f47-472a-9fa9-4f4f6c9e881d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:39.756514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08d58b60-6f47-472a-9fa9-4f4f6c9e881d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:39.756955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08d58b60-6f47-472a-9fa9-4f4f6c9e881d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:39.757706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08d58b60-6f47-472a-9fa9-4f4f6c9e881d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:39.758133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08d58b60-6f47-472a-9fa9-4f4f6c9e881d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:39.888060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-08d58b60-6f47-472a-9fa9-4f4f6c9e881d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:39.896567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-08d58b60-6f47-472a-9fa9-4f4f6c9e881d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151054 Jun 20 07:32:39.897130 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 986/2084] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:39 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:40.429715 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4d34c911-8c98-4486-9ca5-7654a08f80ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:40.430329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4d34c911-8c98-4486-9ca5-7654a08f80ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:40.436906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d34c911-8c98-4486-9ca5-7654a08f80ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:40.437358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d34c911-8c98-4486-9ca5-7654a08f80ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:40.438121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d34c911-8c98-4486-9ca5-7654a08f80ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:40.438552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d34c911-8c98-4486-9ca5-7654a08f80ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:40.501116 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4d34c911-8c98-4486-9ca5-7654a08f80ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:40.509542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4d34c911-8c98-4486-9ca5-7654a08f80ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084269 Jun 20 07:32:40.510082 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1099/2085] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:40 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:40.913467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5f31633d-7fcb-4fd9-a2ad-b8845114ee01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:40.914076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5f31633d-7fcb-4fd9-a2ad-b8845114ee01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:40.920551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f31633d-7fcb-4fd9-a2ad-b8845114ee01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:40.920992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f31633d-7fcb-4fd9-a2ad-b8845114ee01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:40.921739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f31633d-7fcb-4fd9-a2ad-b8845114ee01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:40.922169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f31633d-7fcb-4fd9-a2ad-b8845114ee01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:41.049626 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5f31633d-7fcb-4fd9-a2ad-b8845114ee01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:41.059590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5f31633d-7fcb-4fd9-a2ad-b8845114ee01 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150546 Jun 20 07:32:41.060188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 987/2086] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:40 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:41.526613 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eb4df29b-b25b-4c6f-8995-70a53e5d9adc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:41.527220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eb4df29b-b25b-4c6f-8995-70a53e5d9adc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:41.533824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb4df29b-b25b-4c6f-8995-70a53e5d9adc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:41.534266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb4df29b-b25b-4c6f-8995-70a53e5d9adc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:41.535017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb4df29b-b25b-4c6f-8995-70a53e5d9adc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:41.535449 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb4df29b-b25b-4c6f-8995-70a53e5d9adc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:41.594969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eb4df29b-b25b-4c6f-8995-70a53e5d9adc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:41.602811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eb4df29b-b25b-4c6f-8995-70a53e5d9adc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080054 Jun 20 07:32:41.603370 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1100/2087] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:41 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:42.077795 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a8413e4a-d2e4-4c9b-890a-6e5f4e12759f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:42.078424 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a8413e4a-d2e4-4c9b-890a-6e5f4e12759f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:42.087417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8413e4a-d2e4-4c9b-890a-6e5f4e12759f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:42.087417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8413e4a-d2e4-4c9b-890a-6e5f4e12759f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:42.087417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8413e4a-d2e4-4c9b-890a-6e5f4e12759f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:42.087417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8413e4a-d2e4-4c9b-890a-6e5f4e12759f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:42.213143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a8413e4a-d2e4-4c9b-890a-6e5f4e12759f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:42.220967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a8413e4a-d2e4-4c9b-890a-6e5f4e12759f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147054 Jun 20 07:32:42.221534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 988/2088] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:42 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:42.619845 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d367c4a3-7941-47a2-b7b5-d97cc48941a3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:42.620493 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d367c4a3-7941-47a2-b7b5-d97cc48941a3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:42.626922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d367c4a3-7941-47a2-b7b5-d97cc48941a3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:42.627366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d367c4a3-7941-47a2-b7b5-d97cc48941a3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:42.628135 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d367c4a3-7941-47a2-b7b5-d97cc48941a3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:42.628591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d367c4a3-7941-47a2-b7b5-d97cc48941a3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:42.689402 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d367c4a3-7941-47a2-b7b5-d97cc48941a3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:42.697377 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d367c4a3-7941-47a2-b7b5-d97cc48941a3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081423 Jun 20 07:32:42.697956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1101/2089] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:42 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:43.238427 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fcdff3c4-b992-4da1-84db-d847a4b76361 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:43.239033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fcdff3c4-b992-4da1-84db-d847a4b76361 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:43.245582 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fcdff3c4-b992-4da1-84db-d847a4b76361 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:43.246029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fcdff3c4-b992-4da1-84db-d847a4b76361 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:43.246816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fcdff3c4-b992-4da1-84db-d847a4b76361 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:43.247249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fcdff3c4-b992-4da1-84db-d847a4b76361 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:43.374792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fcdff3c4-b992-4da1-84db-d847a4b76361 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:43.383448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fcdff3c4-b992-4da1-84db-d847a4b76361 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148904 Jun 20 07:32:43.384006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 989/2090] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:43 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:43.714655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-caa25f84-5f8b-41d8-a66d-037eb0be8e43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:43.715307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-caa25f84-5f8b-41d8-a66d-037eb0be8e43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:43.721896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caa25f84-5f8b-41d8-a66d-037eb0be8e43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:43.722347 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caa25f84-5f8b-41d8-a66d-037eb0be8e43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:43.723107 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caa25f84-5f8b-41d8-a66d-037eb0be8e43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:43.723542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-caa25f84-5f8b-41d8-a66d-037eb0be8e43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:43.783165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-caa25f84-5f8b-41d8-a66d-037eb0be8e43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:43.791545 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-caa25f84-5f8b-41d8-a66d-037eb0be8e43 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080750 Jun 20 07:32:43.792129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1102/2091] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:43 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:44.401133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eabf5c85-40dc-45c0-9984-709b60cc0453 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:44.401750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eabf5c85-40dc-45c0-9984-709b60cc0453 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:44.408225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eabf5c85-40dc-45c0-9984-709b60cc0453 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:44.408676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eabf5c85-40dc-45c0-9984-709b60cc0453 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:44.409431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eabf5c85-40dc-45c0-9984-709b60cc0453 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:44.409869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eabf5c85-40dc-45c0-9984-709b60cc0453 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:44.539148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eabf5c85-40dc-45c0-9984-709b60cc0453 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:44.546926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eabf5c85-40dc-45c0-9984-709b60cc0453 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149705 Jun 20 07:32:44.547519 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 990/2092] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:44 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:44.808978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-51808c10-6f7a-49e7-9249-e69a9ccb798b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:44.809596 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-51808c10-6f7a-49e7-9249-e69a9ccb798b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:44.816033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51808c10-6f7a-49e7-9249-e69a9ccb798b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:44.816513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51808c10-6f7a-49e7-9249-e69a9ccb798b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:44.817270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51808c10-6f7a-49e7-9249-e69a9ccb798b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:44.817772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-51808c10-6f7a-49e7-9249-e69a9ccb798b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:44.820273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:32:44.878489 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-51808c10-6f7a-49e7-9249-e69a9ccb798b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:44.890143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-51808c10-6f7a-49e7-9249-e69a9ccb798b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084713 Jun 20 07:32:44.890790 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1103/2093] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:44 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:45.563497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ae2d8be4-c7ea-4658-8ffd-3f401e3419a9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:45.564130 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ae2d8be4-c7ea-4658-8ffd-3f401e3419a9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:45.566420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=54 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:32:45.572349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ae2d8be4-c7ea-4658-8ffd-3f401e3419a9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:45.572804 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ae2d8be4-c7ea-4658-8ffd-3f401e3419a9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:45.573569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ae2d8be4-c7ea-4658-8ffd-3f401e3419a9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:45.574012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ae2d8be4-c7ea-4658-8ffd-3f401e3419a9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:45.796100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ae2d8be4-c7ea-4658-8ffd-3f401e3419a9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:45.804081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ae2d8be4-c7ea-4658-8ffd-3f401e3419a9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.244459 Jun 20 07:32:45.804672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 991/2094] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:45 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:46.029515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1bd64ea8-a6b0-4c50-bb94-0e88a8c41c89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:46.030135 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1bd64ea8-a6b0-4c50-bb94-0e88a8c41c89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:46.036120 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bd64ea8-a6b0-4c50-bb94-0e88a8c41c89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:46.036589 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bd64ea8-a6b0-4c50-bb94-0e88a8c41c89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:46.037346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bd64ea8-a6b0-4c50-bb94-0e88a8c41c89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:46.037785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bd64ea8-a6b0-4c50-bb94-0e88a8c41c89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:46.101009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1bd64ea8-a6b0-4c50-bb94-0e88a8c41c89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:46.108993 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1bd64ea8-a6b0-4c50-bb94-0e88a8c41c89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.206157 Jun 20 07:32:46.109558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1104/2095] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:45 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:46.820984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bbaaa13f-4d91-40db-8135-3ad6b0daf2a4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:46.821597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bbaaa13f-4d91-40db-8135-3ad6b0daf2a4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:46.828045 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbaaa13f-4d91-40db-8135-3ad6b0daf2a4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:46.828530 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbaaa13f-4d91-40db-8135-3ad6b0daf2a4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:46.829293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbaaa13f-4d91-40db-8135-3ad6b0daf2a4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:46.829739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbaaa13f-4d91-40db-8135-3ad6b0daf2a4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:46.963201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bbaaa13f-4d91-40db-8135-3ad6b0daf2a4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:46.970963 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bbaaa13f-4d91-40db-8135-3ad6b0daf2a4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.153856 Jun 20 07:32:46.971523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 992/2096] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:46 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:47.127758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-662f1c91-fe98-461b-8f16-5cf9f86cedca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:47.128420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-662f1c91-fe98-461b-8f16-5cf9f86cedca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:47.131484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=55 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:32:47.136783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-662f1c91-fe98-461b-8f16-5cf9f86cedca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:47.137230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-662f1c91-fe98-461b-8f16-5cf9f86cedca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:47.137996 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-662f1c91-fe98-461b-8f16-5cf9f86cedca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:47.138435 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-662f1c91-fe98-461b-8f16-5cf9f86cedca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:47.203267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-662f1c91-fe98-461b-8f16-5cf9f86cedca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:47.212044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-662f1c91-fe98-461b-8f16-5cf9f86cedca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.088092 Jun 20 07:32:47.212583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1105/2097] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:47 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:47.988312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-30fda8c1-f881-4a82-b544-b46224490985 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:47.988842 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-30fda8c1-f881-4a82-b544-b46224490985 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:48.002249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30fda8c1-f881-4a82-b544-b46224490985 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:48.002744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30fda8c1-f881-4a82-b544-b46224490985 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:48.003533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30fda8c1-f881-4a82-b544-b46224490985 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:48.004284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30fda8c1-f881-4a82-b544-b46224490985 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:48.137472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-30fda8c1-f881-4a82-b544-b46224490985 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:48.145282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-30fda8c1-f881-4a82-b544-b46224490985 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.160994 Jun 20 07:32:48.146489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 993/2098] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:47 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:48.228503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1afb2643-786b-4963-ba50-5edce97f2d9c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:48.229118 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1afb2643-786b-4963-ba50-5edce97f2d9c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:48.235502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1afb2643-786b-4963-ba50-5edce97f2d9c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:48.235953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1afb2643-786b-4963-ba50-5edce97f2d9c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:48.236753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1afb2643-786b-4963-ba50-5edce97f2d9c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:48.237190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1afb2643-786b-4963-ba50-5edce97f2d9c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:48.299034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1afb2643-786b-4963-ba50-5edce97f2d9c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:48.307353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1afb2643-786b-4963-ba50-5edce97f2d9c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082652 Jun 20 07:32:48.307946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1106/2099] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:48 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:49.163286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c5f24c57-7840-4388-88f0-186e18e7adc7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:49.163899 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c5f24c57-7840-4388-88f0-186e18e7adc7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:49.170341 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5f24c57-7840-4388-88f0-186e18e7adc7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:49.170815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5f24c57-7840-4388-88f0-186e18e7adc7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:49.171567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5f24c57-7840-4388-88f0-186e18e7adc7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:49.172000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5f24c57-7840-4388-88f0-186e18e7adc7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:49.296135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5f24c57-7840-4388-88f0-186e18e7adc7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:49.303938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c5f24c57-7840-4388-88f0-186e18e7adc7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145113 Jun 20 07:32:49.304534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 994/2100] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:49 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:49.324071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-29327259-042e-4bf3-a67c-38ef463a0257 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:49.324787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-29327259-042e-4bf3-a67c-38ef463a0257 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:49.331137 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29327259-042e-4bf3-a67c-38ef463a0257 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:49.331587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29327259-042e-4bf3-a67c-38ef463a0257 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:49.332385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29327259-042e-4bf3-a67c-38ef463a0257 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:49.333413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29327259-042e-4bf3-a67c-38ef463a0257 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:49.392804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29327259-042e-4bf3-a67c-38ef463a0257 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:49.401212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-29327259-042e-4bf3-a67c-38ef463a0257 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080942 Jun 20 07:32:49.401777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1107/2101] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:49 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:50.320827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1da1ae00-1408-4278-8fa8-f74d9788e8b8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:50.321450 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1da1ae00-1408-4278-8fa8-f74d9788e8b8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:50.327592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1da1ae00-1408-4278-8fa8-f74d9788e8b8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:50.328041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1da1ae00-1408-4278-8fa8-f74d9788e8b8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:50.328823 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1da1ae00-1408-4278-8fa8-f74d9788e8b8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:50.329261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1da1ae00-1408-4278-8fa8-f74d9788e8b8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:50.418156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15a3ab5e-def6-4582-8c90-518d47567060 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:50.418799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-15a3ab5e-def6-4582-8c90-518d47567060 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:50.425541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15a3ab5e-def6-4582-8c90-518d47567060 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:50.426341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15a3ab5e-def6-4582-8c90-518d47567060 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:50.427408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15a3ab5e-def6-4582-8c90-518d47567060 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:50.428401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15a3ab5e-def6-4582-8c90-518d47567060 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:50.484177 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1da1ae00-1408-4278-8fa8-f74d9788e8b8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:50.492509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1da1ae00-1408-4278-8fa8-f74d9788e8b8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.176119 Jun 20 07:32:50.493074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 995/2102] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:50 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:50.500135 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-15a3ab5e-def6-4582-8c90-518d47567060 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:50.508779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-15a3ab5e-def6-4582-8c90-518d47567060 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.094866 Jun 20 07:32:50.509337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1108/2103] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:50 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:51.510154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fdc73e8e-ac59-40c0-b2a6-dc7a05916e5b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:51.510775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fdc73e8e-ac59-40c0-b2a6-dc7a05916e5b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:51.517399 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdc73e8e-ac59-40c0-b2a6-dc7a05916e5b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:51.517853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdc73e8e-ac59-40c0-b2a6-dc7a05916e5b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:51.518613 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdc73e8e-ac59-40c0-b2a6-dc7a05916e5b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:51.519078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdc73e8e-ac59-40c0-b2a6-dc7a05916e5b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:51.525817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a4ad1f55-04af-4baa-8732-2d29dc95cbce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:51.526457 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a4ad1f55-04af-4baa-8732-2d29dc95cbce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:51.532889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4ad1f55-04af-4baa-8732-2d29dc95cbce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:51.533342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4ad1f55-04af-4baa-8732-2d29dc95cbce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:51.534134 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4ad1f55-04af-4baa-8732-2d29dc95cbce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:51.534573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a4ad1f55-04af-4baa-8732-2d29dc95cbce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:51.617174 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a4ad1f55-04af-4baa-8732-2d29dc95cbce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:51.625008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a4ad1f55-04af-4baa-8732-2d29dc95cbce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.103626 Jun 20 07:32:51.625579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1109/2104] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:51 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:51.673110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fdc73e8e-ac59-40c0-b2a6-dc7a05916e5b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:51.681730 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fdc73e8e-ac59-40c0-b2a6-dc7a05916e5b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.175976 Jun 20 07:32:51.682308 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 996/2105] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:51 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:52.642082 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-34e83b4d-916e-4896-b923-c69b30de869d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:52.642694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-34e83b4d-916e-4896-b923-c69b30de869d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:52.649687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34e83b4d-916e-4896-b923-c69b30de869d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:52.650134 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34e83b4d-916e-4896-b923-c69b30de869d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:52.650913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34e83b4d-916e-4896-b923-c69b30de869d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:52.651389 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-34e83b4d-916e-4896-b923-c69b30de869d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:52.698986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a4a03199-b3af-4655-be3b-f04f5fa30e63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:52.699522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a4a03199-b3af-4655-be3b-f04f5fa30e63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:52.706104 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4a03199-b3af-4655-be3b-f04f5fa30e63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:52.706569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4a03199-b3af-4655-be3b-f04f5fa30e63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:52.707333 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4a03199-b3af-4655-be3b-f04f5fa30e63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:52.707775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4a03199-b3af-4655-be3b-f04f5fa30e63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:52.712431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-34e83b4d-916e-4896-b923-c69b30de869d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:52.720260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-34e83b4d-916e-4896-b923-c69b30de869d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082041 Jun 20 07:32:52.720829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1110/2106] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:52 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:52.835568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a4a03199-b3af-4655-be3b-f04f5fa30e63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:52.843449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a4a03199-b3af-4655-be3b-f04f5fa30e63 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148617 Jun 20 07:32:52.844012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 997/2107] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:52 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:32:53.737163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f558479f-8871-4fd1-8900-69ce0e2a488b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:53.737767 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f558479f-8871-4fd1-8900-69ce0e2a488b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:53.744702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f558479f-8871-4fd1-8900-69ce0e2a488b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:53.745144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f558479f-8871-4fd1-8900-69ce0e2a488b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:53.745887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f558479f-8871-4fd1-8900-69ce0e2a488b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:53.746312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f558479f-8871-4fd1-8900-69ce0e2a488b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:53.809175 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f558479f-8871-4fd1-8900-69ce0e2a488b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:53.817163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f558479f-8871-4fd1-8900-69ce0e2a488b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083897 Jun 20 07:32:53.817732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1111/2108] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:53 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:53.860805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-47b7b9bd-af2d-42c6-8bd4-f89cd6a57496 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:53.861423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-47b7b9bd-af2d-42c6-8bd4-f89cd6a57496 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:53.868562 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47b7b9bd-af2d-42c6-8bd4-f89cd6a57496 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:53.869010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47b7b9bd-af2d-42c6-8bd4-f89cd6a57496 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:53.869797 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47b7b9bd-af2d-42c6-8bd4-f89cd6a57496 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:53.870236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-47b7b9bd-af2d-42c6-8bd4-f89cd6a57496 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:53.996697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-47b7b9bd-af2d-42c6-8bd4-f89cd6a57496 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:54.004992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-47b7b9bd-af2d-42c6-8bd4-f89cd6a57496 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148032 Jun 20 07:32:54.005552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 998/2109] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:53 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:54.833796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-67ea1752-2afd-47ea-8969-6edf4bc10bae tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:54.834416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-67ea1752-2afd-47ea-8969-6edf4bc10bae tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:54.840921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67ea1752-2afd-47ea-8969-6edf4bc10bae tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:54.841369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67ea1752-2afd-47ea-8969-6edf4bc10bae tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:54.842128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67ea1752-2afd-47ea-8969-6edf4bc10bae tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:54.842567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-67ea1752-2afd-47ea-8969-6edf4bc10bae tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:54.907493 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-67ea1752-2afd-47ea-8969-6edf4bc10bae tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:54.916209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-67ea1752-2afd-47ea-8969-6edf4bc10bae tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086322 Jun 20 07:32:54.916773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1112/2110] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:54 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:55.022348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2a8de4bf-427a-497e-87b7-8c928034a822 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:55.022964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2a8de4bf-427a-497e-87b7-8c928034a822 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:55.029713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a8de4bf-427a-497e-87b7-8c928034a822 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:55.030163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a8de4bf-427a-497e-87b7-8c928034a822 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:55.030924 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a8de4bf-427a-497e-87b7-8c928034a822 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:55.031363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a8de4bf-427a-497e-87b7-8c928034a822 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:55.159401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2a8de4bf-427a-497e-87b7-8c928034a822 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:55.167885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2a8de4bf-427a-497e-87b7-8c928034a822 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149925 Jun 20 07:32:55.168540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 999/2111] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:55 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:55.932751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c137ef7-41d1-423c-ad1b-213dfc443ef7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:55.933362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2c137ef7-41d1-423c-ad1b-213dfc443ef7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:55.939741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c137ef7-41d1-423c-ad1b-213dfc443ef7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:55.940208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c137ef7-41d1-423c-ad1b-213dfc443ef7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:55.940957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c137ef7-41d1-423c-ad1b-213dfc443ef7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:55.941385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2c137ef7-41d1-423c-ad1b-213dfc443ef7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:56.001435 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2c137ef7-41d1-423c-ad1b-213dfc443ef7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:56.010032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2c137ef7-41d1-423c-ad1b-213dfc443ef7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081100 Jun 20 07:32:56.010587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1113/2112] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:55 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:56.184019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ede96672-3170-43c2-9646-b811c149cbe6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:56.184667 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ede96672-3170-43c2-9646-b811c149cbe6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:56.191102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ede96672-3170-43c2-9646-b811c149cbe6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:56.191551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ede96672-3170-43c2-9646-b811c149cbe6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:56.192337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ede96672-3170-43c2-9646-b811c149cbe6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:56.192779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ede96672-3170-43c2-9646-b811c149cbe6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:56.317053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ede96672-3170-43c2-9646-b811c149cbe6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:56.319780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:32:56.326723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ede96672-3170-43c2-9646-b811c149cbe6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146598 Jun 20 07:32:56.327293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1000/2113] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:56 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:57.027443 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-300248a9-e445-41af-940a-339c9d1fd41b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:57.028268 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-300248a9-e445-41af-940a-339c9d1fd41b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:57.035154 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-300248a9-e445-41af-940a-339c9d1fd41b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:57.035606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-300248a9-e445-41af-940a-339c9d1fd41b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:57.036416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-300248a9-e445-41af-940a-339c9d1fd41b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:57.036887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-300248a9-e445-41af-940a-339c9d1fd41b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:57.103702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-300248a9-e445-41af-940a-339c9d1fd41b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:57.114585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-300248a9-e445-41af-940a-339c9d1fd41b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.090705 Jun 20 07:32:57.115157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1114/2114] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:57 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:57.344400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e5a1f701-37f3-4928-af19-a7ff76cb10e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:57.344948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e5a1f701-37f3-4928-af19-a7ff76cb10e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:57.351369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5a1f701-37f3-4928-af19-a7ff76cb10e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:57.351818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5a1f701-37f3-4928-af19-a7ff76cb10e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:57.352601 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5a1f701-37f3-4928-af19-a7ff76cb10e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:57.353040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5a1f701-37f3-4928-af19-a7ff76cb10e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:57.484013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e5a1f701-37f3-4928-af19-a7ff76cb10e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:57.491849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e5a1f701-37f3-4928-af19-a7ff76cb10e9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151502 Jun 20 07:32:57.492431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1001/2115] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:57 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:58.132370 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bd4ce172-e913-4e16-8801-537f62d05a18 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:58.132982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bd4ce172-e913-4e16-8801-537f62d05a18 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:58.139458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd4ce172-e913-4e16-8801-537f62d05a18 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:58.139994 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd4ce172-e913-4e16-8801-537f62d05a18 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:58.140776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd4ce172-e913-4e16-8801-537f62d05a18 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:58.141213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd4ce172-e913-4e16-8801-537f62d05a18 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:58.201112 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bd4ce172-e913-4e16-8801-537f62d05a18 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:58.208994 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bd4ce172-e913-4e16-8801-537f62d05a18 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081391 Jun 20 07:32:58.209557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1115/2116] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:58 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:58.508882 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a6deb318-f6fe-4c41-a11b-d07a3d375fbd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:58.509497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a6deb318-f6fe-4c41-a11b-d07a3d375fbd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:58.515875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6deb318-f6fe-4c41-a11b-d07a3d375fbd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:58.516348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6deb318-f6fe-4c41-a11b-d07a3d375fbd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:58.517096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6deb318-f6fe-4c41-a11b-d07a3d375fbd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:58.517527 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6deb318-f6fe-4c41-a11b-d07a3d375fbd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:58.646560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6deb318-f6fe-4c41-a11b-d07a3d375fbd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:58.654471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a6deb318-f6fe-4c41-a11b-d07a3d375fbd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149416 Jun 20 07:32:58.655052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1002/2117] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:58 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:59.225667 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f5e29b99-7b8d-4110-96aa-a5a186ffc434 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:59.226283 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f5e29b99-7b8d-4110-96aa-a5a186ffc434 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:59.232883 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5e29b99-7b8d-4110-96aa-a5a186ffc434 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:59.233338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5e29b99-7b8d-4110-96aa-a5a186ffc434 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:59.234097 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5e29b99-7b8d-4110-96aa-a5a186ffc434 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:59.234540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5e29b99-7b8d-4110-96aa-a5a186ffc434 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:59.294664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f5e29b99-7b8d-4110-96aa-a5a186ffc434 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:59.302709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f5e29b99-7b8d-4110-96aa-a5a186ffc434 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081011 Jun 20 07:32:59.303274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1116/2118] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:59 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:32:59.671897 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a66dc671-1a38-44b9-b694-d7aeea5e8939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:32:59.672567 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a66dc671-1a38-44b9-b694-d7aeea5e8939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:32:59.679553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a66dc671-1a38-44b9-b694-d7aeea5e8939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:59.680008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a66dc671-1a38-44b9-b694-d7aeea5e8939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:59.680797 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a66dc671-1a38-44b9-b694-d7aeea5e8939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:32:59.681273 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a66dc671-1a38-44b9-b694-d7aeea5e8939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:32:59.809001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a66dc671-1a38-44b9-b694-d7aeea5e8939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:32:59.816774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a66dc671-1a38-44b9-b694-d7aeea5e8939 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148746 Jun 20 07:32:59.817337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1003/2119] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:32:59 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:00.319164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3edbbcf0-479a-4cb7-8b50-74971aec6584 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:00.319780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3edbbcf0-479a-4cb7-8b50-74971aec6584 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:00.326480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3edbbcf0-479a-4cb7-8b50-74971aec6584 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:00.327017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3edbbcf0-479a-4cb7-8b50-74971aec6584 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:00.327937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3edbbcf0-479a-4cb7-8b50-74971aec6584 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:00.328492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3edbbcf0-479a-4cb7-8b50-74971aec6584 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:00.393229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3edbbcf0-479a-4cb7-8b50-74971aec6584 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:00.402098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3edbbcf0-479a-4cb7-8b50-74971aec6584 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086924 Jun 20 07:33:00.402665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1117/2120] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:00 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:00.833762 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-93950423-5b38-4280-9b3e-be07137ec572 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:00.834962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-93950423-5b38-4280-9b3e-be07137ec572 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:00.841418 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93950423-5b38-4280-9b3e-be07137ec572 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:00.841869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93950423-5b38-4280-9b3e-be07137ec572 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:00.842621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93950423-5b38-4280-9b3e-be07137ec572 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:00.843049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93950423-5b38-4280-9b3e-be07137ec572 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:00.972140 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-93950423-5b38-4280-9b3e-be07137ec572 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:00.980032 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-93950423-5b38-4280-9b3e-be07137ec572 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150109 Jun 20 07:33:00.980629 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1004/2121] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:00 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:01.418519 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-227d1eb6-51f4-4ace-b15e-cd59010e5828 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:01.419136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-227d1eb6-51f4-4ace-b15e-cd59010e5828 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:01.427401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-227d1eb6-51f4-4ace-b15e-cd59010e5828 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:01.427848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-227d1eb6-51f4-4ace-b15e-cd59010e5828 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:01.429329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-227d1eb6-51f4-4ace-b15e-cd59010e5828 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:01.430108 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-227d1eb6-51f4-4ace-b15e-cd59010e5828 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:01.489987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-227d1eb6-51f4-4ace-b15e-cd59010e5828 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:01.498522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-227d1eb6-51f4-4ace-b15e-cd59010e5828 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083859 Jun 20 07:33:01.499086 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1118/2122] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:01 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:01.996883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8b799b03-e6f9-47b8-94b9-384eddc9e165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:01.997411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8b799b03-e6f9-47b8-94b9-384eddc9e165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:02.004051 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b799b03-e6f9-47b8-94b9-384eddc9e165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:02.004525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b799b03-e6f9-47b8-94b9-384eddc9e165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:02.005268 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b799b03-e6f9-47b8-94b9-384eddc9e165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:02.005699 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b799b03-e6f9-47b8-94b9-384eddc9e165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:02.134931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8b799b03-e6f9-47b8-94b9-384eddc9e165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:02.142710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8b799b03-e6f9-47b8-94b9-384eddc9e165 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149736 Jun 20 07:33:02.143271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1005/2123] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:01 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:02.514723 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-91cbd959-4a9b-4be6-a26e-d5f603d24598 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:02.515333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-91cbd959-4a9b-4be6-a26e-d5f603d24598 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:02.522510 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91cbd959-4a9b-4be6-a26e-d5f603d24598 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:02.522958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91cbd959-4a9b-4be6-a26e-d5f603d24598 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:02.523709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91cbd959-4a9b-4be6-a26e-d5f603d24598 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:02.524162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-91cbd959-4a9b-4be6-a26e-d5f603d24598 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:02.585067 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-91cbd959-4a9b-4be6-a26e-d5f603d24598 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:02.587210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:33:02.593876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-91cbd959-4a9b-4be6-a26e-d5f603d24598 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082969 Jun 20 07:33:02.594439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1119/2124] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:02 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:03.160404 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-12c8c728-2b16-46b2-ac3a-d47bd04c4ed5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:03.161031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-12c8c728-2b16-46b2-ac3a-d47bd04c4ed5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:03.167497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12c8c728-2b16-46b2-ac3a-d47bd04c4ed5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:03.167965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12c8c728-2b16-46b2-ac3a-d47bd04c4ed5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:03.168767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12c8c728-2b16-46b2-ac3a-d47bd04c4ed5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:03.169205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-12c8c728-2b16-46b2-ac3a-d47bd04c4ed5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:03.293672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-12c8c728-2b16-46b2-ac3a-d47bd04c4ed5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:03.301568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-12c8c728-2b16-46b2-ac3a-d47bd04c4ed5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145101 Jun 20 07:33:03.302130 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1006/2125] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:03 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:03.611325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aaeb747c-8097-4b6b-bb88-c7ba565a4e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:03.611965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aaeb747c-8097-4b6b-bb88-c7ba565a4e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:03.619010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aaeb747c-8097-4b6b-bb88-c7ba565a4e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:03.619458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aaeb747c-8097-4b6b-bb88-c7ba565a4e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:03.620248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aaeb747c-8097-4b6b-bb88-c7ba565a4e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:03.620682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aaeb747c-8097-4b6b-bb88-c7ba565a4e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:03.683293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-aaeb747c-8097-4b6b-bb88-c7ba565a4e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:03.691223 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aaeb747c-8097-4b6b-bb88-c7ba565a4e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083895 Jun 20 07:33:03.691784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1120/2126] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:03 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:04.320531 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d802fb73-686e-4207-82eb-13e8de5c2d39 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:04.321148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d802fb73-686e-4207-82eb-13e8de5c2d39 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:04.327855 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d802fb73-686e-4207-82eb-13e8de5c2d39 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:04.328348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d802fb73-686e-4207-82eb-13e8de5c2d39 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:04.329114 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d802fb73-686e-4207-82eb-13e8de5c2d39 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:04.329585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d802fb73-686e-4207-82eb-13e8de5c2d39 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:04.453781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d802fb73-686e-4207-82eb-13e8de5c2d39 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:04.462315 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d802fb73-686e-4207-82eb-13e8de5c2d39 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146143 Jun 20 07:33:04.462879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1007/2127] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:04 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:04.707887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6303b0da-c3b1-4c9b-8469-25de552e3923 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:04.708428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6303b0da-c3b1-4c9b-8469-25de552e3923 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:04.714723 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6303b0da-c3b1-4c9b-8469-25de552e3923 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:04.715162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6303b0da-c3b1-4c9b-8469-25de552e3923 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:04.715922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6303b0da-c3b1-4c9b-8469-25de552e3923 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:04.716374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6303b0da-c3b1-4c9b-8469-25de552e3923 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:04.776413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6303b0da-c3b1-4c9b-8469-25de552e3923 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:04.784121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6303b0da-c3b1-4c9b-8469-25de552e3923 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080175 Jun 20 07:33:04.784685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1121/2128] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:04 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:05.479470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-079ba5ba-5726-4525-adec-b8f5d36990c1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:05.480093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-079ba5ba-5726-4525-adec-b8f5d36990c1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:05.486631 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-079ba5ba-5726-4525-adec-b8f5d36990c1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:05.487085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-079ba5ba-5726-4525-adec-b8f5d36990c1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:05.487850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-079ba5ba-5726-4525-adec-b8f5d36990c1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:05.488347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-079ba5ba-5726-4525-adec-b8f5d36990c1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:05.614704 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-079ba5ba-5726-4525-adec-b8f5d36990c1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:05.622602 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-079ba5ba-5726-4525-adec-b8f5d36990c1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147529 Jun 20 07:33:05.623162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1008/2129] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:05 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:05.800719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e018ccc9-c32a-4f08-8485-d499f4193435 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:05.801313 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e018ccc9-c32a-4f08-8485-d499f4193435 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:05.807680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e018ccc9-c32a-4f08-8485-d499f4193435 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:05.808148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e018ccc9-c32a-4f08-8485-d499f4193435 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:05.808901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e018ccc9-c32a-4f08-8485-d499f4193435 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:05.809333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e018ccc9-c32a-4f08-8485-d499f4193435 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:05.868775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e018ccc9-c32a-4f08-8485-d499f4193435 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:05.876675 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e018ccc9-c32a-4f08-8485-d499f4193435 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079805 Jun 20 07:33:05.877243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1122/2130] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:05 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:06.639073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bfea97bc-a950-4048-95cc-2ac644df7316 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:06.639691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bfea97bc-a950-4048-95cc-2ac644df7316 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:06.646246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfea97bc-a950-4048-95cc-2ac644df7316 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:06.646699 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfea97bc-a950-4048-95cc-2ac644df7316 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:06.647458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfea97bc-a950-4048-95cc-2ac644df7316 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:06.647899 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfea97bc-a950-4048-95cc-2ac644df7316 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:06.771907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bfea97bc-a950-4048-95cc-2ac644df7316 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:06.779808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bfea97bc-a950-4048-95cc-2ac644df7316 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.144592 Jun 20 07:33:06.780403 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1009/2131] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:06 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:06.894063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1dd4e2fd-2bdc-4659-a4f2-e9e3a4943dc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:06.894668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1dd4e2fd-2bdc-4659-a4f2-e9e3a4943dc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:06.901596 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1dd4e2fd-2bdc-4659-a4f2-e9e3a4943dc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:06.902041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1dd4e2fd-2bdc-4659-a4f2-e9e3a4943dc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:06.902805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1dd4e2fd-2bdc-4659-a4f2-e9e3a4943dc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:06.903218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1dd4e2fd-2bdc-4659-a4f2-e9e3a4943dc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:06.966270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1dd4e2fd-2bdc-4659-a4f2-e9e3a4943dc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:06.974084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1dd4e2fd-2bdc-4659-a4f2-e9e3a4943dc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083818 Jun 20 07:33:06.974638 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1123/2132] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:06 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:07.797246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-69cd5b18-ddee-44c7-b37e-1cbee7cf06ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:07.797865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-69cd5b18-ddee-44c7-b37e-1cbee7cf06ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:07.804360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69cd5b18-ddee-44c7-b37e-1cbee7cf06ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:07.804810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69cd5b18-ddee-44c7-b37e-1cbee7cf06ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:07.805568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69cd5b18-ddee-44c7-b37e-1cbee7cf06ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:07.806011 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69cd5b18-ddee-44c7-b37e-1cbee7cf06ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:07.932466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-69cd5b18-ddee-44c7-b37e-1cbee7cf06ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:07.940346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-69cd5b18-ddee-44c7-b37e-1cbee7cf06ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146954 Jun 20 07:33:07.940913 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1010/2133] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:07 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:07.991633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-be5b54d0-e19d-4a70-9884-f1d2dee7e12b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:07.992303 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-be5b54d0-e19d-4a70-9884-f1d2dee7e12b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:07.998824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be5b54d0-e19d-4a70-9884-f1d2dee7e12b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:07.999275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be5b54d0-e19d-4a70-9884-f1d2dee7e12b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:08.000037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be5b54d0-e19d-4a70-9884-f1d2dee7e12b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:08.000503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-be5b54d0-e19d-4a70-9884-f1d2dee7e12b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:08.060646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-be5b54d0-e19d-4a70-9884-f1d2dee7e12b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:08.070096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-be5b54d0-e19d-4a70-9884-f1d2dee7e12b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082310 Jun 20 07:33:08.070669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1124/2134] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:07 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:08.957438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c08ec24d-0416-49e6-8a24-961e460d99aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:08.957971 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c08ec24d-0416-49e6-8a24-961e460d99aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:08.965041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c08ec24d-0416-49e6-8a24-961e460d99aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:08.965486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c08ec24d-0416-49e6-8a24-961e460d99aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:08.966234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c08ec24d-0416-49e6-8a24-961e460d99aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:08.966667 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c08ec24d-0416-49e6-8a24-961e460d99aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:09.087316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1e41d1ee-3cb2-43e1-9505-181e61f6bac9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:09.088050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1e41d1ee-3cb2-43e1-9505-181e61f6bac9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:09.094699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e41d1ee-3cb2-43e1-9505-181e61f6bac9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:09.095156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e41d1ee-3cb2-43e1-9505-181e61f6bac9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:09.096024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e41d1ee-3cb2-43e1-9505-181e61f6bac9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:09.096399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e41d1ee-3cb2-43e1-9505-181e61f6bac9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:09.097921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c08ec24d-0416-49e6-8a24-961e460d99aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:09.108467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c08ec24d-0416-49e6-8a24-961e460d99aa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.154763 Jun 20 07:33:09.109167 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1011/2135] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:08 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:09.159384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1e41d1ee-3cb2-43e1-9505-181e61f6bac9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:09.167176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1e41d1ee-3cb2-43e1-9505-181e61f6bac9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084343 Jun 20 07:33:09.167744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1125/2136] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:09 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:10.125321 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cdc4bea8-349e-44c7-a6b8-295b8f562d20 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:10.125944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cdc4bea8-349e-44c7-a6b8-295b8f562d20 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:10.132702 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cdc4bea8-349e-44c7-a6b8-295b8f562d20 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:10.133156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cdc4bea8-349e-44c7-a6b8-295b8f562d20 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:10.133928 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cdc4bea8-349e-44c7-a6b8-295b8f562d20 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:10.134369 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cdc4bea8-349e-44c7-a6b8-295b8f562d20 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:10.183772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bee94d57-d93d-431e-8b34-340f58e8b5fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:10.184420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bee94d57-d93d-431e-8b34-340f58e8b5fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:10.190920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bee94d57-d93d-431e-8b34-340f58e8b5fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:10.191374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bee94d57-d93d-431e-8b34-340f58e8b5fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:10.192169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bee94d57-d93d-431e-8b34-340f58e8b5fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:10.192610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bee94d57-d93d-431e-8b34-340f58e8b5fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:10.268088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bee94d57-d93d-431e-8b34-340f58e8b5fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:10.276573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bee94d57-d93d-431e-8b34-340f58e8b5fd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.096619 Jun 20 07:33:10.277149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1126/2137] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:10 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:10.284819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cdc4bea8-349e-44c7-a6b8-295b8f562d20 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:10.292765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cdc4bea8-349e-44c7-a6b8-295b8f562d20 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.171383 Jun 20 07:33:10.293320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1012/2138] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:10 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:11.293495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-60dd4db7-e16f-4b69-8065-bba69717c36f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:11.294104 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-60dd4db7-e16f-4b69-8065-bba69717c36f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:11.300597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60dd4db7-e16f-4b69-8065-bba69717c36f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:11.301044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60dd4db7-e16f-4b69-8065-bba69717c36f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:11.301797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60dd4db7-e16f-4b69-8065-bba69717c36f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:11.302230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60dd4db7-e16f-4b69-8065-bba69717c36f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:11.309834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0b18f78-b9bd-45ac-aabc-b75e7ca81a68 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:11.310442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f0b18f78-b9bd-45ac-aabc-b75e7ca81a68 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:11.316806 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0b18f78-b9bd-45ac-aabc-b75e7ca81a68 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:11.317254 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0b18f78-b9bd-45ac-aabc-b75e7ca81a68 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:11.318008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0b18f78-b9bd-45ac-aabc-b75e7ca81a68 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:11.318438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0b18f78-b9bd-45ac-aabc-b75e7ca81a68 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:11.374799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-60dd4db7-e16f-4b69-8065-bba69717c36f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:11.383103 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-60dd4db7-e16f-4b69-8065-bba69717c36f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.093458 Jun 20 07:33:11.383671 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1127/2139] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:11 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:11.459509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f0b18f78-b9bd-45ac-aabc-b75e7ca81a68 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:11.467249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f0b18f78-b9bd-45ac-aabc-b75e7ca81a68 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.161297 Jun 20 07:33:11.467809 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1013/2140] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:11 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:12.399998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0f9e2a2d-3bd8-40dc-88dd-5f8aadb3bfd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:12.400649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0f9e2a2d-3bd8-40dc-88dd-5f8aadb3bfd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:12.407246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f9e2a2d-3bd8-40dc-88dd-5f8aadb3bfd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:12.407696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f9e2a2d-3bd8-40dc-88dd-5f8aadb3bfd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:12.408482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f9e2a2d-3bd8-40dc-88dd-5f8aadb3bfd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:12.408921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f9e2a2d-3bd8-40dc-88dd-5f8aadb3bfd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:12.480001 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0f9e2a2d-3bd8-40dc-88dd-5f8aadb3bfd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:12.484909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bb4fd42d-371e-4f1e-878e-879d59aa1b49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:12.485535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bb4fd42d-371e-4f1e-878e-879d59aa1b49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:12.488717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0f9e2a2d-3bd8-40dc-88dd-5f8aadb3bfd8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.092451 Jun 20 07:33:12.489548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1128/2141] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:12 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:12.492351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb4fd42d-371e-4f1e-878e-879d59aa1b49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:12.492808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb4fd42d-371e-4f1e-878e-879d59aa1b49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:12.493582 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb4fd42d-371e-4f1e-878e-879d59aa1b49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:12.494023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb4fd42d-371e-4f1e-878e-879d59aa1b49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:12.621878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bb4fd42d-371e-4f1e-878e-879d59aa1b49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:12.630009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bb4fd42d-371e-4f1e-878e-879d59aa1b49 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148942 Jun 20 07:33:12.630576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1014/2142] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:12 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:13.507721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fa4ca599-f6b8-4693-8ccc-15391b6b0296 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:13.508332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fa4ca599-f6b8-4693-8ccc-15391b6b0296 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:13.514867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa4ca599-f6b8-4693-8ccc-15391b6b0296 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:13.515320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa4ca599-f6b8-4693-8ccc-15391b6b0296 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:13.516080 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa4ca599-f6b8-4693-8ccc-15391b6b0296 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:13.516545 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa4ca599-f6b8-4693-8ccc-15391b6b0296 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:13.576636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fa4ca599-f6b8-4693-8ccc-15391b6b0296 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:13.584515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fa4ca599-f6b8-4693-8ccc-15391b6b0296 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080952 Jun 20 07:33:13.585090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1129/2143] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:13 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:13.647327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-37461b1f-72d7-4fbb-8422-67a30e4a652c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:13.647945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-37461b1f-72d7-4fbb-8422-67a30e4a652c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:13.654455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37461b1f-72d7-4fbb-8422-67a30e4a652c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:13.654911 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37461b1f-72d7-4fbb-8422-67a30e4a652c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:13.655676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37461b1f-72d7-4fbb-8422-67a30e4a652c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:13.656134 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37461b1f-72d7-4fbb-8422-67a30e4a652c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:13.781656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-37461b1f-72d7-4fbb-8422-67a30e4a652c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:13.790130 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-37461b1f-72d7-4fbb-8422-67a30e4a652c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147224 Jun 20 07:33:13.790698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1015/2144] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:13 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:14.601000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e319ec35-29fa-4f7b-ba88-7b5ffd5ac86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:14.601611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e319ec35-29fa-4f7b-ba88-7b5ffd5ac86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:14.607997 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e319ec35-29fa-4f7b-ba88-7b5ffd5ac86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:14.608468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e319ec35-29fa-4f7b-ba88-7b5ffd5ac86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:14.609215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e319ec35-29fa-4f7b-ba88-7b5ffd5ac86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:14.609643 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e319ec35-29fa-4f7b-ba88-7b5ffd5ac86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:14.671526 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e319ec35-29fa-4f7b-ba88-7b5ffd5ac86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:14.679748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e319ec35-29fa-4f7b-ba88-7b5ffd5ac86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082601 Jun 20 07:33:14.680326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1130/2145] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:14 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:14.807511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7575137b-1ee8-4c0c-b8a8-a5168fd10c16 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:14.808151 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7575137b-1ee8-4c0c-b8a8-a5168fd10c16 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:14.814676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7575137b-1ee8-4c0c-b8a8-a5168fd10c16 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:14.815126 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7575137b-1ee8-4c0c-b8a8-a5168fd10c16 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:14.815885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7575137b-1ee8-4c0c-b8a8-a5168fd10c16 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:14.816352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7575137b-1ee8-4c0c-b8a8-a5168fd10c16 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:14.942917 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7575137b-1ee8-4c0c-b8a8-a5168fd10c16 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:14.950650 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7575137b-1ee8-4c0c-b8a8-a5168fd10c16 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146988 Jun 20 07:33:14.951238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1016/2146] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:14 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:15.696385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8c37da2d-4c0d-46ad-92f1-7af05a00b10a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:15.697014 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8c37da2d-4c0d-46ad-92f1-7af05a00b10a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:15.703547 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c37da2d-4c0d-46ad-92f1-7af05a00b10a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:15.703999 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c37da2d-4c0d-46ad-92f1-7af05a00b10a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:15.704789 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c37da2d-4c0d-46ad-92f1-7af05a00b10a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:15.705224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8c37da2d-4c0d-46ad-92f1-7af05a00b10a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:15.765385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8c37da2d-4c0d-46ad-92f1-7af05a00b10a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:15.773207 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8c37da2d-4c0d-46ad-92f1-7af05a00b10a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080751 Jun 20 07:33:15.773769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1131/2147] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:15 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:15.968061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b786dbc-b93c-4c1f-92fe-1952e66f8c7d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:15.968706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2b786dbc-b93c-4c1f-92fe-1952e66f8c7d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:15.970961 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:33:15.976782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b786dbc-b93c-4c1f-92fe-1952e66f8c7d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:15.977230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b786dbc-b93c-4c1f-92fe-1952e66f8c7d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:15.977976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b786dbc-b93c-4c1f-92fe-1952e66f8c7d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:15.978405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2b786dbc-b93c-4c1f-92fe-1952e66f8c7d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:15.992687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:33:16.332828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2b786dbc-b93c-4c1f-92fe-1952e66f8c7d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:16.341381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2b786dbc-b93c-4c1f-92fe-1952e66f8c7d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.377227 Jun 20 07:33:16.341947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1017/2148] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:15 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:16.789919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e1dede8e-c2e6-4590-97d5-5843f5f1df00 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:16.790529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e1dede8e-c2e6-4590-97d5-5843f5f1df00 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:16.797069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1dede8e-c2e6-4590-97d5-5843f5f1df00 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:16.797509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1dede8e-c2e6-4590-97d5-5843f5f1df00 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:16.798288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1dede8e-c2e6-4590-97d5-5843f5f1df00 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:16.798717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1dede8e-c2e6-4590-97d5-5843f5f1df00 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:16.861597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e1dede8e-c2e6-4590-97d5-5843f5f1df00 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:16.869934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e1dede8e-c2e6-4590-97d5-5843f5f1df00 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083870 Jun 20 07:33:16.870487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1132/2149] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:16 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:17.358591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-99b231d7-a26f-4777-bced-1402af544aa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:17.359212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-99b231d7-a26f-4777-bced-1402af544aa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:17.368438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99b231d7-a26f-4777-bced-1402af544aa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:17.368890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99b231d7-a26f-4777-bced-1402af544aa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:17.369658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99b231d7-a26f-4777-bced-1402af544aa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:17.370099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99b231d7-a26f-4777-bced-1402af544aa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:17.494463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99b231d7-a26f-4777-bced-1402af544aa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:17.502303 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-99b231d7-a26f-4777-bced-1402af544aa9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147858 Jun 20 07:33:17.502867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1018/2150] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:17 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:17.887271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4bc529ea-55fa-4a85-ac86-5a9f24f480b8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:17.887880 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4bc529ea-55fa-4a85-ac86-5a9f24f480b8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:17.890188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:33:17.895434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bc529ea-55fa-4a85-ac86-5a9f24f480b8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:17.895861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bc529ea-55fa-4a85-ac86-5a9f24f480b8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:17.897209 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bc529ea-55fa-4a85-ac86-5a9f24f480b8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:17.897644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4bc529ea-55fa-4a85-ac86-5a9f24f480b8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:17.959582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4bc529ea-55fa-4a85-ac86-5a9f24f480b8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:17.967390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4bc529ea-55fa-4a85-ac86-5a9f24f480b8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083980 Jun 20 07:33:17.967952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1133/2151] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:17 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:18.519256 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-87394e51-1fde-4217-bf78-97874be69d14 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:18.519867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-87394e51-1fde-4217-bf78-97874be69d14 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:18.526288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87394e51-1fde-4217-bf78-97874be69d14 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:18.526733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87394e51-1fde-4217-bf78-97874be69d14 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:18.527479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87394e51-1fde-4217-bf78-97874be69d14 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:18.527918 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87394e51-1fde-4217-bf78-97874be69d14 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:18.651678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87394e51-1fde-4217-bf78-97874be69d14 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:18.659533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-87394e51-1fde-4217-bf78-97874be69d14 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.144101 Jun 20 07:33:18.660097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1019/2152] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:18 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:18.984061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-07750a72-4142-432f-aae5-f02eb3aa556a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:18.984646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-07750a72-4142-432f-aae5-f02eb3aa556a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:18.991527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07750a72-4142-432f-aae5-f02eb3aa556a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:18.991977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07750a72-4142-432f-aae5-f02eb3aa556a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:18.995475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07750a72-4142-432f-aae5-f02eb3aa556a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:18.995926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07750a72-4142-432f-aae5-f02eb3aa556a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:19.058224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-07750a72-4142-432f-aae5-f02eb3aa556a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:19.066075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-07750a72-4142-432f-aae5-f02eb3aa556a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085948 Jun 20 07:33:19.066639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1134/2153] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:18 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:19.682687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f5d11946-9411-453d-b66b-93f8c75f1c23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:19.683301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f5d11946-9411-453d-b66b-93f8c75f1c23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:19.689316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5d11946-9411-453d-b66b-93f8c75f1c23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:19.689765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5d11946-9411-453d-b66b-93f8c75f1c23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:19.690517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5d11946-9411-453d-b66b-93f8c75f1c23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:19.690952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5d11946-9411-453d-b66b-93f8c75f1c23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:19.817188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f5d11946-9411-453d-b66b-93f8c75f1c23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:19.824855 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f5d11946-9411-453d-b66b-93f8c75f1c23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146226 Jun 20 07:33:19.825410 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1020/2154] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:19 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:20.082425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c7bafcf1-61c1-4463-a06b-168d530002f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:20.083044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c7bafcf1-61c1-4463-a06b-168d530002f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:20.090173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7bafcf1-61c1-4463-a06b-168d530002f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:20.090629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7bafcf1-61c1-4463-a06b-168d530002f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:20.091392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7bafcf1-61c1-4463-a06b-168d530002f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:20.091829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c7bafcf1-61c1-4463-a06b-168d530002f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:20.151475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c7bafcf1-61c1-4463-a06b-168d530002f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:20.159260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c7bafcf1-61c1-4463-a06b-168d530002f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080754 Jun 20 07:33:20.159823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1135/2155] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:20 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:20.842411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5193c3be-1888-41c6-b584-268ed30589c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:20.843064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5193c3be-1888-41c6-b584-268ed30589c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:20.849577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5193c3be-1888-41c6-b584-268ed30589c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:20.850029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5193c3be-1888-41c6-b584-268ed30589c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:20.850787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5193c3be-1888-41c6-b584-268ed30589c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:20.851229 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5193c3be-1888-41c6-b584-268ed30589c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:20.974872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5193c3be-1888-41c6-b584-268ed30589c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:20.982723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5193c3be-1888-41c6-b584-268ed30589c9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.144188 Jun 20 07:33:20.983289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1021/2156] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:20 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:21.176954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-20e53d91-2ede-4018-bbc7-89ac2529761f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:21.178078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-20e53d91-2ede-4018-bbc7-89ac2529761f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:21.184491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20e53d91-2ede-4018-bbc7-89ac2529761f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:21.184932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20e53d91-2ede-4018-bbc7-89ac2529761f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:21.185678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20e53d91-2ede-4018-bbc7-89ac2529761f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:21.186105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20e53d91-2ede-4018-bbc7-89ac2529761f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:21.200848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:33:21.249149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20e53d91-2ede-4018-bbc7-89ac2529761f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:21.257895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-20e53d91-2ede-4018-bbc7-89ac2529761f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085022 Jun 20 07:33:21.258459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1136/2157] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:21 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:22.002374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11e0373a-85cb-42e8-9f42-fa3cef410afd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:22.002935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-11e0373a-85cb-42e8-9f42-fa3cef410afd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:22.010252 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11e0373a-85cb-42e8-9f42-fa3cef410afd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:22.010703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11e0373a-85cb-42e8-9f42-fa3cef410afd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:22.011467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11e0373a-85cb-42e8-9f42-fa3cef410afd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:22.011903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11e0373a-85cb-42e8-9f42-fa3cef410afd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:22.135822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-11e0373a-85cb-42e8-9f42-fa3cef410afd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:22.143611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-11e0373a-85cb-42e8-9f42-fa3cef410afd tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145210 Jun 20 07:33:22.144205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1022/2158] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:21 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:22.274410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6ec2a7d4-4d2a-46b2-8953-a38283474641 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:22.275025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6ec2a7d4-4d2a-46b2-8953-a38283474641 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:22.281558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ec2a7d4-4d2a-46b2-8953-a38283474641 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:22.282007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ec2a7d4-4d2a-46b2-8953-a38283474641 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:22.282763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ec2a7d4-4d2a-46b2-8953-a38283474641 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:22.283196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6ec2a7d4-4d2a-46b2-8953-a38283474641 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:22.343155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6ec2a7d4-4d2a-46b2-8953-a38283474641 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:22.351532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6ec2a7d4-4d2a-46b2-8953-a38283474641 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081021 Jun 20 07:33:22.352098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1137/2159] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:22 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:23.160085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-68cf4732-df2c-49a3-a9e2-d36e57763e34 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:23.160724 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-68cf4732-df2c-49a3-a9e2-d36e57763e34 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:23.167120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68cf4732-df2c-49a3-a9e2-d36e57763e34 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:23.167568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68cf4732-df2c-49a3-a9e2-d36e57763e34 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:23.168387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68cf4732-df2c-49a3-a9e2-d36e57763e34 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:23.168852 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68cf4732-df2c-49a3-a9e2-d36e57763e34 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:23.296586 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-68cf4732-df2c-49a3-a9e2-d36e57763e34 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:23.304457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-68cf4732-df2c-49a3-a9e2-d36e57763e34 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148282 Jun 20 07:33:23.305023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1023/2160] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:23 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:23.368489 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-94a516cc-fb07-4490-9e8e-ca0e880d63d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:23.369098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-94a516cc-fb07-4490-9e8e-ca0e880d63d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:23.375562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94a516cc-fb07-4490-9e8e-ca0e880d63d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:23.376007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94a516cc-fb07-4490-9e8e-ca0e880d63d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:23.376822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94a516cc-fb07-4490-9e8e-ca0e880d63d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:23.377258 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94a516cc-fb07-4490-9e8e-ca0e880d63d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:23.437084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-94a516cc-fb07-4490-9e8e-ca0e880d63d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:23.445515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-94a516cc-fb07-4490-9e8e-ca0e880d63d7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081384 Jun 20 07:33:23.446074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1138/2161] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:23 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:24.321471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5ccc0e64-7d5f-4fb6-b951-93c89eb7fd6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:24.322100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5ccc0e64-7d5f-4fb6-b951-93c89eb7fd6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:24.328554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ccc0e64-7d5f-4fb6-b951-93c89eb7fd6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:24.329005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ccc0e64-7d5f-4fb6-b951-93c89eb7fd6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:24.329767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ccc0e64-7d5f-4fb6-b951-93c89eb7fd6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:24.330213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ccc0e64-7d5f-4fb6-b951-93c89eb7fd6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:24.455525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5ccc0e64-7d5f-4fb6-b951-93c89eb7fd6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:24.462539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4148f12d-a5e6-48c7-92f9-aebd4498bcd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:24.463144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4148f12d-a5e6-48c7-92f9-aebd4498bcd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:24.464081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5ccc0e64-7d5f-4fb6-b951-93c89eb7fd6c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146502 Jun 20 07:33:24.464684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1024/2162] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:24 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:24.469636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4148f12d-a5e6-48c7-92f9-aebd4498bcd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:24.470077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4148f12d-a5e6-48c7-92f9-aebd4498bcd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:24.470830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4148f12d-a5e6-48c7-92f9-aebd4498bcd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:24.471291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4148f12d-a5e6-48c7-92f9-aebd4498bcd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:24.536653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4148f12d-a5e6-48c7-92f9-aebd4498bcd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:24.544472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4148f12d-a5e6-48c7-92f9-aebd4498bcd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086173 Jun 20 07:33:24.545033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1139/2163] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:24 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:25.481029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-07d8f930-7145-4304-8e1d-c7f28d632d23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:25.481716 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-07d8f930-7145-4304-8e1d-c7f28d632d23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:25.488187 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-07d8f930-7145-4304-8e1d-c7f28d632d23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:25.488632 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-07d8f930-7145-4304-8e1d-c7f28d632d23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:25.489387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-07d8f930-7145-4304-8e1d-c7f28d632d23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:25.490474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-07d8f930-7145-4304-8e1d-c7f28d632d23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:25.561105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f75c1de1-a8c5-4478-9d00-35b09cfbcc10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:25.561721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f75c1de1-a8c5-4478-9d00-35b09cfbcc10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:25.568088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f75c1de1-a8c5-4478-9d00-35b09cfbcc10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:25.568578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f75c1de1-a8c5-4478-9d00-35b09cfbcc10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:25.569321 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f75c1de1-a8c5-4478-9d00-35b09cfbcc10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:25.569757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f75c1de1-a8c5-4478-9d00-35b09cfbcc10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:25.665009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f75c1de1-a8c5-4478-9d00-35b09cfbcc10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:25.673850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f75c1de1-a8c5-4478-9d00-35b09cfbcc10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.115968 Jun 20 07:33:25.673850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1140/2164] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:25 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:25.709265 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-07d8f930-7145-4304-8e1d-c7f28d632d23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:25.717233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-07d8f930-7145-4304-8e1d-c7f28d632d23 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.240016 Jun 20 07:33:25.717890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1025/2165] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:25 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:26.690806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ef5ce678-b2f1-48b3-90ec-c0d749bd0f45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:26.691379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ef5ce678-b2f1-48b3-90ec-c0d749bd0f45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:26.698505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef5ce678-b2f1-48b3-90ec-c0d749bd0f45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:26.698952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef5ce678-b2f1-48b3-90ec-c0d749bd0f45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:26.699710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef5ce678-b2f1-48b3-90ec-c0d749bd0f45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:26.700169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ef5ce678-b2f1-48b3-90ec-c0d749bd0f45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:26.734684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-082d3889-e090-42ad-9b61-f5aa11164c79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:26.735400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-082d3889-e090-42ad-9b61-f5aa11164c79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:26.742588 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-082d3889-e090-42ad-9b61-f5aa11164c79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:26.743118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-082d3889-e090-42ad-9b61-f5aa11164c79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:26.743963 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-082d3889-e090-42ad-9b61-f5aa11164c79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:26.744498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-082d3889-e090-42ad-9b61-f5aa11164c79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:26.769639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ef5ce678-b2f1-48b3-90ec-c0d749bd0f45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:26.778189 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ef5ce678-b2f1-48b3-90ec-c0d749bd0f45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.091273 Jun 20 07:33:26.778757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1141/2166] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:26 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:26.870249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-082d3889-e090-42ad-9b61-f5aa11164c79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:26.878127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-082d3889-e090-42ad-9b61-f5aa11164c79 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147282 Jun 20 07:33:26.878953 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1026/2167] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:26 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:27.795093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-59a697e7-9079-49a9-9a93-c0a1c534e236 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:27.795705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-59a697e7-9079-49a9-9a93-c0a1c534e236 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:27.802911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59a697e7-9079-49a9-9a93-c0a1c534e236 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:27.803358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59a697e7-9079-49a9-9a93-c0a1c534e236 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:27.804137 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59a697e7-9079-49a9-9a93-c0a1c534e236 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:27.804571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-59a697e7-9079-49a9-9a93-c0a1c534e236 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:27.863476 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-59a697e7-9079-49a9-9a93-c0a1c534e236 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:27.871892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-59a697e7-9079-49a9-9a93-c0a1c534e236 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080700 Jun 20 07:33:27.872490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1142/2168] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:27 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:27.895635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-479de689-d32d-4863-881c-24a2fc4df7a0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:27.896838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-479de689-d32d-4863-881c-24a2fc4df7a0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:27.903219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-479de689-d32d-4863-881c-24a2fc4df7a0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:27.903673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-479de689-d32d-4863-881c-24a2fc4df7a0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:27.904485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-479de689-d32d-4863-881c-24a2fc4df7a0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:27.904924 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-479de689-d32d-4863-881c-24a2fc4df7a0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:28.032341 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-479de689-d32d-4863-881c-24a2fc4df7a0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:28.040797 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-479de689-d32d-4863-881c-24a2fc4df7a0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148966 Jun 20 07:33:28.041364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1027/2169] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:27 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:28.888889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b887ae81-2526-488b-b4ff-9b66d916530e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:28.889496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b887ae81-2526-488b-b4ff-9b66d916530e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:28.895842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b887ae81-2526-488b-b4ff-9b66d916530e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:28.896381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b887ae81-2526-488b-b4ff-9b66d916530e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:28.897130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b887ae81-2526-488b-b4ff-9b66d916530e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:28.897560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b887ae81-2526-488b-b4ff-9b66d916530e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:28.957026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b887ae81-2526-488b-b4ff-9b66d916530e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:28.965001 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b887ae81-2526-488b-b4ff-9b66d916530e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079882 Jun 20 07:33:28.965502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1143/2170] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:28 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:29.058363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4d89482a-cb5e-4d54-9b2a-71ea721fb114 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:29.058981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4d89482a-cb5e-4d54-9b2a-71ea721fb114 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:29.065401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d89482a-cb5e-4d54-9b2a-71ea721fb114 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:29.065849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d89482a-cb5e-4d54-9b2a-71ea721fb114 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:29.066604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d89482a-cb5e-4d54-9b2a-71ea721fb114 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:29.067040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4d89482a-cb5e-4d54-9b2a-71ea721fb114 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:29.192046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4d89482a-cb5e-4d54-9b2a-71ea721fb114 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:29.199973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4d89482a-cb5e-4d54-9b2a-71ea721fb114 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145520 Jun 20 07:33:29.200564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1028/2171] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:29 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:29.268142 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-40fb8f55-5530-44b9-b0ab-f2526e880dc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:29.268683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-40fb8f55-5530-44b9-b0ab-f2526e880dc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:29.274605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40fb8f55-5530-44b9-b0ab-f2526e880dc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:29.275062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40fb8f55-5530-44b9-b0ab-f2526e880dc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:29.275822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40fb8f55-5530-44b9-b0ab-f2526e880dc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:29.276293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-40fb8f55-5530-44b9-b0ab-f2526e880dc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:29.300932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-40fb8f55-5530-44b9-b0ab-f2526e880dc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:33:29.374242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-40fb8f55-5530-44b9-b0ab-f2526e880dc1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 204 len: 0 microversion: 2.20 time: 0.170514 Jun 20 07:33:29.374955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1144/2172] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Jun 20 07:33:29 2022] DELETE /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 07:33:29.383697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-044d77d6-6fd1-4fbe-8216-a223f901b49c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:29.384345 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-044d77d6-6fd1-4fbe-8216-a223f901b49c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:29.390825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-044d77d6-6fd1-4fbe-8216-a223f901b49c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:29.391270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-044d77d6-6fd1-4fbe-8216-a223f901b49c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:29.392036 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-044d77d6-6fd1-4fbe-8216-a223f901b49c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:29.392511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-044d77d6-6fd1-4fbe-8216-a223f901b49c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:29.524324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-044d77d6-6fd1-4fbe-8216-a223f901b49c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:29.532017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-044d77d6-6fd1-4fbe-8216-a223f901b49c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:29.533515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-044d77d6-6fd1-4fbe-8216-a223f901b49c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:29.534655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-044d77d6-6fd1-4fbe-8216-a223f901b49c tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 200 len: 1724 microversion: 2.20 time: 0.154967 Jun 20 07:33:29.535209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1029/2173] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:33:29 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:33:29.982916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-81bab85e-6590-45c7-a42a-27174bfb6945 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:29.983614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-81bab85e-6590-45c7-a42a-27174bfb6945 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:29.990632 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81bab85e-6590-45c7-a42a-27174bfb6945 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:29.991073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81bab85e-6590-45c7-a42a-27174bfb6945 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:29.991818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81bab85e-6590-45c7-a42a-27174bfb6945 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:29.992279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81bab85e-6590-45c7-a42a-27174bfb6945 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:30.057333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-81bab85e-6590-45c7-a42a-27174bfb6945 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:30.065340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-81bab85e-6590-45c7-a42a-27174bfb6945 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086813 Jun 20 07:33:30.065906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1145/2174] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:29 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:30.217332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fdfb5485-0c04-4812-a9e3-fb828b321775 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:30.217944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fdfb5485-0c04-4812-a9e3-fb828b321775 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:30.224938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdfb5485-0c04-4812-a9e3-fb828b321775 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:30.225382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdfb5485-0c04-4812-a9e3-fb828b321775 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:30.226128 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdfb5485-0c04-4812-a9e3-fb828b321775 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:30.226556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdfb5485-0c04-4812-a9e3-fb828b321775 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:30.354994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fdfb5485-0c04-4812-a9e3-fb828b321775 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:30.363015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fdfb5485-0c04-4812-a9e3-fb828b321775 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149478 Jun 20 07:33:30.363577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1030/2175] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:30 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:30.553603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-025898d0-8858-49b6-b108-4f94d299ecb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:30.554220 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-025898d0-8858-49b6-b108-4f94d299ecb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:30.560156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-025898d0-8858-49b6-b108-4f94d299ecb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:30.560605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-025898d0-8858-49b6-b108-4f94d299ecb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:30.561354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-025898d0-8858-49b6-b108-4f94d299ecb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:30.561783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-025898d0-8858-49b6-b108-4f94d299ecb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:30.691467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-025898d0-8858-49b6-b108-4f94d299ecb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:30.699702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-025898d0-8858-49b6-b108-4f94d299ecb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:30.701420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-025898d0-8858-49b6-b108-4f94d299ecb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:30.702623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-025898d0-8858-49b6-b108-4f94d299ecb0 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 200 len: 1724 microversion: 2.20 time: 0.152979 Jun 20 07:33:30.703404 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1146/2176] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:33:30 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:33:31.082198 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-715e5087-94d1-410c-b653-f6eae2a12988 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:31.082761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-715e5087-94d1-410c-b653-f6eae2a12988 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:31.088844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-715e5087-94d1-410c-b653-f6eae2a12988 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:31.089361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-715e5087-94d1-410c-b653-f6eae2a12988 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:31.090139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-715e5087-94d1-410c-b653-f6eae2a12988 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:31.090579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-715e5087-94d1-410c-b653-f6eae2a12988 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:31.157680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-715e5087-94d1-410c-b653-f6eae2a12988 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:31.165454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-715e5087-94d1-410c-b653-f6eae2a12988 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.087183 Jun 20 07:33:31.174519 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1031/2177] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:31 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:31.380690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c1ca3799-cd0d-4d0e-8b6b-b4e565fa5e59 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:31.381232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c1ca3799-cd0d-4d0e-8b6b-b4e565fa5e59 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:31.387397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1ca3799-cd0d-4d0e-8b6b-b4e565fa5e59 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:31.387848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1ca3799-cd0d-4d0e-8b6b-b4e565fa5e59 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:31.388655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1ca3799-cd0d-4d0e-8b6b-b4e565fa5e59 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:31.389091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c1ca3799-cd0d-4d0e-8b6b-b4e565fa5e59 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:31.605609 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-449e4c1f-9795-4527-a6e7-165ef24a3662 req-6b471825-2c5b-4da7-bb08-d4c7110dfbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdd4118-f626-4b1f-9e5d-154498c4591f", "name": "network-vif-deleted", "tag": "3e9ece88-d42e-47fa-af30-ccc61f18eb30"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:33:31.606251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c1ca3799-cd0d-4d0e-8b6b-b4e565fa5e59 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:31.617726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-449e4c1f-9795-4527-a6e7-165ef24a3662 req-6b471825-2c5b-4da7-bb08-d4c7110dfbbb service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:31.618554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-449e4c1f-9795-4527-a6e7-165ef24a3662 req-6b471825-2c5b-4da7-bb08-d4c7110dfbbb service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:31.631803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-449e4c1f-9795-4527-a6e7-165ef24a3662 req-6b471825-2c5b-4da7-bb08-d4c7110dfbbb service nova] Creating event network-vif-deleted:3e9ece88-d42e-47fa-af30-ccc61f18eb30 for instance 5fdd4118-f626-4b1f-9e5d-154498c4591f on hv-cinder-77819 Jun 20 07:33:31.633699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c1ca3799-cd0d-4d0e-8b6b-b4e565fa5e59 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.257655 Jun 20 07:33:31.638604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-449e4c1f-9795-4527-a6e7-165ef24a3662 req-6b471825-2c5b-4da7-bb08-d4c7110dfbbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039654 Jun 20 07:33:31.639518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1032/2178] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:33:31.643248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1147/2179] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:31 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:31.728791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:31.730825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:31.751883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:31.752430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:31.753256 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:31.753970 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:31.800756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:31.801304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:31.801883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lazy-loading 'fault' on Instance uuid 5fdd4118-f626-4b1f-9e5d-154498c4591f {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:33:31.844810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:31.853319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:31.854806 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c618f9ab8bd47a3a9913078f8ae895e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530da3341ec44dddbab5b0042706ac7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:31.855945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c62c1774-f953-45dd-a25e-eee93a8a04e3 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 200 len: 1372 microversion: 2.20 time: 0.138441 Jun 20 07:33:31.856721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1033/2180] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:33:31 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 1372 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 07:33:32.182365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d03ea0f7-29aa-44b3-a8ed-d8e7076f1524 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:32.183008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d03ea0f7-29aa-44b3-a8ed-d8e7076f1524 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:32.189131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d03ea0f7-29aa-44b3-a8ed-d8e7076f1524 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:32.189578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d03ea0f7-29aa-44b3-a8ed-d8e7076f1524 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:32.190360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d03ea0f7-29aa-44b3-a8ed-d8e7076f1524 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:32.190778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d03ea0f7-29aa-44b3-a8ed-d8e7076f1524 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:32.255577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d03ea0f7-29aa-44b3-a8ed-d8e7076f1524 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:32.264044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d03ea0f7-29aa-44b3-a8ed-d8e7076f1524 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085642 Jun 20 07:33:32.264774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1148/2181] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:32 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:32.650729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8d62a3ea-e5ee-4537-bef0-8119e757a26d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:32.651354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8d62a3ea-e5ee-4537-bef0-8119e757a26d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:32.657869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d62a3ea-e5ee-4537-bef0-8119e757a26d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:32.658322 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d62a3ea-e5ee-4537-bef0-8119e757a26d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:32.659103 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d62a3ea-e5ee-4537-bef0-8119e757a26d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:32.659526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d62a3ea-e5ee-4537-bef0-8119e757a26d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:32.673912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:33:32.787850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d62a3ea-e5ee-4537-bef0-8119e757a26d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:32.795691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8d62a3ea-e5ee-4537-bef0-8119e757a26d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148860 Jun 20 07:33:32.796286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1034/2182] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:32 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:32.873824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-628e4046-602b-4ad4-8387-bbe21d1533e6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:32.874427 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-628e4046-602b-4ad4-8387-bbe21d1533e6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:32.881072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-628e4046-602b-4ad4-8387-bbe21d1533e6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:32.881514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-628e4046-602b-4ad4-8387-bbe21d1533e6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:32.882253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-628e4046-602b-4ad4-8387-bbe21d1533e6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:32.882680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-628e4046-602b-4ad4-8387-bbe21d1533e6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:32.895742 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-628e4046-602b-4ad4-8387-bbe21d1533e6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] HTTP exception thrown: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-628e4046-602b-4ad4-8387-bbe21d1533e6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Request method failure captured: Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f HTTP/1.1 Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisByYWeI4txkwa6yML_OMLCKdHtyqYVZGhRsFgJP0YH_6w5z29R9A4pAjgR7FDgcQt62Lnzl8jrsB_H0r94F_2aR6HwrZj598IR3vtw01nCD6H51aJq54v2SGWnrRyUuf2elld0Dt6NbFp0yPX4a92kR0RH1oZbuuyzWzxCUiwWROEH8 Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 530da3341ec44dddbab5b0042706ac7b Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:33:32.897392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:33:32.899305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:33:32.899305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:33:32.899305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 530da3341ec44dddbab5b0042706ac7b Jun 20 07:33:32.899305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:33:32.899305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeShelveTestJSON-220475795-project Jun 20 07:33:32.899305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:33:32.899305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:33:32.899305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 1c618f9ab8bd47a3a9913078f8ae895e Jun 20 07:33:32.899305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeShelveTestJSON-220475795-project Jun 20 07:33:32.899305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:33:32.899305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:32.899305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '5fdd4118-f626-4b1f-9e5d-154498c4591f'} Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:33:32.900436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:32.902190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:33:32.903851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-628e4046-602b-4ad4-8387-bbe21d1533e6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Returning 404 to user: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:33:32.903851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-628e4046-602b-4ad4-8387-bbe21d1533e6 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 404 len: 111 microversion: 2.20 time: 0.028732 Jun 20 07:33:32.903851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1149/2183] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:33:32 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:33:32.907533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-872c5160-5baa-4182-a58a-2d990bca2bb1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '.version_select at 0x7ffa1fc109d0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:32.924787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-872c5160-5baa-4182-a58a-2d990bca2bb1 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162129095" status: 204 len: 0 microversion: 2.20 time: 0.020999 Jun 20 07:33:32.925324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1035/2184] 10.222.0.23 () {60 vars in 1261 bytes} [Mon Jun 20 07:33:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162129095 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 07:33:33.281753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-92b8bacd-d534-4a6a-a01e-c7622533ce11 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:33.282495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-92b8bacd-d534-4a6a-a01e-c7622533ce11 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:33.289129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-92b8bacd-d534-4a6a-a01e-c7622533ce11 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:33.289648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-92b8bacd-d534-4a6a-a01e-c7622533ce11 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:33.290439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-92b8bacd-d534-4a6a-a01e-c7622533ce11 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:33.290861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-92b8bacd-d534-4a6a-a01e-c7622533ce11 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:33.357575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-92b8bacd-d534-4a6a-a01e-c7622533ce11 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:33.365392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-92b8bacd-d534-4a6a-a01e-c7622533ce11 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.087681 Jun 20 07:33:33.365944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1150/2185] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:33 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:33.553070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01d8cb78-4050-410d-95bc-f2293fb11929 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:33.553564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01d8cb78-4050-410d-95bc-f2293fb11929 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:33.559521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01d8cb78-4050-410d-95bc-f2293fb11929 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:33.559968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01d8cb78-4050-410d-95bc-f2293fb11929 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:33.560758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01d8cb78-4050-410d-95bc-f2293fb11929 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:33.561189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01d8cb78-4050-410d-95bc-f2293fb11929 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:33.574647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-01d8cb78-4050-410d-95bc-f2293fb11929 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] HTTP exception thrown: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01d8cb78-4050-410d-95bc-f2293fb11929 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Request method failure captured: Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f HTTP/1.1 Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByYWeI4txkwa6yML_OMLCKdHtyqYVZGhRsFgJP0YH_6w5z29R9A4pAjgR7FDgcQt62Lnzl8jrsB_H0r94F_2aR6HwrZj598IR3vtw01nCD6H51aJq54v2SGWnrRyUuf2elld0Dt6NbFp0yPX4a92kR0RH1oZbuuyzWzxCUiwWROEH8 Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 530da3341ec44dddbab5b0042706ac7b Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:33:33.576317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:33:33.578119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:33:33.578119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:33:33.578119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 530da3341ec44dddbab5b0042706ac7b Jun 20 07:33:33.578119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:33:33.578119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeShelveTestJSON-220475795-project Jun 20 07:33:33.578119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:33:33.578119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:33:33.578119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: 1c618f9ab8bd47a3a9913078f8ae895e Jun 20 07:33:33.578119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-220475795-project Jun 20 07:33:33.578119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:33:33.578119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:33.578119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '5fdd4118-f626-4b1f-9e5d-154498c4591f'} Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:33:33.579314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:33.581326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:33:33.582965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01d8cb78-4050-410d-95bc-f2293fb11929 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Returning 404 to user: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:33:33.582965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-01d8cb78-4050-410d-95bc-f2293fb11929 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 404 len: 111 microversion: 2.20 time: 0.028621 Jun 20 07:33:33.582965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1036/2186] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Jun 20 07:33:33 2022] DELETE /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:33:33.586667 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5fbcdd43-bd96-4c67-98e2-235e039529cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:33.587279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5fbcdd43-bd96-4c67-98e2-235e039529cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 5fdd4118-f626-4b1f-9e5d-154498c4591f] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:33.593346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5fbcdd43-bd96-4c67-98e2-235e039529cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:33.593927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5fbcdd43-bd96-4c67-98e2-235e039529cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:33.594693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5fbcdd43-bd96-4c67-98e2-235e039529cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:33.595133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5fbcdd43-bd96-4c67-98e2-235e039529cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:33.608025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-5fbcdd43-bd96-4c67-98e2-235e039529cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] HTTP exception thrown: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5fbcdd43-bd96-4c67-98e2-235e039529cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Request method failure captured: Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f HTTP/1.1 Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisByYWeI4txkwa6yML_OMLCKdHtyqYVZGhRsFgJP0YH_6w5z29R9A4pAjgR7FDgcQt62Lnzl8jrsB_H0r94F_2aR6HwrZj598IR3vtw01nCD6H51aJq54v2SGWnrRyUuf2elld0Dt6NbFp0yPX4a92kR0RH1oZbuuyzWzxCUiwWROEH8 Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 530da3341ec44dddbab5b0042706ac7b Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:33:33.609575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:33:33.611411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:33:33.611411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:33:33.611411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 530da3341ec44dddbab5b0042706ac7b Jun 20 07:33:33.611411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:33:33.611411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeShelveTestJSON-220475795-project Jun 20 07:33:33.611411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:33:33.611411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:33:33.611411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 1c618f9ab8bd47a3a9913078f8ae895e Jun 20 07:33:33.611411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeShelveTestJSON-220475795-project Jun 20 07:33:33.611411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:33:33.611411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:33.611411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '5fdd4118-f626-4b1f-9e5d-154498c4591f'} Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:33:33.612438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. Jun 20 07:33:33.613799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:33:33.615149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5fbcdd43-bd96-4c67-98e2-235e039529cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Returning 404 to user: Instance 5fdd4118-f626-4b1f-9e5d-154498c4591f could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:33:33.615149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5fbcdd43-bd96-4c67-98e2-235e039529cc tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f" status: 404 len: 111 microversion: 2.20 time: 0.028758 Jun 20 07:33:33.615149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1151/2187] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:33:33 2022] GET /compute/v2.1/servers/5fdd4118-f626-4b1f-9e5d-154498c4591f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:33:33.813050 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b066645b-23d5-4cfc-ae59-34311db3a033 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:33.813592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b066645b-23d5-4cfc-ae59-34311db3a033 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:33.820520 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b066645b-23d5-4cfc-ae59-34311db3a033 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:33.820966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b066645b-23d5-4cfc-ae59-34311db3a033 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:33.821722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b066645b-23d5-4cfc-ae59-34311db3a033 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:33.822161 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b066645b-23d5-4cfc-ae59-34311db3a033 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:33.949689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b066645b-23d5-4cfc-ae59-34311db3a033 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:33.958017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b066645b-23d5-4cfc-ae59-34311db3a033 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148876 Jun 20 07:33:33.958572 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1037/2188] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:33 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:34.382663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-006533d1-2695-40c2-8275-b8c9e4f81c94 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:34.383280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-006533d1-2695-40c2-8275-b8c9e4f81c94 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:34.389432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-006533d1-2695-40c2-8275-b8c9e4f81c94 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:34.389878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-006533d1-2695-40c2-8275-b8c9e4f81c94 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:34.390633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-006533d1-2695-40c2-8275-b8c9e4f81c94 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:34.391071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-006533d1-2695-40c2-8275-b8c9e4f81c94 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:34.454054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-006533d1-2695-40c2-8275-b8c9e4f81c94 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:34.456362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:33:34.463303 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-006533d1-2695-40c2-8275-b8c9e4f81c94 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084974 Jun 20 07:33:34.463867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1152/2189] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:34 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:34.975643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-64e45614-c877-46a1-bd92-2c2ba8c4e393 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:34.976329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-64e45614-c877-46a1-bd92-2c2ba8c4e393 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:34.982751 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64e45614-c877-46a1-bd92-2c2ba8c4e393 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:34.983201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64e45614-c877-46a1-bd92-2c2ba8c4e393 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:34.983953 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64e45614-c877-46a1-bd92-2c2ba8c4e393 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:34.984428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64e45614-c877-46a1-bd92-2c2ba8c4e393 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:35.117430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-64e45614-c877-46a1-bd92-2c2ba8c4e393 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:35.125347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-64e45614-c877-46a1-bd92-2c2ba8c4e393 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.154230 Jun 20 07:33:35.125908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1038/2190] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:34 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:35.479856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-410fef25-cb22-4cd5-8959-37672b9aead0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:35.480506 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-410fef25-cb22-4cd5-8959-37672b9aead0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:35.488877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-410fef25-cb22-4cd5-8959-37672b9aead0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:35.489890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-410fef25-cb22-4cd5-8959-37672b9aead0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:35.490654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-410fef25-cb22-4cd5-8959-37672b9aead0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:35.491096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-410fef25-cb22-4cd5-8959-37672b9aead0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:35.552465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-410fef25-cb22-4cd5-8959-37672b9aead0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:35.560276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-410fef25-cb22-4cd5-8959-37672b9aead0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084179 Jun 20 07:33:35.560843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1153/2191] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:35 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:36.143009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-40c67132-f274-4090-a45e-229fee510369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:36.143633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-40c67132-f274-4090-a45e-229fee510369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:36.150756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40c67132-f274-4090-a45e-229fee510369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:36.151208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40c67132-f274-4090-a45e-229fee510369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:36.151969 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40c67132-f274-4090-a45e-229fee510369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:36.152439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-40c67132-f274-4090-a45e-229fee510369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:36.279707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-40c67132-f274-4090-a45e-229fee510369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:36.288304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-40c67132-f274-4090-a45e-229fee510369 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149147 Jun 20 07:33:36.289064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1039/2192] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:36 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:36.577223 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-185aef17-1e5c-4a4a-865d-b18b159edfd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:36.577844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-185aef17-1e5c-4a4a-865d-b18b159edfd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:36.585115 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-185aef17-1e5c-4a4a-865d-b18b159edfd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:36.585591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-185aef17-1e5c-4a4a-865d-b18b159edfd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:36.586373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-185aef17-1e5c-4a4a-865d-b18b159edfd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:36.586809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-185aef17-1e5c-4a4a-865d-b18b159edfd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:36.647830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-185aef17-1e5c-4a4a-865d-b18b159edfd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:36.655565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-185aef17-1e5c-4a4a-865d-b18b159edfd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082211 Jun 20 07:33:36.656137 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1154/2193] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:36 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:37.306667 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7bc47fd1-8333-45cc-b37a-1156586c196e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:37.307289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7bc47fd1-8333-45cc-b37a-1156586c196e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:37.313668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bc47fd1-8333-45cc-b37a-1156586c196e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:37.314108 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bc47fd1-8333-45cc-b37a-1156586c196e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:37.314862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bc47fd1-8333-45cc-b37a-1156586c196e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:37.315298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bc47fd1-8333-45cc-b37a-1156586c196e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:37.439967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7bc47fd1-8333-45cc-b37a-1156586c196e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:37.447928 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7bc47fd1-8333-45cc-b37a-1156586c196e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145162 Jun 20 07:33:37.448525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1040/2194] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:37 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:37.671952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-add1618f-25bb-4224-a35a-2d3aadeca075 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:37.672538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-add1618f-25bb-4224-a35a-2d3aadeca075 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:37.678922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-add1618f-25bb-4224-a35a-2d3aadeca075 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:37.679362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-add1618f-25bb-4224-a35a-2d3aadeca075 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:37.680117 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-add1618f-25bb-4224-a35a-2d3aadeca075 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:37.680563 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-add1618f-25bb-4224-a35a-2d3aadeca075 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:37.744051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-add1618f-25bb-4224-a35a-2d3aadeca075 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:37.751928 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-add1618f-25bb-4224-a35a-2d3aadeca075 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083951 Jun 20 07:33:37.752524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1155/2195] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:37 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:38.464843 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4dc7f135-0076-4858-ad34-7878c6a853fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:38.465458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4dc7f135-0076-4858-ad34-7878c6a853fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:38.471852 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dc7f135-0076-4858-ad34-7878c6a853fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:38.472338 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dc7f135-0076-4858-ad34-7878c6a853fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:38.473091 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dc7f135-0076-4858-ad34-7878c6a853fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:38.473535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4dc7f135-0076-4858-ad34-7878c6a853fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:38.598546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4dc7f135-0076-4858-ad34-7878c6a853fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:38.606371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4dc7f135-0076-4858-ad34-7878c6a853fa tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145473 Jun 20 07:33:38.606932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1041/2196] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:38 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:38.769095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7f49532f-f199-4e15-b700-386c66409bb2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:38.769702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7f49532f-f199-4e15-b700-386c66409bb2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:38.776191 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f49532f-f199-4e15-b700-386c66409bb2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:38.776641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f49532f-f199-4e15-b700-386c66409bb2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:38.777397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f49532f-f199-4e15-b700-386c66409bb2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:38.777828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7f49532f-f199-4e15-b700-386c66409bb2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:38.837515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7f49532f-f199-4e15-b700-386c66409bb2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:38.845336 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7f49532f-f199-4e15-b700-386c66409bb2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080183 Jun 20 07:33:38.845895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1156/2197] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:38 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:39.622621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-34b20f8f-7e52-4193-8af6-03bfb78a4fb9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:39.623248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-34b20f8f-7e52-4193-8af6-03bfb78a4fb9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:39.630461 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34b20f8f-7e52-4193-8af6-03bfb78a4fb9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:39.630913 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34b20f8f-7e52-4193-8af6-03bfb78a4fb9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:39.631677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34b20f8f-7e52-4193-8af6-03bfb78a4fb9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:39.632139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34b20f8f-7e52-4193-8af6-03bfb78a4fb9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:39.760680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-34b20f8f-7e52-4193-8af6-03bfb78a4fb9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:39.768640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-34b20f8f-7e52-4193-8af6-03bfb78a4fb9 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149828 Jun 20 07:33:39.769209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1042/2198] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:39 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:39.862346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2d5418bd-9271-47a1-8c34-254841626e02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:39.862949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2d5418bd-9271-47a1-8c34-254841626e02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:39.869924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d5418bd-9271-47a1-8c34-254841626e02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:39.870362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d5418bd-9271-47a1-8c34-254841626e02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:39.871106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d5418bd-9271-47a1-8c34-254841626e02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:39.871536 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d5418bd-9271-47a1-8c34-254841626e02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:39.931339 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2d5418bd-9271-47a1-8c34-254841626e02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:39.939107 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2d5418bd-9271-47a1-8c34-254841626e02 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080617 Jun 20 07:33:39.939663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1157/2199] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:39 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:40.785315 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7dce1d27-90b6-471d-b4cf-313b1b019c04 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:40.786004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7dce1d27-90b6-471d-b4cf-313b1b019c04 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:40.792536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7dce1d27-90b6-471d-b4cf-313b1b019c04 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:40.792988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7dce1d27-90b6-471d-b4cf-313b1b019c04 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:40.793748 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7dce1d27-90b6-471d-b4cf-313b1b019c04 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:40.794186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7dce1d27-90b6-471d-b4cf-313b1b019c04 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:40.918673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7dce1d27-90b6-471d-b4cf-313b1b019c04 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:40.927185 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7dce1d27-90b6-471d-b4cf-313b1b019c04 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145237 Jun 20 07:33:40.927746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1043/2200] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:40 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:40.956383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8047ae68-e1d1-4353-a943-fcb40f6cfc20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:40.957002 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8047ae68-e1d1-4353-a943-fcb40f6cfc20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:40.963601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8047ae68-e1d1-4353-a943-fcb40f6cfc20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:40.963999 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8047ae68-e1d1-4353-a943-fcb40f6cfc20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:40.964801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8047ae68-e1d1-4353-a943-fcb40f6cfc20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:40.965243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8047ae68-e1d1-4353-a943-fcb40f6cfc20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:41.028556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8047ae68-e1d1-4353-a943-fcb40f6cfc20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:41.036878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8047ae68-e1d1-4353-a943-fcb40f6cfc20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084363 Jun 20 07:33:41.037444 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1158/2201] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:40 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:41.945006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5756a467-ab86-4c92-b6f2-91c622c8e273 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:41.945651 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5756a467-ab86-4c92-b6f2-91c622c8e273 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:41.952037 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5756a467-ab86-4c92-b6f2-91c622c8e273 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:41.952559 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5756a467-ab86-4c92-b6f2-91c622c8e273 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:41.953302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5756a467-ab86-4c92-b6f2-91c622c8e273 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:41.953738 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5756a467-ab86-4c92-b6f2-91c622c8e273 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:42.052866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4af0bcc4-b8c3-492c-aea3-931e4f9be590 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:42.053480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4af0bcc4-b8c3-492c-aea3-931e4f9be590 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:42.060091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4af0bcc4-b8c3-492c-aea3-931e4f9be590 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:42.060582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4af0bcc4-b8c3-492c-aea3-931e4f9be590 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:42.061348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4af0bcc4-b8c3-492c-aea3-931e4f9be590 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:42.061783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4af0bcc4-b8c3-492c-aea3-931e4f9be590 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:42.082395 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5756a467-ab86-4c92-b6f2-91c622c8e273 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:42.090961 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5756a467-ab86-4c92-b6f2-91c622c8e273 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150474 Jun 20 07:33:42.091524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1044/2202] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:41 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:42.173194 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4af0bcc4-b8c3-492c-aea3-931e4f9be590 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:42.181558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4af0bcc4-b8c3-492c-aea3-931e4f9be590 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.132527 Jun 20 07:33:42.182120 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1159/2203] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:42 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:43.107932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bed3c0f7-9ff8-4a9d-a808-072b4795460e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:43.108583 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bed3c0f7-9ff8-4a9d-a808-072b4795460e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:43.115033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bed3c0f7-9ff8-4a9d-a808-072b4795460e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:43.115484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bed3c0f7-9ff8-4a9d-a808-072b4795460e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:43.116337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bed3c0f7-9ff8-4a9d-a808-072b4795460e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:43.116775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bed3c0f7-9ff8-4a9d-a808-072b4795460e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:43.198197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5f28b6c9-4631-4b55-9357-e2c9d1a5dc35 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:43.198810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5f28b6c9-4631-4b55-9357-e2c9d1a5dc35 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:43.205436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f28b6c9-4631-4b55-9357-e2c9d1a5dc35 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:43.205889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f28b6c9-4631-4b55-9357-e2c9d1a5dc35 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:43.206651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f28b6c9-4631-4b55-9357-e2c9d1a5dc35 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:43.207088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5f28b6c9-4631-4b55-9357-e2c9d1a5dc35 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:43.253692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bed3c0f7-9ff8-4a9d-a808-072b4795460e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:43.262247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bed3c0f7-9ff8-4a9d-a808-072b4795460e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.158120 Jun 20 07:33:43.262793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1045/2204] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:43 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:43.269739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5f28b6c9-4631-4b55-9357-e2c9d1a5dc35 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:43.278273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5f28b6c9-4631-4b55-9357-e2c9d1a5dc35 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083865 Jun 20 07:33:43.278833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1160/2205] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:43 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:44.279765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a9d05343-6a82-41f3-8367-40fff995795b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:44.280410 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a9d05343-6a82-41f3-8367-40fff995795b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:44.286876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9d05343-6a82-41f3-8367-40fff995795b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:44.287321 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9d05343-6a82-41f3-8367-40fff995795b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:44.288073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9d05343-6a82-41f3-8367-40fff995795b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:44.288544 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9d05343-6a82-41f3-8367-40fff995795b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:44.294556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a40dd561-e837-4152-9f21-266063a4f053 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:44.295195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a40dd561-e837-4152-9f21-266063a4f053 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:44.301622 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a40dd561-e837-4152-9f21-266063a4f053 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:44.302075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a40dd561-e837-4152-9f21-266063a4f053 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:44.302839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a40dd561-e837-4152-9f21-266063a4f053 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:44.303281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a40dd561-e837-4152-9f21-266063a4f053 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:44.379298 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a40dd561-e837-4152-9f21-266063a4f053 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:44.387782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a40dd561-e837-4152-9f21-266063a4f053 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.097013 Jun 20 07:33:44.388382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1161/2206] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:44 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:44.442919 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a9d05343-6a82-41f3-8367-40fff995795b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:44.450858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a9d05343-6a82-41f3-8367-40fff995795b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.174899 Jun 20 07:33:44.451420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1046/2207] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:44 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:45.405117 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7d8bff5c-0efc-49ab-89b7-84223568d218 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:45.405713 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7d8bff5c-0efc-49ab-89b7-84223568d218 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:45.412233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d8bff5c-0efc-49ab-89b7-84223568d218 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:45.412685 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d8bff5c-0efc-49ab-89b7-84223568d218 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:45.413437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d8bff5c-0efc-49ab-89b7-84223568d218 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:45.413896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d8bff5c-0efc-49ab-89b7-84223568d218 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:45.467833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-318f8207-b8a1-46d3-a009-35b6fc5a0681 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:45.468589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-318f8207-b8a1-46d3-a009-35b6fc5a0681 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:45.475646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-318f8207-b8a1-46d3-a009-35b6fc5a0681 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:45.476099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-318f8207-b8a1-46d3-a009-35b6fc5a0681 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:45.476879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-318f8207-b8a1-46d3-a009-35b6fc5a0681 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:45.477293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-318f8207-b8a1-46d3-a009-35b6fc5a0681 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:45.478770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7d8bff5c-0efc-49ab-89b7-84223568d218 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:45.487206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7d8bff5c-0efc-49ab-89b7-84223568d218 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086020 Jun 20 07:33:45.487788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1162/2208] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:45 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:45.604363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-318f8207-b8a1-46d3-a009-35b6fc5a0681 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:45.612390 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-318f8207-b8a1-46d3-a009-35b6fc5a0681 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148356 Jun 20 07:33:45.612981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1047/2209] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:45 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:46.505218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-533af8f9-ff25-4366-9b20-98969b4d6e86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:46.505824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-533af8f9-ff25-4366-9b20-98969b4d6e86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:46.512253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-533af8f9-ff25-4366-9b20-98969b4d6e86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:46.512694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-533af8f9-ff25-4366-9b20-98969b4d6e86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:46.513442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-533af8f9-ff25-4366-9b20-98969b4d6e86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:46.513871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-533af8f9-ff25-4366-9b20-98969b4d6e86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:46.574165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-533af8f9-ff25-4366-9b20-98969b4d6e86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:46.581919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-533af8f9-ff25-4366-9b20-98969b4d6e86 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081326 Jun 20 07:33:46.582474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1163/2210] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:46 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:46.630846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-272eb4f1-57d3-4ed8-81a0-dc62690fa0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:46.631467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-272eb4f1-57d3-4ed8-81a0-dc62690fa0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:46.633885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:33:46.639131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-272eb4f1-57d3-4ed8-81a0-dc62690fa0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:46.639585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-272eb4f1-57d3-4ed8-81a0-dc62690fa0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:46.640372 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-272eb4f1-57d3-4ed8-81a0-dc62690fa0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:46.640814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-272eb4f1-57d3-4ed8-81a0-dc62690fa0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:46.770626 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-272eb4f1-57d3-4ed8-81a0-dc62690fa0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:46.778495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-272eb4f1-57d3-4ed8-81a0-dc62690fa0cc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.152370 Jun 20 07:33:46.779063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1048/2211] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:46 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:47.599455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1f10e924-8571-41c3-a975-03fd9d2c4820 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:47.600232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1f10e924-8571-41c3-a975-03fd9d2c4820 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:47.607248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f10e924-8571-41c3-a975-03fd9d2c4820 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:47.607852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f10e924-8571-41c3-a975-03fd9d2c4820 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:47.608764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f10e924-8571-41c3-a975-03fd9d2c4820 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:47.609243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f10e924-8571-41c3-a975-03fd9d2c4820 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:47.670439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f10e924-8571-41c3-a975-03fd9d2c4820 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:47.678360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1f10e924-8571-41c3-a975-03fd9d2c4820 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083377 Jun 20 07:33:47.678921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1164/2212] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:47 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:47.795663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-58dbb37e-d41f-4631-8663-a7c285df5d2b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:47.796337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-58dbb37e-d41f-4631-8663-a7c285df5d2b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:47.802867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58dbb37e-d41f-4631-8663-a7c285df5d2b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:47.803316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58dbb37e-d41f-4631-8663-a7c285df5d2b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:47.804069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58dbb37e-d41f-4631-8663-a7c285df5d2b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:47.804539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58dbb37e-d41f-4631-8663-a7c285df5d2b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:47.928909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-58dbb37e-d41f-4631-8663-a7c285df5d2b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:47.936796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-58dbb37e-d41f-4631-8663-a7c285df5d2b tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145028 Jun 20 07:33:47.937362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1049/2213] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:47 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:48.695574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-83b1ea09-65c8-4a36-9274-060b50a490c9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:48.696216 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-83b1ea09-65c8-4a36-9274-060b50a490c9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:48.698524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:33:48.703950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83b1ea09-65c8-4a36-9274-060b50a490c9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:48.704368 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83b1ea09-65c8-4a36-9274-060b50a490c9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:48.705141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83b1ea09-65c8-4a36-9274-060b50a490c9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:48.705577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-83b1ea09-65c8-4a36-9274-060b50a490c9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:48.769342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-83b1ea09-65c8-4a36-9274-060b50a490c9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:48.777806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-83b1ea09-65c8-4a36-9274-060b50a490c9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086691 Jun 20 07:33:48.778376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1165/2214] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:48 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:48.954281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5965f9c4-9678-4062-943d-b19ab80e8c81 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:48.954833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5965f9c4-9678-4062-943d-b19ab80e8c81 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:48.961606 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5965f9c4-9678-4062-943d-b19ab80e8c81 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:48.962064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5965f9c4-9678-4062-943d-b19ab80e8c81 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:48.962828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5965f9c4-9678-4062-943d-b19ab80e8c81 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:48.963274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5965f9c4-9678-4062-943d-b19ab80e8c81 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:49.314599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5965f9c4-9678-4062-943d-b19ab80e8c81 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:49.323313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5965f9c4-9678-4062-943d-b19ab80e8c81 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.372976 Jun 20 07:33:49.323881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1050/2215] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:48 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:49.794421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9de0804c-6325-4de8-aada-d4f6261090f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:49.795027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9de0804c-6325-4de8-aada-d4f6261090f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:49.801987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9de0804c-6325-4de8-aada-d4f6261090f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:49.802503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9de0804c-6325-4de8-aada-d4f6261090f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:49.803259 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9de0804c-6325-4de8-aada-d4f6261090f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:49.803687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9de0804c-6325-4de8-aada-d4f6261090f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:49.865428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9de0804c-6325-4de8-aada-d4f6261090f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:49.873163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9de0804c-6325-4de8-aada-d4f6261090f5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082541 Jun 20 07:33:49.873725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1166/2216] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:49 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:50.341329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a232dfe3-3168-4d28-a7a5-06255b54757a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:50.341972 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a232dfe3-3168-4d28-a7a5-06255b54757a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:50.348181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a232dfe3-3168-4d28-a7a5-06255b54757a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:50.348642 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a232dfe3-3168-4d28-a7a5-06255b54757a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:50.349402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a232dfe3-3168-4d28-a7a5-06255b54757a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:50.349846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a232dfe3-3168-4d28-a7a5-06255b54757a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:50.478474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a232dfe3-3168-4d28-a7a5-06255b54757a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:50.486402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a232dfe3-3168-4d28-a7a5-06255b54757a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149173 Jun 20 07:33:50.486967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1051/2217] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:50 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:50.890082 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3ff3489a-3549-4f9d-a1b3-b631a8c489d5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:50.890692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3ff3489a-3549-4f9d-a1b3-b631a8c489d5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:50.897161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ff3489a-3549-4f9d-a1b3-b631a8c489d5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:50.897603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ff3489a-3549-4f9d-a1b3-b631a8c489d5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:50.898346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ff3489a-3549-4f9d-a1b3-b631a8c489d5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:50.898777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ff3489a-3549-4f9d-a1b3-b631a8c489d5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:50.958501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3ff3489a-3549-4f9d-a1b3-b631a8c489d5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:50.966183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3ff3489a-3549-4f9d-a1b3-b631a8c489d5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080011 Jun 20 07:33:50.966737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1167/2218] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:50 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:51.504767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d16640f1-0952-4dd5-817b-e2581f76c768 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:51.505331 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d16640f1-0952-4dd5-817b-e2581f76c768 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:51.511771 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d16640f1-0952-4dd5-817b-e2581f76c768 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:51.512259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d16640f1-0952-4dd5-817b-e2581f76c768 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:51.513017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d16640f1-0952-4dd5-817b-e2581f76c768 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:51.513462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d16640f1-0952-4dd5-817b-e2581f76c768 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:51.638139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d16640f1-0952-4dd5-817b-e2581f76c768 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:51.640358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:33:51.647829 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d16640f1-0952-4dd5-817b-e2581f76c768 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147735 Jun 20 07:33:51.648434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1052/2219] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:51 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:51.983138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-49bdc6fa-1e1e-472c-8229-c93e9894aa4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:51.983782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-49bdc6fa-1e1e-472c-8229-c93e9894aa4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:51.990740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49bdc6fa-1e1e-472c-8229-c93e9894aa4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:51.991188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49bdc6fa-1e1e-472c-8229-c93e9894aa4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:51.991941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49bdc6fa-1e1e-472c-8229-c93e9894aa4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:51.992397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-49bdc6fa-1e1e-472c-8229-c93e9894aa4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:52.054910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-49bdc6fa-1e1e-472c-8229-c93e9894aa4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:52.064611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-49bdc6fa-1e1e-472c-8229-c93e9894aa4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085061 Jun 20 07:33:52.065661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1168/2220] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:51 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:52.571779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:33:52.572288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:33:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:33:52.664721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b21db93-a8b2-4d0c-b960-2cab95156018 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:52.665336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b21db93-a8b2-4d0c-b960-2cab95156018 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:52.671905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b21db93-a8b2-4d0c-b960-2cab95156018 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:52.672384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b21db93-a8b2-4d0c-b960-2cab95156018 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:52.673135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b21db93-a8b2-4d0c-b960-2cab95156018 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:52.673574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b21db93-a8b2-4d0c-b960-2cab95156018 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:52.798177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:33:52.798385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:33:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:33:52.808196 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b21db93-a8b2-4d0c-b960-2cab95156018 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:52.815985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b21db93-a8b2-4d0c-b960-2cab95156018 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.155585 Jun 20 07:33:52.816599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1053/2221] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:52 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:53.083293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e6c49f9-b00c-483d-b5d6-89db3e1823aa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:53.083911 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7e6c49f9-b00c-483d-b5d6-89db3e1823aa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:53.090801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e6c49f9-b00c-483d-b5d6-89db3e1823aa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:53.091320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e6c49f9-b00c-483d-b5d6-89db3e1823aa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:53.092013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e6c49f9-b00c-483d-b5d6-89db3e1823aa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:53.092478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e6c49f9-b00c-483d-b5d6-89db3e1823aa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:53.111947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:33:53.158389 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e6c49f9-b00c-483d-b5d6-89db3e1823aa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:53.166358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7e6c49f9-b00c-483d-b5d6-89db3e1823aa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.087653 Jun 20 07:33:53.166924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1169/2222] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:53 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:53.832967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b2b75b4-889b-4355-8109-415e65d4d3df tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:53.833590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4b2b75b4-889b-4355-8109-415e65d4d3df tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:53.840014 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b2b75b4-889b-4355-8109-415e65d4d3df tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:53.840499 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b2b75b4-889b-4355-8109-415e65d4d3df tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:53.841262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b2b75b4-889b-4355-8109-415e65d4d3df tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:53.841710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b2b75b4-889b-4355-8109-415e65d4d3df tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:53.969953 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4b2b75b4-889b-4355-8109-415e65d4d3df tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:53.978305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4b2b75b4-889b-4355-8109-415e65d4d3df tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149228 Jun 20 07:33:53.978872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1054/2223] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:53 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:54.182577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-384d7b61-61cc-43fd-a76d-e0b1a33dfbb0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:54.183199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-384d7b61-61cc-43fd-a76d-e0b1a33dfbb0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:54.189587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-384d7b61-61cc-43fd-a76d-e0b1a33dfbb0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:54.190030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-384d7b61-61cc-43fd-a76d-e0b1a33dfbb0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:54.190774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-384d7b61-61cc-43fd-a76d-e0b1a33dfbb0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:54.191219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-384d7b61-61cc-43fd-a76d-e0b1a33dfbb0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:54.251173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-384d7b61-61cc-43fd-a76d-e0b1a33dfbb0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:54.259441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-384d7b61-61cc-43fd-a76d-e0b1a33dfbb0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080637 Jun 20 07:33:54.260033 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1170/2224] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:54 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:54.995563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d130d16b-f353-4e54-8375-a38dc2142160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:54.996174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d130d16b-f353-4e54-8375-a38dc2142160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:55.002631 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d130d16b-f353-4e54-8375-a38dc2142160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:55.003077 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d130d16b-f353-4e54-8375-a38dc2142160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:55.004710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d130d16b-f353-4e54-8375-a38dc2142160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:55.005158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d130d16b-f353-4e54-8375-a38dc2142160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:55.131838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d130d16b-f353-4e54-8375-a38dc2142160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:55.139586 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d130d16b-f353-4e54-8375-a38dc2142160 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147941 Jun 20 07:33:55.140175 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1055/2225] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:54 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:55.277099 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d36b3d85-6722-4a6b-951d-0c304f65e65b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:55.279224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d36b3d85-6722-4a6b-951d-0c304f65e65b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:55.286277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d36b3d85-6722-4a6b-951d-0c304f65e65b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:55.286724 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d36b3d85-6722-4a6b-951d-0c304f65e65b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:55.287495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d36b3d85-6722-4a6b-951d-0c304f65e65b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:55.287931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d36b3d85-6722-4a6b-951d-0c304f65e65b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:55.351225 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d36b3d85-6722-4a6b-951d-0c304f65e65b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:55.359104 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d36b3d85-6722-4a6b-951d-0c304f65e65b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086847 Jun 20 07:33:55.359671 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1171/2226] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:55 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:56.156473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7662098c-dff7-4fea-8a14-dbe9daac72a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:56.157094 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7662098c-dff7-4fea-8a14-dbe9daac72a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:56.164190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7662098c-dff7-4fea-8a14-dbe9daac72a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:56.164640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7662098c-dff7-4fea-8a14-dbe9daac72a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:56.165392 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7662098c-dff7-4fea-8a14-dbe9daac72a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:56.165826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7662098c-dff7-4fea-8a14-dbe9daac72a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:56.291588 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7662098c-dff7-4fea-8a14-dbe9daac72a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:56.299513 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7662098c-dff7-4fea-8a14-dbe9daac72a8 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146912 Jun 20 07:33:56.300079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1056/2227] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:56 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:56.376200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e03e7b3a-fce8-42c3-9bfb-adc5f067f7e9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:56.376812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e03e7b3a-fce8-42c3-9bfb-adc5f067f7e9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:56.383601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e03e7b3a-fce8-42c3-9bfb-adc5f067f7e9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:56.384045 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e03e7b3a-fce8-42c3-9bfb-adc5f067f7e9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:56.384828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e03e7b3a-fce8-42c3-9bfb-adc5f067f7e9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:56.385260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e03e7b3a-fce8-42c3-9bfb-adc5f067f7e9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:56.447564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e03e7b3a-fce8-42c3-9bfb-adc5f067f7e9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:56.456137 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e03e7b3a-fce8-42c3-9bfb-adc5f067f7e9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083432 Jun 20 07:33:56.456579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1172/2228] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:56 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:57.317832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-97784e59-8848-4c84-9bc5-5c81627f94ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:57.318395 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-97784e59-8848-4c84-9bc5-5c81627f94ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:57.325131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97784e59-8848-4c84-9bc5-5c81627f94ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:57.325580 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97784e59-8848-4c84-9bc5-5c81627f94ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:57.326342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97784e59-8848-4c84-9bc5-5c81627f94ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:57.326782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97784e59-8848-4c84-9bc5-5c81627f94ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:57.456905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-97784e59-8848-4c84-9bc5-5c81627f94ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:57.464734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-97784e59-8848-4c84-9bc5-5c81627f94ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151500 Jun 20 07:33:57.465298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1057/2229] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:57 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:57.473322 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-78da7735-7030-4cdc-8c40-a501448c3bdc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:57.473937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-78da7735-7030-4cdc-8c40-a501448c3bdc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:57.480412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78da7735-7030-4cdc-8c40-a501448c3bdc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:57.480847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78da7735-7030-4cdc-8c40-a501448c3bdc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:57.481591 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78da7735-7030-4cdc-8c40-a501448c3bdc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:57.482022 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-78da7735-7030-4cdc-8c40-a501448c3bdc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:57.543019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-78da7735-7030-4cdc-8c40-a501448c3bdc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:57.551616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-78da7735-7030-4cdc-8c40-a501448c3bdc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081990 Jun 20 07:33:57.552186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1173/2230] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:57 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:58.481922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f62fd664-3710-4e56-8475-267b27769230 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:58.482540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f62fd664-3710-4e56-8475-267b27769230 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:58.489011 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f62fd664-3710-4e56-8475-267b27769230 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:58.489466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f62fd664-3710-4e56-8475-267b27769230 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:58.490221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f62fd664-3710-4e56-8475-267b27769230 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:58.490662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f62fd664-3710-4e56-8475-267b27769230 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:58.568525 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2fbff31b-efb9-45c6-b0ca-2eab1efcad89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:58.569140 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2fbff31b-efb9-45c6-b0ca-2eab1efcad89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:58.575603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fbff31b-efb9-45c6-b0ca-2eab1efcad89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:58.576054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fbff31b-efb9-45c6-b0ca-2eab1efcad89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:58.576873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fbff31b-efb9-45c6-b0ca-2eab1efcad89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:58.577306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2fbff31b-efb9-45c6-b0ca-2eab1efcad89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:58.627526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f62fd664-3710-4e56-8475-267b27769230 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:58.636424 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f62fd664-3710-4e56-8475-267b27769230 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.158346 Jun 20 07:33:58.636998 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1058/2231] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:58 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:33:58.643474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2fbff31b-efb9-45c6-b0ca-2eab1efcad89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:58.651509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2fbff31b-efb9-45c6-b0ca-2eab1efcad89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.087565 Jun 20 07:33:58.652061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1174/2232] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:58 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:59.653387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a6eebd97-c279-4975-aaca-2013154d522d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:59.654031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a6eebd97-c279-4975-aaca-2013154d522d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:59.661139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6eebd97-c279-4975-aaca-2013154d522d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:59.661615 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6eebd97-c279-4975-aaca-2013154d522d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:59.662402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6eebd97-c279-4975-aaca-2013154d522d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:59.662925 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6eebd97-c279-4975-aaca-2013154d522d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:59.667747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-31b39a3d-06aa-4829-8bf2-93d4c775a798 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:33:59.668391 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-31b39a3d-06aa-4829-8bf2-93d4c775a798 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:33:59.674657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31b39a3d-06aa-4829-8bf2-93d4c775a798 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:59.675091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31b39a3d-06aa-4829-8bf2-93d4c775a798 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:59.675863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31b39a3d-06aa-4829-8bf2-93d4c775a798 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:33:59.676326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-31b39a3d-06aa-4829-8bf2-93d4c775a798 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:33:59.760956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-31b39a3d-06aa-4829-8bf2-93d4c775a798 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:59.768734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-31b39a3d-06aa-4829-8bf2-93d4c775a798 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.104702 Jun 20 07:33:59.769285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1175/2233] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:59 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:33:59.817072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6eebd97-c279-4975-aaca-2013154d522d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:33:59.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a6eebd97-c279-4975-aaca-2013154d522d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.175366 Jun 20 07:33:59.825426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1059/2234] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:33:59 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:00.786550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f66d3ea9-1239-43e5-8ad7-fa0de9218c83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:00.787155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f66d3ea9-1239-43e5-8ad7-fa0de9218c83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:00.793636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f66d3ea9-1239-43e5-8ad7-fa0de9218c83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:00.794085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f66d3ea9-1239-43e5-8ad7-fa0de9218c83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:00.794827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f66d3ea9-1239-43e5-8ad7-fa0de9218c83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:00.795254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f66d3ea9-1239-43e5-8ad7-fa0de9218c83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:00.842697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d661312e-2f96-444b-bc18-93beeabcbd98 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:00.843312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d661312e-2f96-444b-bc18-93beeabcbd98 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:00.850252 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d661312e-2f96-444b-bc18-93beeabcbd98 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:00.850696 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d661312e-2f96-444b-bc18-93beeabcbd98 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:00.851459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d661312e-2f96-444b-bc18-93beeabcbd98 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:00.851891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d661312e-2f96-444b-bc18-93beeabcbd98 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:00.855687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f66d3ea9-1239-43e5-8ad7-fa0de9218c83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:00.863479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f66d3ea9-1239-43e5-8ad7-fa0de9218c83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081287 Jun 20 07:34:00.864590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1176/2235] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:00 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:00.981257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d661312e-2f96-444b-bc18-93beeabcbd98 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:00.989059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d661312e-2f96-444b-bc18-93beeabcbd98 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150297 Jun 20 07:34:00.989620 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1060/2236] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:00 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:01.881702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8d42d487-56c7-4bfc-86b7-4bc6569662a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:01.882425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8d42d487-56c7-4bfc-86b7-4bc6569662a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:01.889566 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d42d487-56c7-4bfc-86b7-4bc6569662a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:01.890016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d42d487-56c7-4bfc-86b7-4bc6569662a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:01.890781 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d42d487-56c7-4bfc-86b7-4bc6569662a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:01.891215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8d42d487-56c7-4bfc-86b7-4bc6569662a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:01.951043 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8d42d487-56c7-4bfc-86b7-4bc6569662a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:01.959025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8d42d487-56c7-4bfc-86b7-4bc6569662a0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081742 Jun 20 07:34:01.959524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1177/2237] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:01 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:02.005892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61cacd6a-63d5-4704-a43a-77cedcf38a4a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:02.006533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61cacd6a-63d5-4704-a43a-77cedcf38a4a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:02.012976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61cacd6a-63d5-4704-a43a-77cedcf38a4a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:02.013424 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61cacd6a-63d5-4704-a43a-77cedcf38a4a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:02.014175 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61cacd6a-63d5-4704-a43a-77cedcf38a4a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:02.014639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61cacd6a-63d5-4704-a43a-77cedcf38a4a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:02.140505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61cacd6a-63d5-4704-a43a-77cedcf38a4a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:02.148258 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61cacd6a-63d5-4704-a43a-77cedcf38a4a tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146415 Jun 20 07:34:02.148820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1061/2238] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:02 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:02.975635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-09a51495-039f-4040-9a1b-d1dd4604627f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:02.976189 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-09a51495-039f-4040-9a1b-d1dd4604627f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:02.982731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09a51495-039f-4040-9a1b-d1dd4604627f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:02.983178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09a51495-039f-4040-9a1b-d1dd4604627f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:02.983936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09a51495-039f-4040-9a1b-d1dd4604627f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:02.984403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-09a51495-039f-4040-9a1b-d1dd4604627f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:03.048704 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-09a51495-039f-4040-9a1b-d1dd4604627f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:03.056537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-09a51495-039f-4040-9a1b-d1dd4604627f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084793 Jun 20 07:34:03.057095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1178/2239] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:02 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:03.164641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5320d17d-2c9c-4a92-8860-fd58234fc626 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:03.165291 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5320d17d-2c9c-4a92-8860-fd58234fc626 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:03.176264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5320d17d-2c9c-4a92-8860-fd58234fc626 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:03.176721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5320d17d-2c9c-4a92-8860-fd58234fc626 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:03.177485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5320d17d-2c9c-4a92-8860-fd58234fc626 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:03.177925 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5320d17d-2c9c-4a92-8860-fd58234fc626 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:03.302849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5320d17d-2c9c-4a92-8860-fd58234fc626 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:03.310673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5320d17d-2c9c-4a92-8860-fd58234fc626 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149965 Jun 20 07:34:03.311227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1062/2240] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:03 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:04.073749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-94a6b96d-9ae3-49b4-8640-0af65adc3e3f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:04.074367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-94a6b96d-9ae3-49b4-8640-0af65adc3e3f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:04.080391 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94a6b96d-9ae3-49b4-8640-0af65adc3e3f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:04.080850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94a6b96d-9ae3-49b4-8640-0af65adc3e3f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:04.081615 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94a6b96d-9ae3-49b4-8640-0af65adc3e3f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:04.082577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94a6b96d-9ae3-49b4-8640-0af65adc3e3f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:04.144193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-94a6b96d-9ae3-49b4-8640-0af65adc3e3f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:04.152494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-94a6b96d-9ae3-49b4-8640-0af65adc3e3f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082746 Jun 20 07:34:04.153068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1179/2241] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:04 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:04.328343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bdcc7c5e-6140-4e5e-b0b5-98683778d3ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:04.328865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bdcc7c5e-6140-4e5e-b0b5-98683778d3ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:04.335775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bdcc7c5e-6140-4e5e-b0b5-98683778d3ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:04.336255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bdcc7c5e-6140-4e5e-b0b5-98683778d3ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:04.337001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bdcc7c5e-6140-4e5e-b0b5-98683778d3ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:04.337431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bdcc7c5e-6140-4e5e-b0b5-98683778d3ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:04.465581 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bdcc7c5e-6140-4e5e-b0b5-98683778d3ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:04.473554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bdcc7c5e-6140-4e5e-b0b5-98683778d3ee tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149197 Jun 20 07:34:04.474115 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1063/2242] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:04 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:05.169926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fb26d258-9a6c-4dff-9f67-4475b09ec116 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:05.170530 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fb26d258-9a6c-4dff-9f67-4475b09ec116 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:05.177552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb26d258-9a6c-4dff-9f67-4475b09ec116 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:05.177993 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb26d258-9a6c-4dff-9f67-4475b09ec116 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:05.178733 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb26d258-9a6c-4dff-9f67-4475b09ec116 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:05.179163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb26d258-9a6c-4dff-9f67-4475b09ec116 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:05.239128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fb26d258-9a6c-4dff-9f67-4475b09ec116 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:05.246858 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fb26d258-9a6c-4dff-9f67-4475b09ec116 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080831 Jun 20 07:34:05.247407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1180/2243] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:05 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:05.490466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61eb3e3a-7174-4d49-9553-9924babda27e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:05.491005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61eb3e3a-7174-4d49-9553-9924babda27e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:05.497447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61eb3e3a-7174-4d49-9553-9924babda27e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:05.497889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61eb3e3a-7174-4d49-9553-9924babda27e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:05.498630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61eb3e3a-7174-4d49-9553-9924babda27e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:05.499058 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61eb3e3a-7174-4d49-9553-9924babda27e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:05.624813 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61eb3e3a-7174-4d49-9553-9924babda27e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:05.633236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61eb3e3a-7174-4d49-9553-9924babda27e tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146660 Jun 20 07:34:05.633799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1064/2244] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:05 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:06.264087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b5b7a327-9562-4cee-bc1c-6ab449639bd6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:06.264744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b5b7a327-9562-4cee-bc1c-6ab449639bd6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:06.271716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5b7a327-9562-4cee-bc1c-6ab449639bd6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:06.272185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5b7a327-9562-4cee-bc1c-6ab449639bd6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:06.272941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5b7a327-9562-4cee-bc1c-6ab449639bd6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:06.273372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5b7a327-9562-4cee-bc1c-6ab449639bd6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:06.336041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b5b7a327-9562-4cee-bc1c-6ab449639bd6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:06.343863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b5b7a327-9562-4cee-bc1c-6ab449639bd6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083664 Jun 20 07:34:06.344453 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1181/2245] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:06 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:06.650818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a9233b75-6ea6-4c23-bd73-33f990d26a22 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:06.651365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a9233b75-6ea6-4c23-bd73-33f990d26a22 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:06.658239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9233b75-6ea6-4c23-bd73-33f990d26a22 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:06.658686 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9233b75-6ea6-4c23-bd73-33f990d26a22 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:06.659442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9233b75-6ea6-4c23-bd73-33f990d26a22 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:06.659902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9233b75-6ea6-4c23-bd73-33f990d26a22 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:06.786734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a9233b75-6ea6-4c23-bd73-33f990d26a22 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:06.794646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a9233b75-6ea6-4c23-bd73-33f990d26a22 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147709 Jun 20 07:34:06.795212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1065/2246] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:06 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:07.361206 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-71e17026-528c-4f89-b443-d4aefd244ba2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:07.361830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-71e17026-528c-4f89-b443-d4aefd244ba2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:07.368960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71e17026-528c-4f89-b443-d4aefd244ba2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:07.369407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71e17026-528c-4f89-b443-d4aefd244ba2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:07.370157 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71e17026-528c-4f89-b443-d4aefd244ba2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:07.370595 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-71e17026-528c-4f89-b443-d4aefd244ba2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:07.431593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-71e17026-528c-4f89-b443-d4aefd244ba2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:07.439440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-71e17026-528c-4f89-b443-d4aefd244ba2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082121 Jun 20 07:34:07.439996 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1182/2247] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:07 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:07.812059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7f61fe8e-f3bc-4dbf-bd23-9bf2ff7100db tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:07.812695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7f61fe8e-f3bc-4dbf-bd23-9bf2ff7100db tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:07.819265 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f61fe8e-f3bc-4dbf-bd23-9bf2ff7100db tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:07.819717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f61fe8e-f3bc-4dbf-bd23-9bf2ff7100db tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:07.820509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f61fe8e-f3bc-4dbf-bd23-9bf2ff7100db tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:07.820955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f61fe8e-f3bc-4dbf-bd23-9bf2ff7100db tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:07.949232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7f61fe8e-f3bc-4dbf-bd23-9bf2ff7100db tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:07.957648 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7f61fe8e-f3bc-4dbf-bd23-9bf2ff7100db tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149478 Jun 20 07:34:07.958222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1066/2248] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:07 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:08.455280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c21732e4-61aa-4d51-8ecf-74721a04b3d4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:08.455885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c21732e4-61aa-4d51-8ecf-74721a04b3d4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:08.462376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c21732e4-61aa-4d51-8ecf-74721a04b3d4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:08.462973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c21732e4-61aa-4d51-8ecf-74721a04b3d4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:08.463562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c21732e4-61aa-4d51-8ecf-74721a04b3d4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:08.463991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c21732e4-61aa-4d51-8ecf-74721a04b3d4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:08.523757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c21732e4-61aa-4d51-8ecf-74721a04b3d4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:08.531491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c21732e4-61aa-4d51-8ecf-74721a04b3d4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080033 Jun 20 07:34:08.532052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1183/2249] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:08 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:08.975072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0ebfdbd6-e70b-4a6b-b8b1-8bdd915b08e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:08.975635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0ebfdbd6-e70b-4a6b-b8b1-8bdd915b08e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:08.982201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ebfdbd6-e70b-4a6b-b8b1-8bdd915b08e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:08.982650 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ebfdbd6-e70b-4a6b-b8b1-8bdd915b08e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:08.983405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ebfdbd6-e70b-4a6b-b8b1-8bdd915b08e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:08.983846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ebfdbd6-e70b-4a6b-b8b1-8bdd915b08e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:09.110014 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0ebfdbd6-e70b-4a6b-b8b1-8bdd915b08e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:09.118539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0ebfdbd6-e70b-4a6b-b8b1-8bdd915b08e2 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147943 Jun 20 07:34:09.119101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1067/2250] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:08 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:09.547983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-da816910-bc31-4057-9813-963b63141a07 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:09.548617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-da816910-bc31-4057-9813-963b63141a07 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:09.555035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da816910-bc31-4057-9813-963b63141a07 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:09.555474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da816910-bc31-4057-9813-963b63141a07 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:09.556248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da816910-bc31-4057-9813-963b63141a07 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:09.556675 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da816910-bc31-4057-9813-963b63141a07 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:09.618809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-da816910-bc31-4057-9813-963b63141a07 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:09.626615 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-da816910-bc31-4057-9813-963b63141a07 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082468 Jun 20 07:34:09.627166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1184/2251] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:09 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:10.135706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c4185de5-28d5-41cd-aeaf-815c707dd533 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:10.136348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c4185de5-28d5-41cd-aeaf-815c707dd533 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:10.142788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4185de5-28d5-41cd-aeaf-815c707dd533 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:10.143240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4185de5-28d5-41cd-aeaf-815c707dd533 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:10.144000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4185de5-28d5-41cd-aeaf-815c707dd533 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:10.144493 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4185de5-28d5-41cd-aeaf-815c707dd533 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:10.269253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c4185de5-28d5-41cd-aeaf-815c707dd533 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:10.277363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c4185de5-28d5-41cd-aeaf-815c707dd533 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145543 Jun 20 07:34:10.277926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1068/2252] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:10 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:10.644861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9025ac31-e04a-46b9-a01b-209fbb8e6d7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:10.645500 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9025ac31-e04a-46b9-a01b-209fbb8e6d7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:10.651973 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9025ac31-e04a-46b9-a01b-209fbb8e6d7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:10.652436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9025ac31-e04a-46b9-a01b-209fbb8e6d7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:10.653196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9025ac31-e04a-46b9-a01b-209fbb8e6d7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:10.653656 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9025ac31-e04a-46b9-a01b-209fbb8e6d7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:10.716784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9025ac31-e04a-46b9-a01b-209fbb8e6d7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:10.725301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9025ac31-e04a-46b9-a01b-209fbb8e6d7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084777 Jun 20 07:34:10.725898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1185/2253] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:10 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:11.294996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-664af75a-4f0d-4443-bb02-09290769be86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:11.295614 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-664af75a-4f0d-4443-bb02-09290769be86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:11.302056 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-664af75a-4f0d-4443-bb02-09290769be86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:11.302508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-664af75a-4f0d-4443-bb02-09290769be86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:11.303268 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-664af75a-4f0d-4443-bb02-09290769be86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:11.303707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-664af75a-4f0d-4443-bb02-09290769be86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:11.318659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:34:11.433678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-664af75a-4f0d-4443-bb02-09290769be86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:11.442185 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-664af75a-4f0d-4443-bb02-09290769be86 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151049 Jun 20 07:34:11.442767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1069/2254] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:11 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:11.742572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e1904711-d611-4f3f-a3bd-2de36ac4d676 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:11.743217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e1904711-d611-4f3f-a3bd-2de36ac4d676 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:11.749659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1904711-d611-4f3f-a3bd-2de36ac4d676 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:11.750109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1904711-d611-4f3f-a3bd-2de36ac4d676 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:11.750866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1904711-d611-4f3f-a3bd-2de36ac4d676 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:11.751305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e1904711-d611-4f3f-a3bd-2de36ac4d676 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:11.754061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:34:11.812285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e1904711-d611-4f3f-a3bd-2de36ac4d676 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:11.819966 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e1904711-d611-4f3f-a3bd-2de36ac4d676 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081887 Jun 20 07:34:11.820557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1186/2255] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:11 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:12.459652 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7d42354c-2359-44d7-868c-eb8489091b82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:12.460311 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7d42354c-2359-44d7-868c-eb8489091b82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:12.466837 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d42354c-2359-44d7-868c-eb8489091b82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:12.467290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d42354c-2359-44d7-868c-eb8489091b82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:12.468052 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d42354c-2359-44d7-868c-eb8489091b82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:12.468519 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d42354c-2359-44d7-868c-eb8489091b82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:12.598032 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d42354c-2359-44d7-868c-eb8489091b82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:12.605931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7d42354c-2359-44d7-868c-eb8489091b82 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150634 Jun 20 07:34:12.606494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1070/2256] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:12 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:12.837162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b852c09e-e903-4791-b3b9-aea72593dd82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:12.837797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b852c09e-e903-4791-b3b9-aea72593dd82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:12.844234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b852c09e-e903-4791-b3b9-aea72593dd82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:12.844675 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b852c09e-e903-4791-b3b9-aea72593dd82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:12.845449 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b852c09e-e903-4791-b3b9-aea72593dd82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:12.845878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b852c09e-e903-4791-b3b9-aea72593dd82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:12.908745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b852c09e-e903-4791-b3b9-aea72593dd82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:12.916565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b852c09e-e903-4791-b3b9-aea72593dd82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083201 Jun 20 07:34:12.917117 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1187/2257] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:12 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:13.622756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cde2e732-74e1-486c-a098-c44dfd75d81d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:13.623380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cde2e732-74e1-486c-a098-c44dfd75d81d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:13.630179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cde2e732-74e1-486c-a098-c44dfd75d81d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:13.630633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cde2e732-74e1-486c-a098-c44dfd75d81d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:13.631391 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cde2e732-74e1-486c-a098-c44dfd75d81d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:13.631833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cde2e732-74e1-486c-a098-c44dfd75d81d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:13.756650 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cde2e732-74e1-486c-a098-c44dfd75d81d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:13.764540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cde2e732-74e1-486c-a098-c44dfd75d81d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145669 Jun 20 07:34:13.765109 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1071/2258] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:13 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:13.933770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ea067a9c-4027-4e3e-8260-f982cf88f146 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:13.934350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ea067a9c-4027-4e3e-8260-f982cf88f146 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:13.940840 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea067a9c-4027-4e3e-8260-f982cf88f146 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:13.941290 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea067a9c-4027-4e3e-8260-f982cf88f146 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:13.942048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea067a9c-4027-4e3e-8260-f982cf88f146 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:13.942487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ea067a9c-4027-4e3e-8260-f982cf88f146 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:14.002129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ea067a9c-4027-4e3e-8260-f982cf88f146 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:14.011770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ea067a9c-4027-4e3e-8260-f982cf88f146 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081928 Jun 20 07:34:14.012362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1188/2259] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:13 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:14.782108 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8eaa714a-710b-48a2-ba27-e79791b248c6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:14.782764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8eaa714a-710b-48a2-ba27-e79791b248c6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:14.789787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8eaa714a-710b-48a2-ba27-e79791b248c6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:14.790237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8eaa714a-710b-48a2-ba27-e79791b248c6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:14.790997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8eaa714a-710b-48a2-ba27-e79791b248c6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:14.791439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8eaa714a-710b-48a2-ba27-e79791b248c6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:14.918477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8eaa714a-710b-48a2-ba27-e79791b248c6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:14.927421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8eaa714a-710b-48a2-ba27-e79791b248c6 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149130 Jun 20 07:34:14.927995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1072/2260] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:14 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:15.028972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9e3072d3-cb73-48c7-be23-73e658567107 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:15.029579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9e3072d3-cb73-48c7-be23-73e658567107 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:15.036548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e3072d3-cb73-48c7-be23-73e658567107 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:15.036942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e3072d3-cb73-48c7-be23-73e658567107 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:15.037686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e3072d3-cb73-48c7-be23-73e658567107 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:15.038113 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9e3072d3-cb73-48c7-be23-73e658567107 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:15.097672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9e3072d3-cb73-48c7-be23-73e658567107 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:15.105424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9e3072d3-cb73-48c7-be23-73e658567107 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080230 Jun 20 07:34:15.105980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1189/2261] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:15 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:15.944420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7de4f623-c401-4225-8b0c-e202d9f72514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:15.945075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7de4f623-c401-4225-8b0c-e202d9f72514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:15.951546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7de4f623-c401-4225-8b0c-e202d9f72514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:15.951995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7de4f623-c401-4225-8b0c-e202d9f72514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:15.952785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7de4f623-c401-4225-8b0c-e202d9f72514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:15.953230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7de4f623-c401-4225-8b0c-e202d9f72514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:16.077736 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7de4f623-c401-4225-8b0c-e202d9f72514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:16.086434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7de4f623-c401-4225-8b0c-e202d9f72514 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.145937 Jun 20 07:34:16.086996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1073/2262] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:15 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:16.122505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-590f37ae-2ca2-41a9-8a1d-705ae3397ddd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:16.123121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-590f37ae-2ca2-41a9-8a1d-705ae3397ddd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:16.129833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-590f37ae-2ca2-41a9-8a1d-705ae3397ddd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:16.130280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-590f37ae-2ca2-41a9-8a1d-705ae3397ddd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:16.131037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-590f37ae-2ca2-41a9-8a1d-705ae3397ddd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:16.131473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-590f37ae-2ca2-41a9-8a1d-705ae3397ddd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:16.194017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-590f37ae-2ca2-41a9-8a1d-705ae3397ddd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:16.201827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-590f37ae-2ca2-41a9-8a1d-705ae3397ddd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083119 Jun 20 07:34:16.202387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1190/2263] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:16 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:17.102665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d0026ad5-de0b-48c1-9e18-4d9e2c05faa0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:17.103288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d0026ad5-de0b-48c1-9e18-4d9e2c05faa0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:17.105599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:34:17.110888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0026ad5-de0b-48c1-9e18-4d9e2c05faa0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:17.111342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0026ad5-de0b-48c1-9e18-4d9e2c05faa0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:17.112100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0026ad5-de0b-48c1-9e18-4d9e2c05faa0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:17.112564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0026ad5-de0b-48c1-9e18-4d9e2c05faa0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:17.218851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c541dbe0-6c5c-4365-ab6c-ddb42eb370c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:17.219576 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c541dbe0-6c5c-4365-ab6c-ddb42eb370c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:17.226204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c541dbe0-6c5c-4365-ab6c-ddb42eb370c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:17.226735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c541dbe0-6c5c-4365-ab6c-ddb42eb370c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:17.227574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c541dbe0-6c5c-4365-ab6c-ddb42eb370c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:17.228077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c541dbe0-6c5c-4365-ab6c-ddb42eb370c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:17.241656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d0026ad5-de0b-48c1-9e18-4d9e2c05faa0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:17.249795 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d0026ad5-de0b-48c1-9e18-4d9e2c05faa0 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150938 Jun 20 07:34:17.250371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1074/2264] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:17 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:17.289262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c541dbe0-6c5c-4365-ab6c-ddb42eb370c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:17.296992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c541dbe0-6c5c-4365-ab6c-ddb42eb370c5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082048 Jun 20 07:34:17.297550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1191/2265] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:17 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:18.267875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7371bb52-c307-43c6-8448-3bc06dcc3ec4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:18.268523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7371bb52-c307-43c6-8448-3bc06dcc3ec4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:18.275534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7371bb52-c307-43c6-8448-3bc06dcc3ec4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:18.275986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7371bb52-c307-43c6-8448-3bc06dcc3ec4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:18.276791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7371bb52-c307-43c6-8448-3bc06dcc3ec4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:18.277234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7371bb52-c307-43c6-8448-3bc06dcc3ec4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:18.313586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b5a9d38d-b2e9-4532-b317-4ce8be47de42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:18.314201 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b5a9d38d-b2e9-4532-b317-4ce8be47de42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:18.320850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5a9d38d-b2e9-4532-b317-4ce8be47de42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:18.321298 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5a9d38d-b2e9-4532-b317-4ce8be47de42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:18.322067 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5a9d38d-b2e9-4532-b317-4ce8be47de42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:18.322502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5a9d38d-b2e9-4532-b317-4ce8be47de42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:18.397235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b5a9d38d-b2e9-4532-b317-4ce8be47de42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:18.405126 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b5a9d38d-b2e9-4532-b317-4ce8be47de42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.095270 Jun 20 07:34:18.405679 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1192/2266] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:18 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:18.429310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7371bb52-c307-43c6-8448-3bc06dcc3ec4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:18.437374 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7371bb52-c307-43c6-8448-3bc06dcc3ec4 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.173426 Jun 20 07:34:18.437942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1075/2267] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:18 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:19.422493 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9d3bda80-444a-4161-883e-be477ce46c47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:19.423093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9d3bda80-444a-4161-883e-be477ce46c47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:19.425404 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:34:19.431201 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d3bda80-444a-4161-883e-be477ce46c47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:19.431647 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d3bda80-444a-4161-883e-be477ce46c47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:19.432426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d3bda80-444a-4161-883e-be477ce46c47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:19.432862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d3bda80-444a-4161-883e-be477ce46c47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:19.458951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-856a4333-9abf-4f28-ba0c-3265868e612c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:19.459820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-856a4333-9abf-4f28-ba0c-3265868e612c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:19.466383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-856a4333-9abf-4f28-ba0c-3265868e612c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:19.466835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-856a4333-9abf-4f28-ba0c-3265868e612c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:19.467636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-856a4333-9abf-4f28-ba0c-3265868e612c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:19.468078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-856a4333-9abf-4f28-ba0c-3265868e612c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:19.493782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9d3bda80-444a-4161-883e-be477ce46c47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:19.501660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9d3bda80-444a-4161-883e-be477ce46c47 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083182 Jun 20 07:34:19.502223 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1193/2268] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:19 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:19.593621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-856a4333-9abf-4f28-ba0c-3265868e612c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:19.602076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-856a4333-9abf-4f28-ba0c-3265868e612c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146926 Jun 20 07:34:19.602643 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1076/2269] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:19 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:20.518793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ad08a7d8-c7dc-4ed0-b623-106ebec3e29d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:20.519410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ad08a7d8-c7dc-4ed0-b623-106ebec3e29d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:20.525903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad08a7d8-c7dc-4ed0-b623-106ebec3e29d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:20.526353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad08a7d8-c7dc-4ed0-b623-106ebec3e29d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:20.527121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad08a7d8-c7dc-4ed0-b623-106ebec3e29d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:20.527543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad08a7d8-c7dc-4ed0-b623-106ebec3e29d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:20.590177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad08a7d8-c7dc-4ed0-b623-106ebec3e29d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:20.598109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ad08a7d8-c7dc-4ed0-b623-106ebec3e29d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083220 Jun 20 07:34:20.598675 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1194/2270] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:20 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:20.619079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9ad7e541-6df0-41cf-a25a-3a82bc02a73d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:20.619736 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9ad7e541-6df0-41cf-a25a-3a82bc02a73d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:20.626181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ad7e541-6df0-41cf-a25a-3a82bc02a73d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:20.626637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ad7e541-6df0-41cf-a25a-3a82bc02a73d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:20.627401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ad7e541-6df0-41cf-a25a-3a82bc02a73d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:20.627846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ad7e541-6df0-41cf-a25a-3a82bc02a73d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:20.756694 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9ad7e541-6df0-41cf-a25a-3a82bc02a73d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:20.764509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9ad7e541-6df0-41cf-a25a-3a82bc02a73d tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149189 Jun 20 07:34:20.765079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1077/2271] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:20 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:21.614569 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ca240ddc-704a-402f-90b6-73a15db6cf2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:21.615188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ca240ddc-704a-402f-90b6-73a15db6cf2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:21.621663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca240ddc-704a-402f-90b6-73a15db6cf2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:21.622112 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca240ddc-704a-402f-90b6-73a15db6cf2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:21.622871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca240ddc-704a-402f-90b6-73a15db6cf2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:21.623310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca240ddc-704a-402f-90b6-73a15db6cf2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:21.683565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca240ddc-704a-402f-90b6-73a15db6cf2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:21.691920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ca240ddc-704a-402f-90b6-73a15db6cf2e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080706 Jun 20 07:34:21.692528 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1195/2272] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:21 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:21.781234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0ed99ced-372a-466b-8bf8-df04562439fc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:21.781857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0ed99ced-372a-466b-8bf8-df04562439fc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:21.788340 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ed99ced-372a-466b-8bf8-df04562439fc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:21.788795 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ed99ced-372a-466b-8bf8-df04562439fc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:21.789554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ed99ced-372a-466b-8bf8-df04562439fc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:21.789992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ed99ced-372a-466b-8bf8-df04562439fc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:21.917352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0ed99ced-372a-466b-8bf8-df04562439fc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:21.925251 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0ed99ced-372a-466b-8bf8-df04562439fc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147852 Jun 20 07:34:21.926371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1078/2273] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:21 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:22.709179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-cebef4f3-4b27-435a-8f94-645df3995883 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:22.709831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-cebef4f3-4b27-435a-8f94-645df3995883 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:22.716342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cebef4f3-4b27-435a-8f94-645df3995883 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:22.716846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cebef4f3-4b27-435a-8f94-645df3995883 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:22.717557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cebef4f3-4b27-435a-8f94-645df3995883 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:22.717999 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-cebef4f3-4b27-435a-8f94-645df3995883 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:22.779122 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-cebef4f3-4b27-435a-8f94-645df3995883 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:22.786945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-cebef4f3-4b27-435a-8f94-645df3995883 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081654 Jun 20 07:34:22.787514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1196/2274] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:22 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:22.943285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-590ace9e-893d-4e96-8f49-2b6426c413ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:22.943907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-590ace9e-893d-4e96-8f49-2b6426c413ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:22.950377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-590ace9e-893d-4e96-8f49-2b6426c413ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:22.950824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-590ace9e-893d-4e96-8f49-2b6426c413ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:22.951583 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-590ace9e-893d-4e96-8f49-2b6426c413ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:22.952029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-590ace9e-893d-4e96-8f49-2b6426c413ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:23.084618 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-590ace9e-893d-4e96-8f49-2b6426c413ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:23.093046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-590ace9e-893d-4e96-8f49-2b6426c413ce tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.154208 Jun 20 07:34:23.100981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1079/2275] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:22 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:23.803627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-742b8fec-0f14-4b95-8547-70a53d6c0fd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:23.804257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-742b8fec-0f14-4b95-8547-70a53d6c0fd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:23.810673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-742b8fec-0f14-4b95-8547-70a53d6c0fd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:23.811116 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-742b8fec-0f14-4b95-8547-70a53d6c0fd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:23.811862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-742b8fec-0f14-4b95-8547-70a53d6c0fd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:23.812319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-742b8fec-0f14-4b95-8547-70a53d6c0fd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:23.874512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-742b8fec-0f14-4b95-8547-70a53d6c0fd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:23.883006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-742b8fec-0f14-4b95-8547-70a53d6c0fd9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083245 Jun 20 07:34:23.883564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1197/2276] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:23 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:24.109536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8263c1c4-39dc-4ebb-9eb0-20f9795863d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:24.110154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8263c1c4-39dc-4ebb-9eb0-20f9795863d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:24.117116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8263c1c4-39dc-4ebb-9eb0-20f9795863d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:24.117568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8263c1c4-39dc-4ebb-9eb0-20f9795863d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:24.118323 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8263c1c4-39dc-4ebb-9eb0-20f9795863d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:24.118755 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8263c1c4-39dc-4ebb-9eb0-20f9795863d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:24.244890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8263c1c4-39dc-4ebb-9eb0-20f9795863d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:24.252808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8263c1c4-39dc-4ebb-9eb0-20f9795863d5 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147144 Jun 20 07:34:24.254224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1080/2277] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:24 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:24.898843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-11769f16-6eb4-4efb-b43c-168e8b36cffb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:24.899462 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-11769f16-6eb4-4efb-b43c-168e8b36cffb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:24.906011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-11769f16-6eb4-4efb-b43c-168e8b36cffb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:24.906459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-11769f16-6eb4-4efb-b43c-168e8b36cffb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:24.907267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-11769f16-6eb4-4efb-b43c-168e8b36cffb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:24.907706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-11769f16-6eb4-4efb-b43c-168e8b36cffb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:24.969677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-11769f16-6eb4-4efb-b43c-168e8b36cffb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:24.977446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-11769f16-6eb4-4efb-b43c-168e8b36cffb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082557 Jun 20 07:34:24.978010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1198/2278] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:24 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:25.272135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-709e865e-efea-466d-bbc7-343c473b0742 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:25.272763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-709e865e-efea-466d-bbc7-343c473b0742 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:25.279718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-709e865e-efea-466d-bbc7-343c473b0742 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:25.280219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-709e865e-efea-466d-bbc7-343c473b0742 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:25.281063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-709e865e-efea-466d-bbc7-343c473b0742 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:25.281720 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-709e865e-efea-466d-bbc7-343c473b0742 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:25.484343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-709e865e-efea-466d-bbc7-343c473b0742 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:25.492824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-709e865e-efea-466d-bbc7-343c473b0742 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.225312 Jun 20 07:34:25.493394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1081/2279] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:25 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:25.994666 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c2c84f57-95fe-4311-ba56-487b9df76837 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:25.995262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c2c84f57-95fe-4311-ba56-487b9df76837 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:26.001760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2c84f57-95fe-4311-ba56-487b9df76837 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:26.002210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2c84f57-95fe-4311-ba56-487b9df76837 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:26.003214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2c84f57-95fe-4311-ba56-487b9df76837 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:26.003647 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2c84f57-95fe-4311-ba56-487b9df76837 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:26.063956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c2c84f57-95fe-4311-ba56-487b9df76837 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:26.071892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c2c84f57-95fe-4311-ba56-487b9df76837 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081028 Jun 20 07:34:26.072429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1199/2280] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:25 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:26.510968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1acabdaf-1f39-4861-8d07-62cb5e7809dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:26.511592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1acabdaf-1f39-4861-8d07-62cb5e7809dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:26.518221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1acabdaf-1f39-4861-8d07-62cb5e7809dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:26.518701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1acabdaf-1f39-4861-8d07-62cb5e7809dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:26.519458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1acabdaf-1f39-4861-8d07-62cb5e7809dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:26.519894 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1acabdaf-1f39-4861-8d07-62cb5e7809dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:26.664862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1acabdaf-1f39-4861-8d07-62cb5e7809dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:26.672652 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1acabdaf-1f39-4861-8d07-62cb5e7809dc tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.165554 Jun 20 07:34:26.673212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1082/2281] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:26 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:27.088662 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e07a170d-eeba-48f1-aa9d-392b1439930c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:27.089304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e07a170d-eeba-48f1-aa9d-392b1439930c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:27.105331 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e07a170d-eeba-48f1-aa9d-392b1439930c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:27.105776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e07a170d-eeba-48f1-aa9d-392b1439930c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:27.106573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e07a170d-eeba-48f1-aa9d-392b1439930c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:27.107006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e07a170d-eeba-48f1-aa9d-392b1439930c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:27.177455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e07a170d-eeba-48f1-aa9d-392b1439930c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:27.190574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e07a170d-eeba-48f1-aa9d-392b1439930c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.105760 Jun 20 07:34:27.191143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1200/2282] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:27 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:27.690138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7c88b884-58ef-4e35-8d96-a05711e0aba7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:27.691186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7c88b884-58ef-4e35-8d96-a05711e0aba7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:27.697879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c88b884-58ef-4e35-8d96-a05711e0aba7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:27.698337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c88b884-58ef-4e35-8d96-a05711e0aba7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:27.699102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c88b884-58ef-4e35-8d96-a05711e0aba7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:27.699540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c88b884-58ef-4e35-8d96-a05711e0aba7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:27.828386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7c88b884-58ef-4e35-8d96-a05711e0aba7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:27.836717 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7c88b884-58ef-4e35-8d96-a05711e0aba7 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.150463 Jun 20 07:34:27.837271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1083/2283] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:27 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:28.208684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d18911b6-3af6-410e-9d38-be490697d738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:28.209243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d18911b6-3af6-410e-9d38-be490697d738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:28.216023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d18911b6-3af6-410e-9d38-be490697d738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:28.216498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d18911b6-3af6-410e-9d38-be490697d738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:28.217306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d18911b6-3af6-410e-9d38-be490697d738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:28.217830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d18911b6-3af6-410e-9d38-be490697d738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:28.283681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d18911b6-3af6-410e-9d38-be490697d738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:28.292859 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d18911b6-3af6-410e-9d38-be490697d738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.088973 Jun 20 07:34:28.293427 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1201/2284] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:28 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:28.854208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1e832557-375f-4271-b276-24f4f922b060 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:28.854801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1e832557-375f-4271-b276-24f4f922b060 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:28.862852 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e832557-375f-4271-b276-24f4f922b060 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:28.863290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e832557-375f-4271-b276-24f4f922b060 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:28.864039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e832557-375f-4271-b276-24f4f922b060 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:28.864542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e832557-375f-4271-b276-24f4f922b060 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:28.991446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1e832557-375f-4271-b276-24f4f922b060 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:28.999299 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1e832557-375f-4271-b276-24f4f922b060 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149002 Jun 20 07:34:28.999865 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1084/2285] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:28 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:29.310457 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-365771aa-f89b-407a-b572-67cc7575bde9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:29.311075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-365771aa-f89b-407a-b572-67cc7575bde9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:29.318196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-365771aa-f89b-407a-b572-67cc7575bde9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:29.318642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-365771aa-f89b-407a-b572-67cc7575bde9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:29.319398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-365771aa-f89b-407a-b572-67cc7575bde9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:29.319831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-365771aa-f89b-407a-b572-67cc7575bde9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:29.379371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-365771aa-f89b-407a-b572-67cc7575bde9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:29.382179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:34:29.389186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-365771aa-f89b-407a-b572-67cc7575bde9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082555 Jun 20 07:34:29.389760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1202/2286] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:29 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:30.017110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-51d8cfc0-e85b-46d5-a0d2-0a2b01cf8c42 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:30.017737 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-51d8cfc0-e85b-46d5-a0d2-0a2b01cf8c42 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:30.024451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51d8cfc0-e85b-46d5-a0d2-0a2b01cf8c42 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:30.024905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51d8cfc0-e85b-46d5-a0d2-0a2b01cf8c42 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:30.025673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51d8cfc0-e85b-46d5-a0d2-0a2b01cf8c42 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:30.026118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51d8cfc0-e85b-46d5-a0d2-0a2b01cf8c42 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:30.156560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-51d8cfc0-e85b-46d5-a0d2-0a2b01cf8c42 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:30.164985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-51d8cfc0-e85b-46d5-a0d2-0a2b01cf8c42 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.151777 Jun 20 07:34:30.165551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1085/2287] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:30 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:30.405745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5d62a2d3-1071-41fd-9817-d16d8ca222d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:30.406357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5d62a2d3-1071-41fd-9817-d16d8ca222d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:30.413419 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d62a2d3-1071-41fd-9817-d16d8ca222d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:30.413861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d62a2d3-1071-41fd-9817-d16d8ca222d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:30.414613 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d62a2d3-1071-41fd-9817-d16d8ca222d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:30.415045 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d62a2d3-1071-41fd-9817-d16d8ca222d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:30.475127 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5d62a2d3-1071-41fd-9817-d16d8ca222d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:30.483075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5d62a2d3-1071-41fd-9817-d16d8ca222d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081173 Jun 20 07:34:30.483634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1203/2288] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:30 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:31.182471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d987d6a6-73ed-4d99-8944-dff9fdfbdf4f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:31.183093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d987d6a6-73ed-4d99-8944-dff9fdfbdf4f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:31.189597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d987d6a6-73ed-4d99-8944-dff9fdfbdf4f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:31.190043 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d987d6a6-73ed-4d99-8944-dff9fdfbdf4f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:31.190801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d987d6a6-73ed-4d99-8944-dff9fdfbdf4f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:31.191243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d987d6a6-73ed-4d99-8944-dff9fdfbdf4f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:31.197259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:34:31.325208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d987d6a6-73ed-4d99-8944-dff9fdfbdf4f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:31.333054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d987d6a6-73ed-4d99-8944-dff9fdfbdf4f tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.154495 Jun 20 07:34:31.333616 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1086/2289] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:31 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:31.499576 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-279cccb8-1b87-4917-ba48-4f74abd50421 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:31.500160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-279cccb8-1b87-4917-ba48-4f74abd50421 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:31.506975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-279cccb8-1b87-4917-ba48-4f74abd50421 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:31.507426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-279cccb8-1b87-4917-ba48-4f74abd50421 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:31.508216 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-279cccb8-1b87-4917-ba48-4f74abd50421 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:31.508657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-279cccb8-1b87-4917-ba48-4f74abd50421 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:31.571119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-279cccb8-1b87-4917-ba48-4f74abd50421 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:31.579072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-279cccb8-1b87-4917-ba48-4f74abd50421 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083418 Jun 20 07:34:31.579637 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1204/2290] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:31 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:32.349822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-778bf7a2-fe7a-48c8-ae5c-50e41a0049af tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:32.350438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-778bf7a2-fe7a-48c8-ae5c-50e41a0049af tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:32.357172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-778bf7a2-fe7a-48c8-ae5c-50e41a0049af tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:32.357622 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-778bf7a2-fe7a-48c8-ae5c-50e41a0049af tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:32.358377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-778bf7a2-fe7a-48c8-ae5c-50e41a0049af tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:32.358815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-778bf7a2-fe7a-48c8-ae5c-50e41a0049af tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:32.484457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-778bf7a2-fe7a-48c8-ae5c-50e41a0049af tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:32.492910 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-778bf7a2-fe7a-48c8-ae5c-50e41a0049af tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146948 Jun 20 07:34:32.493481 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1087/2291] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:32 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:32.596264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2f535320-5222-4435-97a4-5c9e2faaac17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:32.596882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2f535320-5222-4435-97a4-5c9e2faaac17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:32.603300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f535320-5222-4435-97a4-5c9e2faaac17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:32.603695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f535320-5222-4435-97a4-5c9e2faaac17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:32.604477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f535320-5222-4435-97a4-5c9e2faaac17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:32.604909 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2f535320-5222-4435-97a4-5c9e2faaac17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:32.666494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2f535320-5222-4435-97a4-5c9e2faaac17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:32.674394 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2f535320-5222-4435-97a4-5c9e2faaac17 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082043 Jun 20 07:34:32.674956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1205/2292] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:32 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:33.509859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-980090f3-869b-4708-9ad4-226d3693cb7c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:33.510475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-980090f3-869b-4708-9ad4-226d3693cb7c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:33.517005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-980090f3-869b-4708-9ad4-226d3693cb7c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:33.517448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-980090f3-869b-4708-9ad4-226d3693cb7c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:33.518201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-980090f3-869b-4708-9ad4-226d3693cb7c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:33.518634 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-980090f3-869b-4708-9ad4-226d3693cb7c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:33.644655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-980090f3-869b-4708-9ad4-226d3693cb7c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:33.652484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-980090f3-869b-4708-9ad4-226d3693cb7c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.146421 Jun 20 07:34:33.653047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1088/2293] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:33 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:33.690456 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a7e6120a-9f63-4932-be28-ed3f9c0f8ff0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:33.691063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a7e6120a-9f63-4932-be28-ed3f9c0f8ff0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:33.697583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7e6120a-9f63-4932-be28-ed3f9c0f8ff0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:33.698024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7e6120a-9f63-4932-be28-ed3f9c0f8ff0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:33.698770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7e6120a-9f63-4932-be28-ed3f9c0f8ff0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:33.699204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a7e6120a-9f63-4932-be28-ed3f9c0f8ff0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:33.760063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a7e6120a-9f63-4932-be28-ed3f9c0f8ff0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:33.768813 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a7e6120a-9f63-4932-be28-ed3f9c0f8ff0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082110 Jun 20 07:34:33.769381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1206/2294] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:33 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:34.669568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6f63a52a-edf8-41f1-a667-6c0af072626c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:34.670186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6f63a52a-edf8-41f1-a667-6c0af072626c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:34.677201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f63a52a-edf8-41f1-a667-6c0af072626c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:34.677649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f63a52a-edf8-41f1-a667-6c0af072626c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:34.678403 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f63a52a-edf8-41f1-a667-6c0af072626c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:34.678841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f63a52a-edf8-41f1-a667-6c0af072626c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:34.784785 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-89c514e0-e17c-44e2-aee4-9995a8691b7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:34.785396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-89c514e0-e17c-44e2-aee4-9995a8691b7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:34.791367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89c514e0-e17c-44e2-aee4-9995a8691b7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:34.791809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89c514e0-e17c-44e2-aee4-9995a8691b7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:34.792597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89c514e0-e17c-44e2-aee4-9995a8691b7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:34.793032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89c514e0-e17c-44e2-aee4-9995a8691b7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:34.806015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6f63a52a-edf8-41f1-a667-6c0af072626c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:34.813978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6f63a52a-edf8-41f1-a667-6c0af072626c tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.148230 Jun 20 07:34:34.814636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1089/2295] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:34 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:34.855649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-89c514e0-e17c-44e2-aee4-9995a8691b7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:34.863524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-89c514e0-e17c-44e2-aee4-9995a8691b7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082742 Jun 20 07:34:34.864651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1207/2296] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:34 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:35.831706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-34f4fd20-5645-4329-bd5f-31fc0282c362 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:35.832351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-34f4fd20-5645-4329-bd5f-31fc0282c362 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:35.839060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34f4fd20-5645-4329-bd5f-31fc0282c362 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:35.839503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34f4fd20-5645-4329-bd5f-31fc0282c362 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:35.840292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34f4fd20-5645-4329-bd5f-31fc0282c362 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:35.840731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34f4fd20-5645-4329-bd5f-31fc0282c362 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:35.880892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3ed32176-834b-45f3-96a0-a70eff35083b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:35.881689 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3ed32176-834b-45f3-96a0-a70eff35083b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:35.888369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ed32176-834b-45f3-96a0-a70eff35083b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:35.888936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ed32176-834b-45f3-96a0-a70eff35083b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:35.889779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ed32176-834b-45f3-96a0-a70eff35083b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:35.890315 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3ed32176-834b-45f3-96a0-a70eff35083b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:35.959847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3ed32176-834b-45f3-96a0-a70eff35083b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:35.967764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3ed32176-834b-45f3-96a0-a70eff35083b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.091069 Jun 20 07:34:35.968365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1208/2297] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:35 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:35.989605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-34f4fd20-5645-4329-bd5f-31fc0282c362 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:35.997467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-34f4fd20-5645-4329-bd5f-31fc0282c362 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.169630 Jun 20 07:34:35.998022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1090/2298] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:35 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:36.984552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c2e9d8f4-e642-4944-bc35-67c20b483dad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:36.985168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c2e9d8f4-e642-4944-bc35-67c20b483dad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:36.992590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2e9d8f4-e642-4944-bc35-67c20b483dad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:36.993043 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2e9d8f4-e642-4944-bc35-67c20b483dad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:36.993803 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2e9d8f4-e642-4944-bc35-67c20b483dad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:36.994240 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2e9d8f4-e642-4944-bc35-67c20b483dad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:37.014505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-46e2f091-565f-4f2f-88df-393d23f8e1f1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:37.015120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-46e2f091-565f-4f2f-88df-393d23f8e1f1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:37.021502 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46e2f091-565f-4f2f-88df-393d23f8e1f1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:37.021951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46e2f091-565f-4f2f-88df-393d23f8e1f1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:37.022707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46e2f091-565f-4f2f-88df-393d23f8e1f1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:37.023141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46e2f091-565f-4f2f-88df-393d23f8e1f1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:37.056095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c2e9d8f4-e642-4944-bc35-67c20b483dad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:37.064131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c2e9d8f4-e642-4944-bc35-67c20b483dad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083314 Jun 20 07:34:37.064749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1209/2299] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:36 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:37.152642 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-46e2f091-565f-4f2f-88df-393d23f8e1f1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:37.160548 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-46e2f091-565f-4f2f-88df-393d23f8e1f1 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.149832 Jun 20 07:34:37.161735 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1091/2300] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:37 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:38.081543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1186e772-928e-4c09-85ef-575d5466cdf8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:38.082156 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1186e772-928e-4c09-85ef-575d5466cdf8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:38.088653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1186e772-928e-4c09-85ef-575d5466cdf8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:38.089098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1186e772-928e-4c09-85ef-575d5466cdf8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:38.089853 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1186e772-928e-4c09-85ef-575d5466cdf8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:38.090288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1186e772-928e-4c09-85ef-575d5466cdf8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:38.150556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1186e772-928e-4c09-85ef-575d5466cdf8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:38.158751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1186e772-928e-4c09-85ef-575d5466cdf8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081053 Jun 20 07:34:38.159314 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1210/2301] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:38 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:38.178542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-638ec262-e431-4997-aa61-36bbcc8f0314 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:38.179195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-638ec262-e431-4997-aa61-36bbcc8f0314 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:38.185644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-638ec262-e431-4997-aa61-36bbcc8f0314 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:38.186094 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-638ec262-e431-4997-aa61-36bbcc8f0314 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:38.186853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-638ec262-e431-4997-aa61-36bbcc8f0314 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:38.187296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-638ec262-e431-4997-aa61-36bbcc8f0314 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:38.310599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-638ec262-e431-4997-aa61-36bbcc8f0314 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:38.318434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-638ec262-e431-4997-aa61-36bbcc8f0314 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.144333 Jun 20 07:34:38.319001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1092/2302] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:38 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:39.175800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1c824788-a26f-4654-84a2-38662f5135e5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:39.177118 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1c824788-a26f-4654-84a2-38662f5135e5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:39.183567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c824788-a26f-4654-84a2-38662f5135e5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:39.184017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c824788-a26f-4654-84a2-38662f5135e5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:39.184809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c824788-a26f-4654-84a2-38662f5135e5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:39.185244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c824788-a26f-4654-84a2-38662f5135e5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:39.250325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c824788-a26f-4654-84a2-38662f5135e5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:39.259070 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1c824788-a26f-4654-84a2-38662f5135e5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.087052 Jun 20 07:34:39.259684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1211/2303] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:39 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:39.334985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-96a0c882-7ca2-4594-b79e-b0c45f595c96 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:39.335601 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-96a0c882-7ca2-4594-b79e-b0c45f595c96 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] [instance: ec0ea04e-5c9f-4536-b200-1eaf64edef9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:39.342228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96a0c882-7ca2-4594-b79e-b0c45f595c96 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:39.342676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96a0c882-7ca2-4594-b79e-b0c45f595c96 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:39.343432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96a0c882-7ca2-4594-b79e-b0c45f595c96 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:39.343872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96a0c882-7ca2-4594-b79e-b0c45f595c96 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:39.470528 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-96a0c882-7ca2-4594-b79e-b0c45f595c96 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf681122194384812c2eb96d1adfbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1583bd5823544e54b32e1eaf308cd261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:39.479029 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-96a0c882-7ca2-4594-b79e-b0c45f595c96 tempest-VolumesSnapshotTestJSON-672847046 tempest-VolumesSnapshotTestJSON-672847046-project] 10.222.0.23 "GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c" status: 200 len: 1559 microversion: 2.1 time: 0.147837 Jun 20 07:34:39.479631 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1093/2304] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:39 2022] GET /compute/v2.1/servers/ec0ea04e-5c9f-4536-b200-1eaf64edef9c => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:40.276703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5aaae2e5-ff3b-4919-a5ca-6e72bf34a5d3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:40.277319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5aaae2e5-ff3b-4919-a5ca-6e72bf34a5d3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:40.284242 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5aaae2e5-ff3b-4919-a5ca-6e72bf34a5d3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:40.284696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5aaae2e5-ff3b-4919-a5ca-6e72bf34a5d3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:40.285461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5aaae2e5-ff3b-4919-a5ca-6e72bf34a5d3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:40.285899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5aaae2e5-ff3b-4919-a5ca-6e72bf34a5d3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:40.347243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5aaae2e5-ff3b-4919-a5ca-6e72bf34a5d3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:40.355081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5aaae2e5-ff3b-4919-a5ca-6e72bf34a5d3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082295 Jun 20 07:34:40.355643 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1212/2305] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:40 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:41.371817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d81c50df-5936-4a0e-ac72-b3a68a062c0f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:41.372462 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d81c50df-5936-4a0e-ac72-b3a68a062c0f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:41.379226 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d81c50df-5936-4a0e-ac72-b3a68a062c0f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:41.379678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d81c50df-5936-4a0e-ac72-b3a68a062c0f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:41.380467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d81c50df-5936-4a0e-ac72-b3a68a062c0f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:41.380912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d81c50df-5936-4a0e-ac72-b3a68a062c0f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:41.444736 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d81c50df-5936-4a0e-ac72-b3a68a062c0f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:41.452654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d81c50df-5936-4a0e-ac72-b3a68a062c0f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084684 Jun 20 07:34:41.453228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1094/2306] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:41 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:42.008843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-37591872-8376-4102-a961-c6e391b7d077 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:42.009414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-37591872-8376-4102-a961-c6e391b7d077 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:42.015784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37591872-8376-4102-a961-c6e391b7d077 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:42.016263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37591872-8376-4102-a961-c6e391b7d077 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:42.017014 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37591872-8376-4102-a961-c6e391b7d077 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:42.017470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37591872-8376-4102-a961-c6e391b7d077 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:42.042381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-37591872-8376-4102-a961-c6e391b7d077 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:34:42.117288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-37591872-8376-4102-a961-c6e391b7d077 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 204 len: 0 microversion: 2.1 time: 0.112536 Jun 20 07:34:42.117876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1213/2307] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:34:42 2022] DELETE /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:34:42.126203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9a598af9-47fa-44dd-851e-dbf80b932702 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:42.126827 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9a598af9-47fa-44dd-851e-dbf80b932702 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:42.133796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a598af9-47fa-44dd-851e-dbf80b932702 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:42.134190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a598af9-47fa-44dd-851e-dbf80b932702 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:42.134953 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a598af9-47fa-44dd-851e-dbf80b932702 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:42.135392 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a598af9-47fa-44dd-851e-dbf80b932702 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:42.259936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a598af9-47fa-44dd-851e-dbf80b932702 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:42.267808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9a598af9-47fa-44dd-851e-dbf80b932702 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145444 Jun 20 07:34:42.268410 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1095/2308] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:42 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:42.470303 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fd9de81f-1efe-4573-93bf-f276cb9aba9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:42.470938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fd9de81f-1efe-4573-93bf-f276cb9aba9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:42.477555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd9de81f-1efe-4573-93bf-f276cb9aba9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:42.478451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd9de81f-1efe-4573-93bf-f276cb9aba9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:42.479315 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd9de81f-1efe-4573-93bf-f276cb9aba9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:42.479637 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fd9de81f-1efe-4573-93bf-f276cb9aba9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:42.540197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fd9de81f-1efe-4573-93bf-f276cb9aba9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:42.547927 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fd9de81f-1efe-4573-93bf-f276cb9aba9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081881 Jun 20 07:34:42.548533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1214/2309] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:42 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:43.285068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a4b74fec-5393-49f3-bf2d-ba89a0e50984 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:43.285701 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a4b74fec-5393-49f3-bf2d-ba89a0e50984 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:43.292377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4b74fec-5393-49f3-bf2d-ba89a0e50984 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:43.292837 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4b74fec-5393-49f3-bf2d-ba89a0e50984 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:43.293596 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4b74fec-5393-49f3-bf2d-ba89a0e50984 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:43.294033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a4b74fec-5393-49f3-bf2d-ba89a0e50984 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:43.421150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a4b74fec-5393-49f3-bf2d-ba89a0e50984 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:43.428952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a4b74fec-5393-49f3-bf2d-ba89a0e50984 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147810 Jun 20 07:34:43.429516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1096/2310] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:43 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:43.564534 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dfef8ed4-eafd-4aec-a947-3434bdbead74 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:43.565148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dfef8ed4-eafd-4aec-a947-3434bdbead74 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:43.572253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfef8ed4-eafd-4aec-a947-3434bdbead74 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:43.572707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfef8ed4-eafd-4aec-a947-3434bdbead74 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:43.573463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfef8ed4-eafd-4aec-a947-3434bdbead74 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:43.573902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dfef8ed4-eafd-4aec-a947-3434bdbead74 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:43.635324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dfef8ed4-eafd-4aec-a947-3434bdbead74 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:43.643218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dfef8ed4-eafd-4aec-a947-3434bdbead74 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082484 Jun 20 07:34:43.643782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1215/2311] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:43 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:44.445765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-54af6d34-606a-4db3-a7f1-e3494487d18f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:44.446382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-54af6d34-606a-4db3-a7f1-e3494487d18f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:44.453043 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54af6d34-606a-4db3-a7f1-e3494487d18f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:44.453498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54af6d34-606a-4db3-a7f1-e3494487d18f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:44.454840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54af6d34-606a-4db3-a7f1-e3494487d18f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:44.455640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54af6d34-606a-4db3-a7f1-e3494487d18f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:44.586509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-54af6d34-606a-4db3-a7f1-e3494487d18f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:44.594301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-54af6d34-606a-4db3-a7f1-e3494487d18f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152446 Jun 20 07:34:44.594862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1097/2312] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:44.659929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-405662b2-ae23-448e-9a08-aa2da7e5ba3a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:44.661141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-405662b2-ae23-448e-9a08-aa2da7e5ba3a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:44.667558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-405662b2-ae23-448e-9a08-aa2da7e5ba3a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:44.668010 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-405662b2-ae23-448e-9a08-aa2da7e5ba3a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:44.668805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-405662b2-ae23-448e-9a08-aa2da7e5ba3a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:44.669243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-405662b2-ae23-448e-9a08-aa2da7e5ba3a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:44.731698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-405662b2-ae23-448e-9a08-aa2da7e5ba3a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:44.739572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-405662b2-ae23-448e-9a08-aa2da7e5ba3a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083545 Jun 20 07:34:44.740165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1216/2313] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:44 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:45.611142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a4153cb-33d7-42d3-8830-dac114fed173 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:45.611754 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6a4153cb-33d7-42d3-8830-dac114fed173 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:45.618817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a4153cb-33d7-42d3-8830-dac114fed173 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:45.619263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a4153cb-33d7-42d3-8830-dac114fed173 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:45.620019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a4153cb-33d7-42d3-8830-dac114fed173 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:45.620479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a4153cb-33d7-42d3-8830-dac114fed173 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:45.745366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6a4153cb-33d7-42d3-8830-dac114fed173 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:45.753560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6a4153cb-33d7-42d3-8830-dac114fed173 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146235 Jun 20 07:34:45.754123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1098/2314] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:45.756350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-df4f525c-f2e1-4c1e-ac3e-d3dd4356ac7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:45.756966 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-df4f525c-f2e1-4c1e-ac3e-d3dd4356ac7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:45.763324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df4f525c-f2e1-4c1e-ac3e-d3dd4356ac7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:45.763761 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df4f525c-f2e1-4c1e-ac3e-d3dd4356ac7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:45.764549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df4f525c-f2e1-4c1e-ac3e-d3dd4356ac7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:45.764980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df4f525c-f2e1-4c1e-ac3e-d3dd4356ac7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:45.824482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-df4f525c-f2e1-4c1e-ac3e-d3dd4356ac7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:45.826706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:34:45.833918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-df4f525c-f2e1-4c1e-ac3e-d3dd4356ac7c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081661 Jun 20 07:34:45.834482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1217/2315] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:45 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:46.770524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4fa086b1-198c-44db-99ff-6af760dacece tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:46.771135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4fa086b1-198c-44db-99ff-6af760dacece tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:46.777550 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4fa086b1-198c-44db-99ff-6af760dacece tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:46.777992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4fa086b1-198c-44db-99ff-6af760dacece tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:46.778739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4fa086b1-198c-44db-99ff-6af760dacece tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:46.779205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4fa086b1-198c-44db-99ff-6af760dacece tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:46.850417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3a2071f9-6e7d-480d-82f2-a470a3a96264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:46.851634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3a2071f9-6e7d-480d-82f2-a470a3a96264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:46.859062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a2071f9-6e7d-480d-82f2-a470a3a96264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:46.859513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a2071f9-6e7d-480d-82f2-a470a3a96264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:46.860305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a2071f9-6e7d-480d-82f2-a470a3a96264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:46.860746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3a2071f9-6e7d-480d-82f2-a470a3a96264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:46.918330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4fa086b1-198c-44db-99ff-6af760dacece tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:46.926857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4fa086b1-198c-44db-99ff-6af760dacece tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.159625 Jun 20 07:34:46.927426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1099/2316] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:46.935293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3a2071f9-6e7d-480d-82f2-a470a3a96264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:46.943215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3a2071f9-6e7d-480d-82f2-a470a3a96264 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.096698 Jun 20 07:34:46.943769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1218/2317] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:46 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:47.944458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5a558c1c-707a-42e6-92a6-f8b613c2b3ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:47.945083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5a558c1c-707a-42e6-92a6-f8b613c2b3ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:47.947360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:34:47.952804 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a558c1c-707a-42e6-92a6-f8b613c2b3ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:47.953257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a558c1c-707a-42e6-92a6-f8b613c2b3ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:47.954129 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a558c1c-707a-42e6-92a6-f8b613c2b3ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:47.954657 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a558c1c-707a-42e6-92a6-f8b613c2b3ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:47.960436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-747dc9a5-857d-41e7-ad39-a87ae9e2a1f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:47.960991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-747dc9a5-857d-41e7-ad39-a87ae9e2a1f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:47.967736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-747dc9a5-857d-41e7-ad39-a87ae9e2a1f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:47.968213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-747dc9a5-857d-41e7-ad39-a87ae9e2a1f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:47.968970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-747dc9a5-857d-41e7-ad39-a87ae9e2a1f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:47.969403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-747dc9a5-857d-41e7-ad39-a87ae9e2a1f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:48.047584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-747dc9a5-857d-41e7-ad39-a87ae9e2a1f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:48.056026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-747dc9a5-857d-41e7-ad39-a87ae9e2a1f2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.100470 Jun 20 07:34:48.056625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1219/2318] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:47 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:48.105983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5a558c1c-707a-42e6-92a6-f8b613c2b3ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:48.113766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5a558c1c-707a-42e6-92a6-f8b613c2b3ca tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.173750 Jun 20 07:34:48.114326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1100/2319] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:47 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:49.072831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e6c48bef-f200-4fbf-a8bc-74b76d6ad498 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:49.073474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e6c48bef-f200-4fbf-a8bc-74b76d6ad498 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:49.080051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6c48bef-f200-4fbf-a8bc-74b76d6ad498 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:49.080528 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6c48bef-f200-4fbf-a8bc-74b76d6ad498 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:49.081286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6c48bef-f200-4fbf-a8bc-74b76d6ad498 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:49.081722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6c48bef-f200-4fbf-a8bc-74b76d6ad498 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:49.130980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7e3f34e5-5add-4534-95f4-53df806ee278 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:49.131598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7e3f34e5-5add-4534-95f4-53df806ee278 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:49.137978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e3f34e5-5add-4534-95f4-53df806ee278 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:49.138428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e3f34e5-5add-4534-95f4-53df806ee278 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:49.139179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e3f34e5-5add-4534-95f4-53df806ee278 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:49.139612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e3f34e5-5add-4534-95f4-53df806ee278 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:49.146921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e6c48bef-f200-4fbf-a8bc-74b76d6ad498 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:49.154885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e6c48bef-f200-4fbf-a8bc-74b76d6ad498 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085896 Jun 20 07:34:49.162020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1220/2320] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:49 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:49.273639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7e3f34e5-5add-4534-95f4-53df806ee278 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:49.281520 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7e3f34e5-5add-4534-95f4-53df806ee278 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.154583 Jun 20 07:34:49.282083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1101/2321] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:34:50.172312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4c899353-529c-43d8-bc4d-a7f4c83da834 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:50.172950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4c899353-529c-43d8-bc4d-a7f4c83da834 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:50.175235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:34:50.181265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c899353-529c-43d8-bc4d-a7f4c83da834 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:50.181709 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c899353-529c-43d8-bc4d-a7f4c83da834 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:50.182460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c899353-529c-43d8-bc4d-a7f4c83da834 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:50.182892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c899353-529c-43d8-bc4d-a7f4c83da834 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:50.242945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4c899353-529c-43d8-bc4d-a7f4c83da834 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:50.250693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4c899353-529c-43d8-bc4d-a7f4c83da834 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082351 Jun 20 07:34:50.251251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1221/2322] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:50 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:50.298373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca3781d1-d95b-4b38-bcbc-69178f96577c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:50.298992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca3781d1-d95b-4b38-bcbc-69178f96577c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:50.305940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca3781d1-d95b-4b38-bcbc-69178f96577c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:50.306400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca3781d1-d95b-4b38-bcbc-69178f96577c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:50.307163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca3781d1-d95b-4b38-bcbc-69178f96577c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:50.307607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca3781d1-d95b-4b38-bcbc-69178f96577c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:50.433355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca3781d1-d95b-4b38-bcbc-69178f96577c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:50.435540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:34:50.442556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca3781d1-d95b-4b38-bcbc-69178f96577c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147991 Jun 20 07:34:50.443212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1102/2323] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:51.266734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bbeaac9e-acef-4952-8cef-6649fca695bd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:51.267353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bbeaac9e-acef-4952-8cef-6649fca695bd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:51.275477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbeaac9e-acef-4952-8cef-6649fca695bd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:51.276301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbeaac9e-acef-4952-8cef-6649fca695bd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:51.277244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbeaac9e-acef-4952-8cef-6649fca695bd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:51.277689 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bbeaac9e-acef-4952-8cef-6649fca695bd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:51.337776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bbeaac9e-acef-4952-8cef-6649fca695bd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:51.345610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bbeaac9e-acef-4952-8cef-6649fca695bd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082760 Jun 20 07:34:51.346168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1222/2324] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:51 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:51.459458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-66484bd8-342d-46e2-8e44-32e7de39a3e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:51.460102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-66484bd8-342d-46e2-8e44-32e7de39a3e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:51.466529 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66484bd8-342d-46e2-8e44-32e7de39a3e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:51.466973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66484bd8-342d-46e2-8e44-32e7de39a3e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:51.467718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66484bd8-342d-46e2-8e44-32e7de39a3e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:51.468174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66484bd8-342d-46e2-8e44-32e7de39a3e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:51.592087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-66484bd8-342d-46e2-8e44-32e7de39a3e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:51.600724 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-66484bd8-342d-46e2-8e44-32e7de39a3e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145092 Jun 20 07:34:51.601292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1103/2325] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:52.362466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7445934a-9385-48bd-97e0-01ca32e63f9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:52.363078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7445934a-9385-48bd-97e0-01ca32e63f9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:52.369657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7445934a-9385-48bd-97e0-01ca32e63f9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:52.370107 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7445934a-9385-48bd-97e0-01ca32e63f9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:52.370867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7445934a-9385-48bd-97e0-01ca32e63f9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:52.371304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7445934a-9385-48bd-97e0-01ca32e63f9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:52.434007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7445934a-9385-48bd-97e0-01ca32e63f9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:52.442360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7445934a-9385-48bd-97e0-01ca32e63f9e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083199 Jun 20 07:34:52.442924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1223/2326] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:52 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:52.617645 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e3807766-dc4f-469a-91da-c546cc7c8b59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:52.618200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e3807766-dc4f-469a-91da-c546cc7c8b59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:52.624699 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3807766-dc4f-469a-91da-c546cc7c8b59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:52.625148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3807766-dc4f-469a-91da-c546cc7c8b59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:52.625899 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3807766-dc4f-469a-91da-c546cc7c8b59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:52.626334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3807766-dc4f-469a-91da-c546cc7c8b59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:52.754108 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e3807766-dc4f-469a-91da-c546cc7c8b59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:52.762020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e3807766-dc4f-469a-91da-c546cc7c8b59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148263 Jun 20 07:34:52.762581 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1104/2327] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:53.458755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-df1558af-5518-455d-83d2-8a6b7aba230e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:53.459391 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-df1558af-5518-455d-83d2-8a6b7aba230e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:53.465820 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df1558af-5518-455d-83d2-8a6b7aba230e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:53.466289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df1558af-5518-455d-83d2-8a6b7aba230e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:53.467041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df1558af-5518-455d-83d2-8a6b7aba230e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:53.467470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df1558af-5518-455d-83d2-8a6b7aba230e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:53.529369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-df1558af-5518-455d-83d2-8a6b7aba230e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:53.537185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-df1558af-5518-455d-83d2-8a6b7aba230e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082244 Jun 20 07:34:53.537743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1224/2328] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:53 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:53.779662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2c28b93f-0eba-485d-8689-d7862be2b529 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:53.780331 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2c28b93f-0eba-485d-8689-d7862be2b529 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:53.787451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c28b93f-0eba-485d-8689-d7862be2b529 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:53.787909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c28b93f-0eba-485d-8689-d7862be2b529 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:53.788712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c28b93f-0eba-485d-8689-d7862be2b529 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:53.789158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2c28b93f-0eba-485d-8689-d7862be2b529 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:53.915419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2c28b93f-0eba-485d-8689-d7862be2b529 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:53.923243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2c28b93f-0eba-485d-8689-d7862be2b529 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147441 Jun 20 07:34:53.923815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1105/2329] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:54.554367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aaa4cce9-87af-4d06-bd86-c6676d5a6983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:54.554977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aaa4cce9-87af-4d06-bd86-c6676d5a6983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:54.561451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aaa4cce9-87af-4d06-bd86-c6676d5a6983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:54.561899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aaa4cce9-87af-4d06-bd86-c6676d5a6983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:54.562647 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aaa4cce9-87af-4d06-bd86-c6676d5a6983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:54.563080 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aaa4cce9-87af-4d06-bd86-c6676d5a6983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:54.622708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-aaa4cce9-87af-4d06-bd86-c6676d5a6983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:54.631024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aaa4cce9-87af-4d06-bd86-c6676d5a6983 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081062 Jun 20 07:34:54.631579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1225/2330] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:54 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:54.941707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-568fe6ec-898b-4977-b522-7d2521e6e6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:54.942320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-568fe6ec-898b-4977-b522-7d2521e6e6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:54.948722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-568fe6ec-898b-4977-b522-7d2521e6e6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:54.949165 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-568fe6ec-898b-4977-b522-7d2521e6e6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:54.949912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-568fe6ec-898b-4977-b522-7d2521e6e6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:54.950343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-568fe6ec-898b-4977-b522-7d2521e6e6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:55.074598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-568fe6ec-898b-4977-b522-7d2521e6e6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:55.083096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-568fe6ec-898b-4977-b522-7d2521e6e6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145245 Jun 20 07:34:55.083654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1106/2331] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:54 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:55.648224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-18194a53-57ee-4b9b-91b8-cc985892813d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:55.648839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-18194a53-57ee-4b9b-91b8-cc985892813d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:55.655276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18194a53-57ee-4b9b-91b8-cc985892813d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:55.655723 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18194a53-57ee-4b9b-91b8-cc985892813d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:55.656510 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18194a53-57ee-4b9b-91b8-cc985892813d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:55.656949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-18194a53-57ee-4b9b-91b8-cc985892813d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:55.720158 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-18194a53-57ee-4b9b-91b8-cc985892813d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:55.728786 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-18194a53-57ee-4b9b-91b8-cc985892813d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084980 Jun 20 07:34:55.729359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1226/2332] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:55 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:56.099645 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-114041e6-c36e-4de6-9792-1fbb4b938452 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:56.100324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-114041e6-c36e-4de6-9792-1fbb4b938452 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:56.106791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-114041e6-c36e-4de6-9792-1fbb4b938452 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:56.107234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-114041e6-c36e-4de6-9792-1fbb4b938452 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:56.107979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-114041e6-c36e-4de6-9792-1fbb4b938452 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:56.108435 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-114041e6-c36e-4de6-9792-1fbb4b938452 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:56.459619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-114041e6-c36e-4de6-9792-1fbb4b938452 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:56.467484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-114041e6-c36e-4de6-9792-1fbb4b938452 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.372241 Jun 20 07:34:56.468068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1107/2333] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:56.745044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-950d2f0f-1107-4470-b2d2-52c80fb15603 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:56.745663 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-950d2f0f-1107-4470-b2d2-52c80fb15603 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:56.752136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-950d2f0f-1107-4470-b2d2-52c80fb15603 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:56.752599 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-950d2f0f-1107-4470-b2d2-52c80fb15603 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:56.753623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-950d2f0f-1107-4470-b2d2-52c80fb15603 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:56.754640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-950d2f0f-1107-4470-b2d2-52c80fb15603 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:56.813721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-950d2f0f-1107-4470-b2d2-52c80fb15603 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:56.822091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-950d2f0f-1107-4470-b2d2-52c80fb15603 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080920 Jun 20 07:34:56.822665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1227/2334] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:56 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:57.485081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b4e94ce2-44b7-4df9-949f-ac80b2ca71b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:57.485629 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b4e94ce2-44b7-4df9-949f-ac80b2ca71b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:57.492772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4e94ce2-44b7-4df9-949f-ac80b2ca71b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:57.493230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4e94ce2-44b7-4df9-949f-ac80b2ca71b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:57.493989 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4e94ce2-44b7-4df9-949f-ac80b2ca71b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:57.494432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4e94ce2-44b7-4df9-949f-ac80b2ca71b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:57.632384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b4e94ce2-44b7-4df9-949f-ac80b2ca71b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:57.640558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b4e94ce2-44b7-4df9-949f-ac80b2ca71b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.159464 Jun 20 07:34:57.641119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1108/2335] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:57 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:57.838826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4dde4143-d5ca-498c-899a-1ba460af3354 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:57.839467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4dde4143-d5ca-498c-899a-1ba460af3354 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:57.846090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4dde4143-d5ca-498c-899a-1ba460af3354 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:57.846533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4dde4143-d5ca-498c-899a-1ba460af3354 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:57.847287 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4dde4143-d5ca-498c-899a-1ba460af3354 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:57.848361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4dde4143-d5ca-498c-899a-1ba460af3354 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:57.910744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4dde4143-d5ca-498c-899a-1ba460af3354 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:57.918677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4dde4143-d5ca-498c-899a-1ba460af3354 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083795 Jun 20 07:34:57.919248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1228/2336] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:57 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:58.657450 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3b133022-072a-4f2f-8f4c-9427cf524f7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:58.658072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3b133022-072a-4f2f-8f4c-9427cf524f7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:58.665340 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b133022-072a-4f2f-8f4c-9427cf524f7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:58.665791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b133022-072a-4f2f-8f4c-9427cf524f7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:58.666552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b133022-072a-4f2f-8f4c-9427cf524f7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:58.666993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3b133022-072a-4f2f-8f4c-9427cf524f7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:58.792315 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3b133022-072a-4f2f-8f4c-9427cf524f7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:58.800199 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3b133022-072a-4f2f-8f4c-9427cf524f7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146618 Jun 20 07:34:58.800767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1109/2337] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:58.935601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8adc8191-daa2-4656-945e-cda782e8acd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:58.936241 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8adc8191-daa2-4656-945e-cda782e8acd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:58.943188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8adc8191-daa2-4656-945e-cda782e8acd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:58.943655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8adc8191-daa2-4656-945e-cda782e8acd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:58.944441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8adc8191-daa2-4656-945e-cda782e8acd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:58.944879 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8adc8191-daa2-4656-945e-cda782e8acd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:59.006738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8adc8191-daa2-4656-945e-cda782e8acd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:59.014673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8adc8191-daa2-4656-945e-cda782e8acd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082965 Jun 20 07:34:59.015243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1229/2338] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:58 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:34:59.817796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d63981a2-b0de-4043-a2af-5581098efa3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:34:59.818424 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d63981a2-b0de-4043-a2af-5581098efa3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:34:59.824949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d63981a2-b0de-4043-a2af-5581098efa3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:59.825400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d63981a2-b0de-4043-a2af-5581098efa3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:59.826161 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d63981a2-b0de-4043-a2af-5581098efa3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:34:59.826599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d63981a2-b0de-4043-a2af-5581098efa3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:34:59.954711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d63981a2-b0de-4043-a2af-5581098efa3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:34:59.963257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d63981a2-b0de-4043-a2af-5581098efa3e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149764 Jun 20 07:34:59.963772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1110/2339] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:34:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:00.031715 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b1d58b27-8df6-46e8-aa3d-a5ff5758859a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:00.032363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b1d58b27-8df6-46e8-aa3d-a5ff5758859a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:00.039604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1d58b27-8df6-46e8-aa3d-a5ff5758859a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:00.040066 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1d58b27-8df6-46e8-aa3d-a5ff5758859a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:00.040881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1d58b27-8df6-46e8-aa3d-a5ff5758859a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:00.041327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1d58b27-8df6-46e8-aa3d-a5ff5758859a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:00.105106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b1d58b27-8df6-46e8-aa3d-a5ff5758859a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:00.114269 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b1d58b27-8df6-46e8-aa3d-a5ff5758859a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086341 Jun 20 07:35:00.115102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1230/2340] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:00 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:00.979927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-02133b53-ddf1-42ad-afd6-3c29d8e4e0de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:00.980528 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-02133b53-ddf1-42ad-afd6-3c29d8e4e0de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:00.987091 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02133b53-ddf1-42ad-afd6-3c29d8e4e0de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:00.987547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02133b53-ddf1-42ad-afd6-3c29d8e4e0de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:00.988347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02133b53-ddf1-42ad-afd6-3c29d8e4e0de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:00.988793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-02133b53-ddf1-42ad-afd6-3c29d8e4e0de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:01.116421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-02133b53-ddf1-42ad-afd6-3c29d8e4e0de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:01.124289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-02133b53-ddf1-42ad-afd6-3c29d8e4e0de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148263 Jun 20 07:35:01.124853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1111/2341] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:00 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:01.132040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-63fbe195-cd40-4fdf-9987-b24cc29aed66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:01.132684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-63fbe195-cd40-4fdf-9987-b24cc29aed66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:01.139046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63fbe195-cd40-4fdf-9987-b24cc29aed66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:01.139495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63fbe195-cd40-4fdf-9987-b24cc29aed66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:01.140272 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63fbe195-cd40-4fdf-9987-b24cc29aed66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:01.140708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63fbe195-cd40-4fdf-9987-b24cc29aed66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:01.202062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-63fbe195-cd40-4fdf-9987-b24cc29aed66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:01.210399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-63fbe195-cd40-4fdf-9987-b24cc29aed66 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082398 Jun 20 07:35:01.210963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1231/2342] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:01 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:02.141458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7fedc4b4-34bc-4690-a2cb-6c2bc71c0852 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:02.142075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7fedc4b4-34bc-4690-a2cb-6c2bc71c0852 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:02.148570 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fedc4b4-34bc-4690-a2cb-6c2bc71c0852 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:02.149017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fedc4b4-34bc-4690-a2cb-6c2bc71c0852 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:02.149775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fedc4b4-34bc-4690-a2cb-6c2bc71c0852 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:02.150208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fedc4b4-34bc-4690-a2cb-6c2bc71c0852 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:02.227326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-07321cda-a24a-4d3c-9514-d378680b110c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:02.227948 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-07321cda-a24a-4d3c-9514-d378680b110c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:02.234624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07321cda-a24a-4d3c-9514-d378680b110c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:02.235078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07321cda-a24a-4d3c-9514-d378680b110c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:02.235839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07321cda-a24a-4d3c-9514-d378680b110c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:02.236312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-07321cda-a24a-4d3c-9514-d378680b110c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:02.286877 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7fedc4b4-34bc-4690-a2cb-6c2bc71c0852 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:02.294855 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7fedc4b4-34bc-4690-a2cb-6c2bc71c0852 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.157312 Jun 20 07:35:02.295413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1112/2343] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:02.302995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-07321cda-a24a-4d3c-9514-d378680b110c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:02.311164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-07321cda-a24a-4d3c-9514-d378680b110c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.087725 Jun 20 07:35:02.311725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1232/2344] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:02 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:35:03.313311 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-013c073a-4d8c-47b3-919e-a4ba61deff17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:03.313931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-013c073a-4d8c-47b3-919e-a4ba61deff17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:03.320474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-013c073a-4d8c-47b3-919e-a4ba61deff17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:03.320930 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-013c073a-4d8c-47b3-919e-a4ba61deff17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:03.321692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-013c073a-4d8c-47b3-919e-a4ba61deff17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:03.322136 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-013c073a-4d8c-47b3-919e-a4ba61deff17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:03.327515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7fb9e9c4-8264-437b-a765-caa6e29af1a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:03.328273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7fb9e9c4-8264-437b-a765-caa6e29af1a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:03.335153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fb9e9c4-8264-437b-a765-caa6e29af1a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:03.335600 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fb9e9c4-8264-437b-a765-caa6e29af1a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:03.336386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fb9e9c4-8264-437b-a765-caa6e29af1a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:03.336823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fb9e9c4-8264-437b-a765-caa6e29af1a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:03.416645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7fb9e9c4-8264-437b-a765-caa6e29af1a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:03.424492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7fb9e9c4-8264-437b-a765-caa6e29af1a6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.100740 Jun 20 07:35:03.425301 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1233/2345] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:03 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:35:03.474850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-013c073a-4d8c-47b3-919e-a4ba61deff17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:03.482646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-013c073a-4d8c-47b3-919e-a4ba61deff17 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.173505 Jun 20 07:35:03.483217 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1113/2346] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:03 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:04.441244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b04d761e-cb86-41db-8a9e-2b3c2cb79bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:04.441842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b04d761e-cb86-41db-8a9e-2b3c2cb79bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:04.447957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b04d761e-cb86-41db-8a9e-2b3c2cb79bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:04.448438 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b04d761e-cb86-41db-8a9e-2b3c2cb79bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:04.449184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b04d761e-cb86-41db-8a9e-2b3c2cb79bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:04.449615 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b04d761e-cb86-41db-8a9e-2b3c2cb79bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:04.463749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:35:04.498654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4050de7c-d60e-4db8-b6e8-6f1864178606 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:04.499277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4050de7c-d60e-4db8-b6e8-6f1864178606 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:04.506028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4050de7c-d60e-4db8-b6e8-6f1864178606 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:04.506477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4050de7c-d60e-4db8-b6e8-6f1864178606 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:04.507237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4050de7c-d60e-4db8-b6e8-6f1864178606 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:04.507919 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4050de7c-d60e-4db8-b6e8-6f1864178606 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:04.509944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b04d761e-cb86-41db-8a9e-2b3c2cb79bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:04.517836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b04d761e-cb86-41db-8a9e-2b3c2cb79bd0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080492 Jun 20 07:35:04.518405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1234/2347] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:04 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:35:04.636683 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4050de7c-d60e-4db8-b6e8-6f1864178606 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:04.644976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4050de7c-d60e-4db8-b6e8-6f1864178606 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149670 Jun 20 07:35:04.645539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1114/2348] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:04 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:05.534428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-692bf6f2-d041-4e65-9fac-8795a4cf9379 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:05.535640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-692bf6f2-d041-4e65-9fac-8795a4cf9379 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:05.542063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-692bf6f2-d041-4e65-9fac-8795a4cf9379 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:05.542514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-692bf6f2-d041-4e65-9fac-8795a4cf9379 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:05.543273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-692bf6f2-d041-4e65-9fac-8795a4cf9379 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:05.543713 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-692bf6f2-d041-4e65-9fac-8795a4cf9379 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:05.603241 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-692bf6f2-d041-4e65-9fac-8795a4cf9379 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:05.611190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-692bf6f2-d041-4e65-9fac-8795a4cf9379 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080629 Jun 20 07:35:05.611753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1235/2349] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:05 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:05.662209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cb2a13c6-e3db-4213-97f2-22f451e2298d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:05.662819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cb2a13c6-e3db-4213-97f2-22f451e2298d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:05.669237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb2a13c6-e3db-4213-97f2-22f451e2298d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:05.669682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb2a13c6-e3db-4213-97f2-22f451e2298d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:05.670430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb2a13c6-e3db-4213-97f2-22f451e2298d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:05.670864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb2a13c6-e3db-4213-97f2-22f451e2298d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:05.798757 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cb2a13c6-e3db-4213-97f2-22f451e2298d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:05.806671 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cb2a13c6-e3db-4213-97f2-22f451e2298d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148819 Jun 20 07:35:05.807243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1115/2350] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:05 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:06.627265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-68bf1927-9948-4f05-a42d-54025f8a87d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:06.628081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-68bf1927-9948-4f05-a42d-54025f8a87d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:06.634566 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68bf1927-9948-4f05-a42d-54025f8a87d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:06.635017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68bf1927-9948-4f05-a42d-54025f8a87d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:06.635773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68bf1927-9948-4f05-a42d-54025f8a87d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:06.636241 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-68bf1927-9948-4f05-a42d-54025f8a87d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:06.698941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-68bf1927-9948-4f05-a42d-54025f8a87d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:06.706899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-68bf1927-9948-4f05-a42d-54025f8a87d8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083544 Jun 20 07:35:06.707460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1236/2351] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:06 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:06.823789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-35d7e686-7fcf-4d65-aed0-e32f6f0b7269 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:06.824428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-35d7e686-7fcf-4d65-aed0-e32f6f0b7269 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:06.830903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35d7e686-7fcf-4d65-aed0-e32f6f0b7269 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:06.831347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35d7e686-7fcf-4d65-aed0-e32f6f0b7269 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:06.832670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35d7e686-7fcf-4d65-aed0-e32f6f0b7269 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:06.833110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35d7e686-7fcf-4d65-aed0-e32f6f0b7269 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:06.958566 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-35d7e686-7fcf-4d65-aed0-e32f6f0b7269 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:06.966429 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-35d7e686-7fcf-4d65-aed0-e32f6f0b7269 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146443 Jun 20 07:35:06.966997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1116/2352] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:06 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:07.723554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7ed6e0bf-339b-4a6f-95a3-d446d2ecfa42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:07.724208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7ed6e0bf-339b-4a6f-95a3-d446d2ecfa42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:07.730705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ed6e0bf-339b-4a6f-95a3-d446d2ecfa42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:07.731154 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ed6e0bf-339b-4a6f-95a3-d446d2ecfa42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:07.731945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ed6e0bf-339b-4a6f-95a3-d446d2ecfa42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:07.732407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7ed6e0bf-339b-4a6f-95a3-d446d2ecfa42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:07.793454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7ed6e0bf-339b-4a6f-95a3-d446d2ecfa42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:07.801334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7ed6e0bf-339b-4a6f-95a3-d446d2ecfa42 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082412 Jun 20 07:35:07.801894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1237/2353] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:07 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:07.983840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3c331b0d-e31f-4f68-991a-8bbd9695d31e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:07.984431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3c331b0d-e31f-4f68-991a-8bbd9695d31e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:07.990893 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c331b0d-e31f-4f68-991a-8bbd9695d31e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:07.991346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c331b0d-e31f-4f68-991a-8bbd9695d31e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:07.992127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c331b0d-e31f-4f68-991a-8bbd9695d31e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:07.992578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c331b0d-e31f-4f68-991a-8bbd9695d31e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:08.123573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c331b0d-e31f-4f68-991a-8bbd9695d31e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:08.131729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3c331b0d-e31f-4f68-991a-8bbd9695d31e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151803 Jun 20 07:35:08.132395 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1117/2354] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:07 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:08.817839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8e619ec2-a6e7-4972-8808-8b34ab7152ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:08.818458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8e619ec2-a6e7-4972-8808-8b34ab7152ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:08.824977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e619ec2-a6e7-4972-8808-8b34ab7152ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:08.825430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e619ec2-a6e7-4972-8808-8b34ab7152ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:08.826190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e619ec2-a6e7-4972-8808-8b34ab7152ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:08.826627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e619ec2-a6e7-4972-8808-8b34ab7152ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:08.888792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8e619ec2-a6e7-4972-8808-8b34ab7152ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:08.897318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8e619ec2-a6e7-4972-8808-8b34ab7152ad tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083857 Jun 20 07:35:08.897888 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1238/2355] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:08 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:09.149117 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ad7647f-9c21-4151-b4f6-8375e794b344 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:09.149641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3ad7647f-9c21-4151-b4f6-8375e794b344 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:09.156095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ad7647f-9c21-4151-b4f6-8375e794b344 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:09.156569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ad7647f-9c21-4151-b4f6-8375e794b344 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:09.157320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ad7647f-9c21-4151-b4f6-8375e794b344 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:09.157752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ad7647f-9c21-4151-b4f6-8375e794b344 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:09.283102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3ad7647f-9c21-4151-b4f6-8375e794b344 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:09.291589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3ad7647f-9c21-4151-b4f6-8375e794b344 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146322 Jun 20 07:35:09.292166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1118/2356] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:09 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:09.914545 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-01862c2b-831a-48d4-9ae8-be20951662ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:09.915148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-01862c2b-831a-48d4-9ae8-be20951662ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:09.921574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01862c2b-831a-48d4-9ae8-be20951662ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:09.922012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01862c2b-831a-48d4-9ae8-be20951662ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:09.922751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01862c2b-831a-48d4-9ae8-be20951662ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:09.923178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-01862c2b-831a-48d4-9ae8-be20951662ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:09.985564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-01862c2b-831a-48d4-9ae8-be20951662ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:09.993681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-01862c2b-831a-48d4-9ae8-be20951662ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082945 Jun 20 07:35:09.994256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1239/2357] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:09 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:10.308605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3eba1140-9720-4b74-9887-e400d733d9ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:10.309226 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3eba1140-9720-4b74-9887-e400d733d9ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:10.316195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3eba1140-9720-4b74-9887-e400d733d9ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:10.316659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3eba1140-9720-4b74-9887-e400d733d9ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:10.317417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3eba1140-9720-4b74-9887-e400d733d9ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:10.317854 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3eba1140-9720-4b74-9887-e400d733d9ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:10.332756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:35:10.443021 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3eba1140-9720-4b74-9887-e400d733d9ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:10.450889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3eba1140-9720-4b74-9887-e400d733d9ee tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146201 Jun 20 07:35:10.451455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1119/2358] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:10 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:11.010624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-43592169-ba70-4440-a2d6-b17ba4ef6175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:11.011238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-43592169-ba70-4440-a2d6-b17ba4ef6175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:11.017796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43592169-ba70-4440-a2d6-b17ba4ef6175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:11.018246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43592169-ba70-4440-a2d6-b17ba4ef6175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:11.019636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43592169-ba70-4440-a2d6-b17ba4ef6175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:11.020072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-43592169-ba70-4440-a2d6-b17ba4ef6175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:11.084477 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-43592169-ba70-4440-a2d6-b17ba4ef6175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:11.092814 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-43592169-ba70-4440-a2d6-b17ba4ef6175 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085993 Jun 20 07:35:11.093375 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1240/2359] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:11 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:11.468663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-85dd6af6-8ac2-4db2-a6bf-28c306dd2b36 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:11.469246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-85dd6af6-8ac2-4db2-a6bf-28c306dd2b36 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:11.476424 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85dd6af6-8ac2-4db2-a6bf-28c306dd2b36 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:11.476879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85dd6af6-8ac2-4db2-a6bf-28c306dd2b36 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:11.477677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85dd6af6-8ac2-4db2-a6bf-28c306dd2b36 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:11.478122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85dd6af6-8ac2-4db2-a6bf-28c306dd2b36 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:11.604578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-85dd6af6-8ac2-4db2-a6bf-28c306dd2b36 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:11.612540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-85dd6af6-8ac2-4db2-a6bf-28c306dd2b36 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147772 Jun 20 07:35:11.613085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1120/2360] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:11 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:12.109974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ad5ac2dc-2edb-485a-a660-5b426e472749 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:12.110582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ad5ac2dc-2edb-485a-a660-5b426e472749 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:12.117518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad5ac2dc-2edb-485a-a660-5b426e472749 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:12.117962 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad5ac2dc-2edb-485a-a660-5b426e472749 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:12.118715 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad5ac2dc-2edb-485a-a660-5b426e472749 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:12.119150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ad5ac2dc-2edb-485a-a660-5b426e472749 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:12.178901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ad5ac2dc-2edb-485a-a660-5b426e472749 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:12.186681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ad5ac2dc-2edb-485a-a660-5b426e472749 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080595 Jun 20 07:35:12.187245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1241/2361] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:12 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:12.629858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6be0c83c-2a58-4616-8034-d7b94839f73d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:12.630481 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6be0c83c-2a58-4616-8034-d7b94839f73d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:12.636982 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6be0c83c-2a58-4616-8034-d7b94839f73d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:12.637434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6be0c83c-2a58-4616-8034-d7b94839f73d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:12.638193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6be0c83c-2a58-4616-8034-d7b94839f73d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:12.638635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6be0c83c-2a58-4616-8034-d7b94839f73d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:12.765894 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6be0c83c-2a58-4616-8034-d7b94839f73d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:12.773737 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6be0c83c-2a58-4616-8034-d7b94839f73d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147938 Jun 20 07:35:12.774289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1121/2362] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:12 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:13.203559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2d617fd8-7d51-453c-bc27-dacddb0ba1b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:13.204198 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2d617fd8-7d51-453c-bc27-dacddb0ba1b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:13.210991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d617fd8-7d51-453c-bc27-dacddb0ba1b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:13.211441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d617fd8-7d51-453c-bc27-dacddb0ba1b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:13.212234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d617fd8-7d51-453c-bc27-dacddb0ba1b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:13.212667 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d617fd8-7d51-453c-bc27-dacddb0ba1b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:13.275579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2d617fd8-7d51-453c-bc27-dacddb0ba1b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:13.283373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2d617fd8-7d51-453c-bc27-dacddb0ba1b0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083685 Jun 20 07:35:13.283939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1242/2363] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:13 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:13.791089 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7af440e4-33c6-4e99-b94e-bb3caf4902e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:13.791711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7af440e4-33c6-4e99-b94e-bb3caf4902e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:13.798220 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7af440e4-33c6-4e99-b94e-bb3caf4902e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:13.798679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7af440e4-33c6-4e99-b94e-bb3caf4902e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:13.799437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7af440e4-33c6-4e99-b94e-bb3caf4902e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:13.799876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7af440e4-33c6-4e99-b94e-bb3caf4902e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:13.923964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7af440e4-33c6-4e99-b94e-bb3caf4902e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:13.931788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7af440e4-33c6-4e99-b94e-bb3caf4902e4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144527 Jun 20 07:35:13.932385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1122/2364] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:13 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:14.301395 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-072bfe19-1df6-4031-ad7b-aa484e687ae0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:14.301925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-072bfe19-1df6-4031-ad7b-aa484e687ae0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:14.308390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-072bfe19-1df6-4031-ad7b-aa484e687ae0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:14.308842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-072bfe19-1df6-4031-ad7b-aa484e687ae0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:14.309625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-072bfe19-1df6-4031-ad7b-aa484e687ae0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:14.310062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-072bfe19-1df6-4031-ad7b-aa484e687ae0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:14.369690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-072bfe19-1df6-4031-ad7b-aa484e687ae0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:14.377451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-072bfe19-1df6-4031-ad7b-aa484e687ae0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080683 Jun 20 07:35:14.378281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1243/2365] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:14 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:14.949422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-87501481-564e-4052-8cca-3c5fb707f767 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:14.950045 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-87501481-564e-4052-8cca-3c5fb707f767 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:14.957173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87501481-564e-4052-8cca-3c5fb707f767 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:14.957624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87501481-564e-4052-8cca-3c5fb707f767 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:14.958385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87501481-564e-4052-8cca-3c5fb707f767 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:14.958868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87501481-564e-4052-8cca-3c5fb707f767 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:15.090893 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87501481-564e-4052-8cca-3c5fb707f767 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:15.103947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-87501481-564e-4052-8cca-3c5fb707f767 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.158059 Jun 20 07:35:15.105044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1123/2366] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:14 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:15.394362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-42f7b95d-53b9-4637-9c8b-47a4a4d72ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:15.394976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-42f7b95d-53b9-4637-9c8b-47a4a4d72ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:15.401550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42f7b95d-53b9-4637-9c8b-47a4a4d72ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:15.402000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42f7b95d-53b9-4637-9c8b-47a4a4d72ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:15.402758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42f7b95d-53b9-4637-9c8b-47a4a4d72ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:15.403196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-42f7b95d-53b9-4637-9c8b-47a4a4d72ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:15.471332 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-42f7b95d-53b9-4637-9c8b-47a4a4d72ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:15.479707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-42f7b95d-53b9-4637-9c8b-47a4a4d72ec7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.089210 Jun 20 07:35:15.480316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1244/2367] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:15 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:16.122135 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-19a85764-a997-4b55-9e8e-94670718c992 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:16.122749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-19a85764-a997-4b55-9e8e-94670718c992 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:16.130680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19a85764-a997-4b55-9e8e-94670718c992 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:16.131121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19a85764-a997-4b55-9e8e-94670718c992 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:16.131873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19a85764-a997-4b55-9e8e-94670718c992 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:16.132335 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19a85764-a997-4b55-9e8e-94670718c992 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:16.259013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-19a85764-a997-4b55-9e8e-94670718c992 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:16.266765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-19a85764-a997-4b55-9e8e-94670718c992 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148478 Jun 20 07:35:16.267328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1124/2368] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:16 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:16.496831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c9862155-9bfa-475f-ac8b-f911c137801c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:16.497448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c9862155-9bfa-475f-ac8b-f911c137801c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:16.504749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9862155-9bfa-475f-ac8b-f911c137801c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:16.505196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9862155-9bfa-475f-ac8b-f911c137801c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:16.505950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9862155-9bfa-475f-ac8b-f911c137801c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:16.506383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c9862155-9bfa-475f-ac8b-f911c137801c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:16.569388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c9862155-9bfa-475f-ac8b-f911c137801c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:16.577202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c9862155-9bfa-475f-ac8b-f911c137801c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084202 Jun 20 07:35:16.577767 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1245/2369] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:16 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:17.284859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-061a4905-eedb-4bef-a5b1-e832c205eda9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:17.285600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-061a4905-eedb-4bef-a5b1-e832c205eda9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:17.291906 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-061a4905-eedb-4bef-a5b1-e832c205eda9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:17.292378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-061a4905-eedb-4bef-a5b1-e832c205eda9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:17.293122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-061a4905-eedb-4bef-a5b1-e832c205eda9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:17.293554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-061a4905-eedb-4bef-a5b1-e832c205eda9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:17.423085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-061a4905-eedb-4bef-a5b1-e832c205eda9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:17.431017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-061a4905-eedb-4bef-a5b1-e832c205eda9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150634 Jun 20 07:35:17.431610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1125/2370] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:17 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:17.593587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fa76b702-16d4-43c5-9d8c-a526b4fd5492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:17.594365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fa76b702-16d4-43c5-9d8c-a526b4fd5492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:17.601547 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa76b702-16d4-43c5-9d8c-a526b4fd5492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:17.601984 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa76b702-16d4-43c5-9d8c-a526b4fd5492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:17.603318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa76b702-16d4-43c5-9d8c-a526b4fd5492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:17.604093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fa76b702-16d4-43c5-9d8c-a526b4fd5492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:17.672691 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fa76b702-16d4-43c5-9d8c-a526b4fd5492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:17.681454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fa76b702-16d4-43c5-9d8c-a526b4fd5492 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.091785 Jun 20 07:35:17.682019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1246/2371] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:17 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:18.447796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a34a9b70-37b6-480d-a2c3-e36cc3850dd2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:18.448415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a34a9b70-37b6-480d-a2c3-e36cc3850dd2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:18.450695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:35:18.456327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a34a9b70-37b6-480d-a2c3-e36cc3850dd2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:18.456778 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a34a9b70-37b6-480d-a2c3-e36cc3850dd2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:18.457533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a34a9b70-37b6-480d-a2c3-e36cc3850dd2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:18.458226 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a34a9b70-37b6-480d-a2c3-e36cc3850dd2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:18.586345 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a34a9b70-37b6-480d-a2c3-e36cc3850dd2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:18.594197 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a34a9b70-37b6-480d-a2c3-e36cc3850dd2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150234 Jun 20 07:35:18.594766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1126/2372] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:18 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:18.698783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0727de49-172d-4ed3-b07d-d42410d8e29a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:18.699381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0727de49-172d-4ed3-b07d-d42410d8e29a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:18.706057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0727de49-172d-4ed3-b07d-d42410d8e29a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:18.706509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0727de49-172d-4ed3-b07d-d42410d8e29a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:18.707275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0727de49-172d-4ed3-b07d-d42410d8e29a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:18.707710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0727de49-172d-4ed3-b07d-d42410d8e29a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:18.767746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0727de49-172d-4ed3-b07d-d42410d8e29a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:18.775525 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0727de49-172d-4ed3-b07d-d42410d8e29a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080730 Jun 20 07:35:18.776089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1247/2373] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:18 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:19.611232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d6794523-4cd2-4d2d-bf92-c2b025ed5f44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:19.611824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d6794523-4cd2-4d2d-bf92-c2b025ed5f44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:19.617816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6794523-4cd2-4d2d-bf92-c2b025ed5f44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:19.618261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6794523-4cd2-4d2d-bf92-c2b025ed5f44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:19.619006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6794523-4cd2-4d2d-bf92-c2b025ed5f44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:19.619439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6794523-4cd2-4d2d-bf92-c2b025ed5f44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:19.745269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d6794523-4cd2-4d2d-bf92-c2b025ed5f44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:19.753452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d6794523-4cd2-4d2d-bf92-c2b025ed5f44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146621 Jun 20 07:35:19.754015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1127/2374] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:19 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:19.792653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1f6ec14f-ca03-4455-a448-980b03f0c469 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:19.793267 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1f6ec14f-ca03-4455-a448-980b03f0c469 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:19.799634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f6ec14f-ca03-4455-a448-980b03f0c469 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:19.800085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f6ec14f-ca03-4455-a448-980b03f0c469 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:19.800863 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f6ec14f-ca03-4455-a448-980b03f0c469 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:19.801295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f6ec14f-ca03-4455-a448-980b03f0c469 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:19.863818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f6ec14f-ca03-4455-a448-980b03f0c469 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:19.871778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1f6ec14f-ca03-4455-a448-980b03f0c469 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082963 Jun 20 07:35:19.872369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1248/2375] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:19 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:20.771146 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0bfc1540-f0e8-4314-bd1f-4ee3c8a80a10 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:20.771814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0bfc1540-f0e8-4314-bd1f-4ee3c8a80a10 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:20.778289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bfc1540-f0e8-4314-bd1f-4ee3c8a80a10 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:20.778740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bfc1540-f0e8-4314-bd1f-4ee3c8a80a10 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:20.779505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bfc1540-f0e8-4314-bd1f-4ee3c8a80a10 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:20.779945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bfc1540-f0e8-4314-bd1f-4ee3c8a80a10 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:20.888655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-036e36dd-0000-404c-856a-b6a326de4cc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:20.889277 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-036e36dd-0000-404c-856a-b6a326de4cc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:20.891574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:35:20.897491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-036e36dd-0000-404c-856a-b6a326de4cc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:20.897946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-036e36dd-0000-404c-856a-b6a326de4cc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:20.898708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-036e36dd-0000-404c-856a-b6a326de4cc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:20.899149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-036e36dd-0000-404c-856a-b6a326de4cc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:20.906163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0bfc1540-f0e8-4314-bd1f-4ee3c8a80a10 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:20.914078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0bfc1540-f0e8-4314-bd1f-4ee3c8a80a10 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147415 Jun 20 07:35:20.914645 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1128/2376] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:20 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:20.961799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-036e36dd-0000-404c-856a-b6a326de4cc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:20.969711 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-036e36dd-0000-404c-856a-b6a326de4cc7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084878 Jun 20 07:35:20.970283 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1249/2377] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:20 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:35:21.930714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1843c234-2b79-42fe-a2c1-0f29a0e7db13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:21.931475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1843c234-2b79-42fe-a2c1-0f29a0e7db13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:21.938255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1843c234-2b79-42fe-a2c1-0f29a0e7db13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:21.938707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1843c234-2b79-42fe-a2c1-0f29a0e7db13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:21.939469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1843c234-2b79-42fe-a2c1-0f29a0e7db13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:21.939907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1843c234-2b79-42fe-a2c1-0f29a0e7db13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:21.986678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-66fccfad-693e-47e8-8805-ace061a130fe tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:21.987253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-66fccfad-693e-47e8-8805-ace061a130fe tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:21.993937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66fccfad-693e-47e8-8805-ace061a130fe tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:21.994382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66fccfad-693e-47e8-8805-ace061a130fe tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:21.995162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66fccfad-693e-47e8-8805-ace061a130fe tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:21.995595 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-66fccfad-693e-47e8-8805-ace061a130fe tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:22.072608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-66fccfad-693e-47e8-8805-ace061a130fe tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:22.080434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-66fccfad-693e-47e8-8805-ace061a130fe tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.097664 Jun 20 07:35:22.081600 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1250/2378] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:21 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:35:22.093861 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1843c234-2b79-42fe-a2c1-0f29a0e7db13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:22.102198 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1843c234-2b79-42fe-a2c1-0f29a0e7db13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.175257 Jun 20 07:35:22.102750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1129/2379] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:21 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:23.098496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e5bac8f5-7642-4832-87a5-6ffe4300d1c2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:23.099204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e5bac8f5-7642-4832-87a5-6ffe4300d1c2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:23.106452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5bac8f5-7642-4832-87a5-6ffe4300d1c2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:23.106905 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5bac8f5-7642-4832-87a5-6ffe4300d1c2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:23.107673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5bac8f5-7642-4832-87a5-6ffe4300d1c2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:23.108141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e5bac8f5-7642-4832-87a5-6ffe4300d1c2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:23.112707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:35:23.119205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bc969829-b214-4bec-949b-741e8bacd4c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:23.119822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bc969829-b214-4bec-949b-741e8bacd4c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:23.126694 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc969829-b214-4bec-949b-741e8bacd4c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:23.127342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc969829-b214-4bec-949b-741e8bacd4c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:23.128480 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc969829-b214-4bec-949b-741e8bacd4c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:23.129027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc969829-b214-4bec-949b-741e8bacd4c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:23.174311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e5bac8f5-7642-4832-87a5-6ffe4300d1c2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:23.183683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e5bac8f5-7642-4832-87a5-6ffe4300d1c2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.089790 Jun 20 07:35:23.184282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1251/2380] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:23 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:23.264966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bc969829-b214-4bec-949b-741e8bacd4c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:23.272889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bc969829-b214-4bec-949b-741e8bacd4c3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.157498 Jun 20 07:35:23.273452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1130/2381] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:23 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:35:24.200421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b655dc5e-5d74-40b5-8375-ee78ef25d40d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:24.201015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b655dc5e-5d74-40b5-8375-ee78ef25d40d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:24.208052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b655dc5e-5d74-40b5-8375-ee78ef25d40d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:24.208529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b655dc5e-5d74-40b5-8375-ee78ef25d40d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:24.209283 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b655dc5e-5d74-40b5-8375-ee78ef25d40d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:24.209718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b655dc5e-5d74-40b5-8375-ee78ef25d40d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:24.290936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ea7307a9-ad37-4666-9b56-3694ffec592b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:24.291577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ea7307a9-ad37-4666-9b56-3694ffec592b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:24.298304 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea7307a9-ad37-4666-9b56-3694ffec592b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:24.298749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea7307a9-ad37-4666-9b56-3694ffec592b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:24.299517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea7307a9-ad37-4666-9b56-3694ffec592b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:24.299981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea7307a9-ad37-4666-9b56-3694ffec592b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:24.432022 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b655dc5e-5d74-40b5-8375-ee78ef25d40d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:24.440760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b655dc5e-5d74-40b5-8375-ee78ef25d40d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.243592 Jun 20 07:35:24.441325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1252/2382] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:24 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:24.459389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ea7307a9-ad37-4666-9b56-3694ffec592b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:24.467262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ea7307a9-ad37-4666-9b56-3694ffec592b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.180375 Jun 20 07:35:24.467828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1131/2383] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:24 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:35:25.457279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d6d595dd-eec6-499d-8ece-7bee6062c72c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:25.457891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d6d595dd-eec6-499d-8ece-7bee6062c72c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:25.464680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6d595dd-eec6-499d-8ece-7bee6062c72c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:25.465131 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6d595dd-eec6-499d-8ece-7bee6062c72c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:25.465889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6d595dd-eec6-499d-8ece-7bee6062c72c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:25.466327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6d595dd-eec6-499d-8ece-7bee6062c72c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:25.484137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d88fe2a7-1ab5-4308-82ab-99b85932044d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:25.484753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d88fe2a7-1ab5-4308-82ab-99b85932044d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:25.491161 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d88fe2a7-1ab5-4308-82ab-99b85932044d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:25.491758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d88fe2a7-1ab5-4308-82ab-99b85932044d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:25.492557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d88fe2a7-1ab5-4308-82ab-99b85932044d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:25.492999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d88fe2a7-1ab5-4308-82ab-99b85932044d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:25.528603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d6d595dd-eec6-499d-8ece-7bee6062c72c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:25.537108 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d6d595dd-eec6-499d-8ece-7bee6062c72c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084343 Jun 20 07:35:25.537778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1253/2384] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:25 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:25.625267 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d88fe2a7-1ab5-4308-82ab-99b85932044d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:25.633688 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d88fe2a7-1ab5-4308-82ab-99b85932044d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.153455 Jun 20 07:35:25.634248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1132/2385] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:25 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:35:26.553842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a71b0176-9826-4563-8a16-270e695c3270 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:26.554453 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a71b0176-9826-4563-8a16-270e695c3270 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:26.560912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a71b0176-9826-4563-8a16-270e695c3270 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:26.561359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a71b0176-9826-4563-8a16-270e695c3270 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:26.562112 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a71b0176-9826-4563-8a16-270e695c3270 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:26.562540 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a71b0176-9826-4563-8a16-270e695c3270 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:26.624457 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a71b0176-9826-4563-8a16-270e695c3270 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:26.632562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a71b0176-9826-4563-8a16-270e695c3270 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082498 Jun 20 07:35:26.633115 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1254/2386] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:26 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:26.650168 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-065c18a4-4279-4f36-a6c3-9e5c15413a6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:26.650815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-065c18a4-4279-4f36-a6c3-9e5c15413a6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:26.657290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-065c18a4-4279-4f36-a6c3-9e5c15413a6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:26.657741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-065c18a4-4279-4f36-a6c3-9e5c15413a6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:26.658494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-065c18a4-4279-4f36-a6c3-9e5c15413a6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:26.659579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-065c18a4-4279-4f36-a6c3-9e5c15413a6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:26.788383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-065c18a4-4279-4f36-a6c3-9e5c15413a6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:26.796172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-065c18a4-4279-4f36-a6c3-9e5c15413a6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149913 Jun 20 07:35:26.796734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1133/2387] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:26 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:27.649306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-486364e7-9b10-49d1-b617-b95e82bbe86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:27.649913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-486364e7-9b10-49d1-b617-b95e82bbe86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:27.656652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-486364e7-9b10-49d1-b617-b95e82bbe86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:27.657100 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-486364e7-9b10-49d1-b617-b95e82bbe86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:27.657858 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-486364e7-9b10-49d1-b617-b95e82bbe86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:27.658320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-486364e7-9b10-49d1-b617-b95e82bbe86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:27.721965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-486364e7-9b10-49d1-b617-b95e82bbe86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:27.729856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-486364e7-9b10-49d1-b617-b95e82bbe86b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084634 Jun 20 07:35:27.730408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1255/2388] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:27 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:27.812936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-58bcaa40-a8fe-45cd-82a1-16834f718ff6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:27.813492 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-58bcaa40-a8fe-45cd-82a1-16834f718ff6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:27.819953 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58bcaa40-a8fe-45cd-82a1-16834f718ff6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:27.820431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58bcaa40-a8fe-45cd-82a1-16834f718ff6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:27.821188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58bcaa40-a8fe-45cd-82a1-16834f718ff6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:27.821622 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58bcaa40-a8fe-45cd-82a1-16834f718ff6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:27.945904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-58bcaa40-a8fe-45cd-82a1-16834f718ff6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:27.953759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-58bcaa40-a8fe-45cd-82a1-16834f718ff6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144648 Jun 20 07:35:27.954329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1134/2389] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:27 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:28.746791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-089c6faf-7061-4c1e-8ed9-4564aba7a612 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:28.747396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-089c6faf-7061-4c1e-8ed9-4564aba7a612 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:28.754190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-089c6faf-7061-4c1e-8ed9-4564aba7a612 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:28.754576 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-089c6faf-7061-4c1e-8ed9-4564aba7a612 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:28.755319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-089c6faf-7061-4c1e-8ed9-4564aba7a612 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:28.755748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-089c6faf-7061-4c1e-8ed9-4564aba7a612 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:28.815059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-089c6faf-7061-4c1e-8ed9-4564aba7a612 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:28.822860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-089c6faf-7061-4c1e-8ed9-4564aba7a612 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079916 Jun 20 07:35:28.823409 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1256/2390] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:28 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:28.970680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-020a7380-ebc4-4563-b77d-c9dbbe439080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:28.971297 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-020a7380-ebc4-4563-b77d-c9dbbe439080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:28.977821 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-020a7380-ebc4-4563-b77d-c9dbbe439080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:28.978270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-020a7380-ebc4-4563-b77d-c9dbbe439080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:28.979031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-020a7380-ebc4-4563-b77d-c9dbbe439080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:28.979470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-020a7380-ebc4-4563-b77d-c9dbbe439080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:29.107406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-020a7380-ebc4-4563-b77d-c9dbbe439080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:29.115275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-020a7380-ebc4-4563-b77d-c9dbbe439080 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148429 Jun 20 07:35:29.115834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1135/2391] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:28 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:29.839972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0c370272-d5d9-4238-b1e0-1952a5adc345 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:29.840646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0c370272-d5d9-4238-b1e0-1952a5adc345 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:29.847565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c370272-d5d9-4238-b1e0-1952a5adc345 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:29.848008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c370272-d5d9-4238-b1e0-1952a5adc345 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:29.848789 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c370272-d5d9-4238-b1e0-1952a5adc345 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:29.849221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0c370272-d5d9-4238-b1e0-1952a5adc345 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:29.911073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0c370272-d5d9-4238-b1e0-1952a5adc345 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:29.918934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0c370272-d5d9-4238-b1e0-1952a5adc345 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082866 Jun 20 07:35:29.919682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1257/2392] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:29 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:30.133147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-34d58cd0-4af6-4725-b95d-6621930f95f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:30.133698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-34d58cd0-4af6-4725-b95d-6621930f95f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:30.140079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34d58cd0-4af6-4725-b95d-6621930f95f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:30.140555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34d58cd0-4af6-4725-b95d-6621930f95f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:30.141306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34d58cd0-4af6-4725-b95d-6621930f95f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:30.141739 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-34d58cd0-4af6-4725-b95d-6621930f95f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:30.144741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:35:30.266563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-34d58cd0-4af6-4725-b95d-6621930f95f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:30.275081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-34d58cd0-4af6-4725-b95d-6621930f95f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145946 Jun 20 07:35:30.275647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1136/2393] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:30 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:30.936292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1c4b395e-786a-4673-ad79-34beff39eae6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:30.936908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1c4b395e-786a-4673-ad79-34beff39eae6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:30.943310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c4b395e-786a-4673-ad79-34beff39eae6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:30.943763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c4b395e-786a-4673-ad79-34beff39eae6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:30.944555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c4b395e-786a-4673-ad79-34beff39eae6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:30.944994 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1c4b395e-786a-4673-ad79-34beff39eae6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:31.008276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1c4b395e-786a-4673-ad79-34beff39eae6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:31.016100 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1c4b395e-786a-4673-ad79-34beff39eae6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083716 Jun 20 07:35:31.016686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1258/2394] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:30 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:31.292558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-995e3e47-98cd-42b3-89c8-1b69d0b38d52 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:31.293170 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-995e3e47-98cd-42b3-89c8-1b69d0b38d52 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:31.299524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-995e3e47-98cd-42b3-89c8-1b69d0b38d52 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:31.299965 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-995e3e47-98cd-42b3-89c8-1b69d0b38d52 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:31.300759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-995e3e47-98cd-42b3-89c8-1b69d0b38d52 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:31.301177 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-995e3e47-98cd-42b3-89c8-1b69d0b38d52 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:31.429106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-995e3e47-98cd-42b3-89c8-1b69d0b38d52 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:31.436870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-995e3e47-98cd-42b3-89c8-1b69d0b38d52 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148144 Jun 20 07:35:31.437437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1137/2395] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:31 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:32.034274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e8a22469-82dc-4f2c-8330-049061ff71e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:32.034887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e8a22469-82dc-4f2c-8330-049061ff71e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:32.041337 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8a22469-82dc-4f2c-8330-049061ff71e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:32.041784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8a22469-82dc-4f2c-8330-049061ff71e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:32.042535 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8a22469-82dc-4f2c-8330-049061ff71e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:32.042970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e8a22469-82dc-4f2c-8330-049061ff71e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:32.102921 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e8a22469-82dc-4f2c-8330-049061ff71e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:32.110626 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e8a22469-82dc-4f2c-8330-049061ff71e7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080848 Jun 20 07:35:32.111179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1259/2396] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:32 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:32.454758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-093f2d37-293b-4556-8ae4-2127fe0eaa2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:32.455309 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-093f2d37-293b-4556-8ae4-2127fe0eaa2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:32.462472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-093f2d37-293b-4556-8ae4-2127fe0eaa2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:32.462923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-093f2d37-293b-4556-8ae4-2127fe0eaa2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:32.463677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-093f2d37-293b-4556-8ae4-2127fe0eaa2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:32.464134 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-093f2d37-293b-4556-8ae4-2127fe0eaa2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:32.593472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-093f2d37-293b-4556-8ae4-2127fe0eaa2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:32.601890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-093f2d37-293b-4556-8ae4-2127fe0eaa2e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151104 Jun 20 07:35:32.602464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1138/2397] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:32 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:33.128133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4b11e9d3-d78d-4887-9106-75cf165d2156 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:33.128786 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4b11e9d3-d78d-4887-9106-75cf165d2156 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:33.135187 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b11e9d3-d78d-4887-9106-75cf165d2156 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:33.135652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b11e9d3-d78d-4887-9106-75cf165d2156 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:33.136416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b11e9d3-d78d-4887-9106-75cf165d2156 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:33.136848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b11e9d3-d78d-4887-9106-75cf165d2156 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:33.196688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4b11e9d3-d78d-4887-9106-75cf165d2156 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:33.204604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4b11e9d3-d78d-4887-9106-75cf165d2156 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080530 Jun 20 07:35:33.205168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1260/2398] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:33 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:33.618442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9b39fafa-3480-4c43-88c6-810dc843d974 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:33.619051 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9b39fafa-3480-4c43-88c6-810dc843d974 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:33.625516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b39fafa-3480-4c43-88c6-810dc843d974 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:33.625955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b39fafa-3480-4c43-88c6-810dc843d974 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:33.626703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b39fafa-3480-4c43-88c6-810dc843d974 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:33.627133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b39fafa-3480-4c43-88c6-810dc843d974 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:33.751658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9b39fafa-3480-4c43-88c6-810dc843d974 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:33.759868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9b39fafa-3480-4c43-88c6-810dc843d974 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145271 Jun 20 07:35:33.760463 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1139/2399] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:33 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:34.222418 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-61d575ad-eb79-4a5d-8dba-91b059fcd481 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:34.223056 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-61d575ad-eb79-4a5d-8dba-91b059fcd481 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:34.229182 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61d575ad-eb79-4a5d-8dba-91b059fcd481 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:34.229635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61d575ad-eb79-4a5d-8dba-91b059fcd481 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:34.230390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61d575ad-eb79-4a5d-8dba-91b059fcd481 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:34.230824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-61d575ad-eb79-4a5d-8dba-91b059fcd481 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:34.293152 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-61d575ad-eb79-4a5d-8dba-91b059fcd481 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:34.300963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-61d575ad-eb79-4a5d-8dba-91b059fcd481 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082611 Jun 20 07:35:34.301537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1261/2400] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:34 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:34.776885 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5da90566-0b18-48c8-9d8a-1d6d39edc27e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:34.777585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5da90566-0b18-48c8-9d8a-1d6d39edc27e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:34.784793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5da90566-0b18-48c8-9d8a-1d6d39edc27e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:34.785241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5da90566-0b18-48c8-9d8a-1d6d39edc27e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:34.785993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5da90566-0b18-48c8-9d8a-1d6d39edc27e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:34.786432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5da90566-0b18-48c8-9d8a-1d6d39edc27e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:34.917764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5da90566-0b18-48c8-9d8a-1d6d39edc27e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:34.925790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5da90566-0b18-48c8-9d8a-1d6d39edc27e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152741 Jun 20 07:35:34.926358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1140/2401] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:35.317574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ff930542-c80c-4bff-b7ec-fa9fa27197ce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:35.318169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ff930542-c80c-4bff-b7ec-fa9fa27197ce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:35.326977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff930542-c80c-4bff-b7ec-fa9fa27197ce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:35.327415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff930542-c80c-4bff-b7ec-fa9fa27197ce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:35.328529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff930542-c80c-4bff-b7ec-fa9fa27197ce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:35.329324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ff930542-c80c-4bff-b7ec-fa9fa27197ce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:35.390693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ff930542-c80c-4bff-b7ec-fa9fa27197ce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:35.399040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ff930542-c80c-4bff-b7ec-fa9fa27197ce tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085291 Jun 20 07:35:35.399590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1262/2402] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:35 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:35.943176 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7677fe1c-aec6-4967-81d4-2b824e8045cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:35.943802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7677fe1c-aec6-4967-81d4-2b824e8045cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:35.950318 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7677fe1c-aec6-4967-81d4-2b824e8045cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:35.950768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7677fe1c-aec6-4967-81d4-2b824e8045cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:35.951524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7677fe1c-aec6-4967-81d4-2b824e8045cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:35.951966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7677fe1c-aec6-4967-81d4-2b824e8045cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:36.082014 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7677fe1c-aec6-4967-81d4-2b824e8045cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:36.089890 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7677fe1c-aec6-4967-81d4-2b824e8045cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151063 Jun 20 07:35:36.090450 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1141/2403] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:35 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:36.415782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a72bf1cb-509b-4ca5-86b5-c6f616d734b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:36.416354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a72bf1cb-509b-4ca5-86b5-c6f616d734b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:36.422691 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72bf1cb-509b-4ca5-86b5-c6f616d734b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:36.423127 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72bf1cb-509b-4ca5-86b5-c6f616d734b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:36.423871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72bf1cb-509b-4ca5-86b5-c6f616d734b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:36.424950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a72bf1cb-509b-4ca5-86b5-c6f616d734b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:36.484680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a72bf1cb-509b-4ca5-86b5-c6f616d734b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:36.493218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a72bf1cb-509b-4ca5-86b5-c6f616d734b2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081307 Jun 20 07:35:36.493774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1263/2404] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:36 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:37.107443 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d5c9a4c8-ed8e-47d8-a871-ccb42678c2d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:37.108064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d5c9a4c8-ed8e-47d8-a871-ccb42678c2d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:37.114578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5c9a4c8-ed8e-47d8-a871-ccb42678c2d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:37.115032 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5c9a4c8-ed8e-47d8-a871-ccb42678c2d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:37.115790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5c9a4c8-ed8e-47d8-a871-ccb42678c2d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:37.116270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5c9a4c8-ed8e-47d8-a871-ccb42678c2d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:37.241556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d5c9a4c8-ed8e-47d8-a871-ccb42678c2d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:37.249489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d5c9a4c8-ed8e-47d8-a871-ccb42678c2d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145915 Jun 20 07:35:37.250061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1142/2405] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:37 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:37.510774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6395002d-8adc-482e-a1a1-0484950de131 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:37.511420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6395002d-8adc-482e-a1a1-0484950de131 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:37.518505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6395002d-8adc-482e-a1a1-0484950de131 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:37.518949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6395002d-8adc-482e-a1a1-0484950de131 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:37.519700 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6395002d-8adc-482e-a1a1-0484950de131 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:37.520148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6395002d-8adc-482e-a1a1-0484950de131 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:37.584618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6395002d-8adc-482e-a1a1-0484950de131 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:37.593085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6395002d-8adc-482e-a1a1-0484950de131 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086034 Jun 20 07:35:37.593914 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1264/2406] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:37 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:38.267575 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-08c74615-8890-439d-b73c-e348154c13b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:38.268213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-08c74615-8890-439d-b73c-e348154c13b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:38.275138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08c74615-8890-439d-b73c-e348154c13b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:38.275580 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08c74615-8890-439d-b73c-e348154c13b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:38.276365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08c74615-8890-439d-b73c-e348154c13b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:38.276799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-08c74615-8890-439d-b73c-e348154c13b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:38.403641 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-08c74615-8890-439d-b73c-e348154c13b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:38.412249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-08c74615-8890-439d-b73c-e348154c13b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148463 Jun 20 07:35:38.412818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1143/2407] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:38 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:38.609622 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5b5c5fad-587f-4bcb-ba04-75fea3df5bfd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:38.610176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5b5c5fad-587f-4bcb-ba04-75fea3df5bfd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:38.616686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b5c5fad-587f-4bcb-ba04-75fea3df5bfd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:38.617139 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b5c5fad-587f-4bcb-ba04-75fea3df5bfd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:38.617897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b5c5fad-587f-4bcb-ba04-75fea3df5bfd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:38.618334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b5c5fad-587f-4bcb-ba04-75fea3df5bfd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:38.678968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5b5c5fad-587f-4bcb-ba04-75fea3df5bfd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:38.686739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5b5c5fad-587f-4bcb-ba04-75fea3df5bfd tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081048 Jun 20 07:35:38.687287 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1265/2408] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:38 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:39.429780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7fa2a996-0548-4ea6-9ffc-a4c28d835270 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:39.430384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7fa2a996-0548-4ea6-9ffc-a4c28d835270 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:39.436740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fa2a996-0548-4ea6-9ffc-a4c28d835270 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:39.437180 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fa2a996-0548-4ea6-9ffc-a4c28d835270 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:39.437921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fa2a996-0548-4ea6-9ffc-a4c28d835270 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:39.438382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7fa2a996-0548-4ea6-9ffc-a4c28d835270 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:39.568541 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7fa2a996-0548-4ea6-9ffc-a4c28d835270 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:39.576302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7fa2a996-0548-4ea6-9ffc-a4c28d835270 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151087 Jun 20 07:35:39.576881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1144/2409] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:39 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:39.703947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e3bd4273-86db-4dc9-9716-0e18c4ccd437 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:39.704566 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e3bd4273-86db-4dc9-9716-0e18c4ccd437 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:39.711047 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3bd4273-86db-4dc9-9716-0e18c4ccd437 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:39.711496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3bd4273-86db-4dc9-9716-0e18c4ccd437 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:39.712287 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3bd4273-86db-4dc9-9716-0e18c4ccd437 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:39.712856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e3bd4273-86db-4dc9-9716-0e18c4ccd437 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:39.773916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e3bd4273-86db-4dc9-9716-0e18c4ccd437 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:39.781612 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e3bd4273-86db-4dc9-9716-0e18c4ccd437 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081639 Jun 20 07:35:39.782168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1266/2410] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:39 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:40.593166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-99a2ea4d-929a-4496-9187-fff1dc530641 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:40.593778 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-99a2ea4d-929a-4496-9187-fff1dc530641 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:40.600188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99a2ea4d-929a-4496-9187-fff1dc530641 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:40.600655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99a2ea4d-929a-4496-9187-fff1dc530641 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:40.601419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99a2ea4d-929a-4496-9187-fff1dc530641 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:40.601849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99a2ea4d-929a-4496-9187-fff1dc530641 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:40.729194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99a2ea4d-929a-4496-9187-fff1dc530641 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:40.737482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-99a2ea4d-929a-4496-9187-fff1dc530641 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148103 Jun 20 07:35:40.738801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1145/2411] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:40 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:40.799059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-10547656-c538-464f-8e31-16a5522944e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:40.799677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-10547656-c538-464f-8e31-16a5522944e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:40.807294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10547656-c538-464f-8e31-16a5522944e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:40.807741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10547656-c538-464f-8e31-16a5522944e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:40.808524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10547656-c538-464f-8e31-16a5522944e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:40.808960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10547656-c538-464f-8e31-16a5522944e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:40.872694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-10547656-c538-464f-8e31-16a5522944e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:40.874892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:35:40.883199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-10547656-c538-464f-8e31-16a5522944e4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.088056 Jun 20 07:35:40.883958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1267/2412] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:40 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:41.755579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8c5b831b-3f74-4480-be0a-a48de4f0aa61 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:41.756222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8c5b831b-3f74-4480-be0a-a48de4f0aa61 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:41.762623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c5b831b-3f74-4480-be0a-a48de4f0aa61 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:41.763075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c5b831b-3f74-4480-be0a-a48de4f0aa61 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:41.763828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c5b831b-3f74-4480-be0a-a48de4f0aa61 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:41.764299 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8c5b831b-3f74-4480-be0a-a48de4f0aa61 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:41.888875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8c5b831b-3f74-4480-be0a-a48de4f0aa61 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:41.897408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8c5b831b-3f74-4480-be0a-a48de4f0aa61 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146488 Jun 20 07:35:41.897979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1146/2413] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:41.901063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7d20894a-7066-47ea-b7ff-74ca376d51fa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:41.901708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7d20894a-7066-47ea-b7ff-74ca376d51fa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:41.908133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d20894a-7066-47ea-b7ff-74ca376d51fa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:41.908615 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d20894a-7066-47ea-b7ff-74ca376d51fa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:41.909372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d20894a-7066-47ea-b7ff-74ca376d51fa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:41.909810 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d20894a-7066-47ea-b7ff-74ca376d51fa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:41.969476 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7d20894a-7066-47ea-b7ff-74ca376d51fa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:41.977433 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7d20894a-7066-47ea-b7ff-74ca376d51fa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080470 Jun 20 07:35:41.978002 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1268/2414] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:41 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:35:42.914841 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-af66d17f-4014-4291-a6a8-d38aefdd2e4c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:42.915447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-af66d17f-4014-4291-a6a8-d38aefdd2e4c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:42.922016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af66d17f-4014-4291-a6a8-d38aefdd2e4c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:42.922467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af66d17f-4014-4291-a6a8-d38aefdd2e4c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:42.923209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af66d17f-4014-4291-a6a8-d38aefdd2e4c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:42.923638 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af66d17f-4014-4291-a6a8-d38aefdd2e4c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:42.994063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5c05c93b-2577-4386-8c7d-c36cb02c297a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:42.994913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5c05c93b-2577-4386-8c7d-c36cb02c297a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:43.001465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c05c93b-2577-4386-8c7d-c36cb02c297a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:43.001947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c05c93b-2577-4386-8c7d-c36cb02c297a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:43.002928 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c05c93b-2577-4386-8c7d-c36cb02c297a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:43.003357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c05c93b-2577-4386-8c7d-c36cb02c297a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:43.072764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5c05c93b-2577-4386-8c7d-c36cb02c297a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:43.079759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-af66d17f-4014-4291-a6a8-d38aefdd2e4c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:43.080561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5c05c93b-2577-4386-8c7d-c36cb02c297a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.090281 Jun 20 07:35:43.081904 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1269/2415] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:42 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:35:43.088432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-af66d17f-4014-4291-a6a8-d38aefdd2e4c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.177387 Jun 20 07:35:43.088995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1147/2416] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:42 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:44.098233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8a34981c-14fc-488f-a03c-9c275091922b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:44.098840 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8a34981c-14fc-488f-a03c-9c275091922b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:44.105341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a34981c-14fc-488f-a03c-9c275091922b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:44.105732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7f450af-6053-48db-8dd5-cde6985cf4ec tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:44.106190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a34981c-14fc-488f-a03c-9c275091922b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:44.106357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7f450af-6053-48db-8dd5-cde6985cf4ec tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:44.106512 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a34981c-14fc-488f-a03c-9c275091922b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:44.106942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a34981c-14fc-488f-a03c-9c275091922b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:44.113353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7f450af-6053-48db-8dd5-cde6985cf4ec tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:44.113811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7f450af-6053-48db-8dd5-cde6985cf4ec tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:44.114576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7f450af-6053-48db-8dd5-cde6985cf4ec tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:44.115016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7f450af-6053-48db-8dd5-cde6985cf4ec tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:44.177263 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8a34981c-14fc-488f-a03c-9c275091922b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:44.185151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8a34981c-14fc-488f-a03c-9c275091922b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.091287 Jun 20 07:35:44.185708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1270/2417] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:44 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:44.257612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7f450af-6053-48db-8dd5-cde6985cf4ec tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:44.269987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7f450af-6053-48db-8dd5-cde6985cf4ec tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.168111 Jun 20 07:35:44.270554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1148/2418] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:35:45.202025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-87554340-0f96-4fd5-9033-763a5cad1d4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:45.202640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-87554340-0f96-4fd5-9033-763a5cad1d4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:45.209177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87554340-0f96-4fd5-9033-763a5cad1d4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:45.209618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87554340-0f96-4fd5-9033-763a5cad1d4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:45.210360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87554340-0f96-4fd5-9033-763a5cad1d4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:45.210783 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-87554340-0f96-4fd5-9033-763a5cad1d4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:45.273511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-87554340-0f96-4fd5-9033-763a5cad1d4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:45.281299 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-87554340-0f96-4fd5-9033-763a5cad1d4b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083183 Jun 20 07:35:45.281936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1271/2419] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:45 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:45.286948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ea4aa3d3-c888-41c8-90e0-c13ec6bdc480 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:45.287568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ea4aa3d3-c888-41c8-90e0-c13ec6bdc480 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:45.294057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea4aa3d3-c888-41c8-90e0-c13ec6bdc480 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:45.294511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea4aa3d3-c888-41c8-90e0-c13ec6bdc480 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:45.295265 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea4aa3d3-c888-41c8-90e0-c13ec6bdc480 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:45.295710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ea4aa3d3-c888-41c8-90e0-c13ec6bdc480 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:45.430457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ea4aa3d3-c888-41c8-90e0-c13ec6bdc480 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:45.438438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ea4aa3d3-c888-41c8-90e0-c13ec6bdc480 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.155485 Jun 20 07:35:45.439007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1149/2420] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:35:46.298146 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a1b10679-ba7a-4e15-b284-59f0d3a949fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:46.298745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a1b10679-ba7a-4e15-b284-59f0d3a949fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:46.305257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1b10679-ba7a-4e15-b284-59f0d3a949fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:46.305699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1b10679-ba7a-4e15-b284-59f0d3a949fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:46.306446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1b10679-ba7a-4e15-b284-59f0d3a949fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:46.306877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1b10679-ba7a-4e15-b284-59f0d3a949fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:46.369250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1b10679-ba7a-4e15-b284-59f0d3a949fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:46.378577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a1b10679-ba7a-4e15-b284-59f0d3a949fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083816 Jun 20 07:35:46.379425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1272/2421] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:46 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:46.454554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-908c5b73-ba73-4227-8871-7a494f251a89 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:46.455202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-908c5b73-ba73-4227-8871-7a494f251a89 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:46.462282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-908c5b73-ba73-4227-8871-7a494f251a89 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:46.462729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-908c5b73-ba73-4227-8871-7a494f251a89 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:46.463483 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-908c5b73-ba73-4227-8871-7a494f251a89 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:46.463916 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-908c5b73-ba73-4227-8871-7a494f251a89 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:46.592467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-908c5b73-ba73-4227-8871-7a494f251a89 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:46.600484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-908c5b73-ba73-4227-8871-7a494f251a89 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149670 Jun 20 07:35:46.601060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1150/2422] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:47.395295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b5defd58-e215-44c5-82c8-a5d3704e0e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:47.395919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b5defd58-e215-44c5-82c8-a5d3704e0e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:47.402374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5defd58-e215-44c5-82c8-a5d3704e0e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:47.402817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5defd58-e215-44c5-82c8-a5d3704e0e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:47.403559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5defd58-e215-44c5-82c8-a5d3704e0e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:47.403988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b5defd58-e215-44c5-82c8-a5d3704e0e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:47.463894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b5defd58-e215-44c5-82c8-a5d3704e0e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:47.471577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b5defd58-e215-44c5-82c8-a5d3704e0e20 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080665 Jun 20 07:35:47.472804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1273/2423] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:47 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:47.618786 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7f900108-db58-4a76-aec5-8d1f213d8244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:47.619392 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7f900108-db58-4a76-aec5-8d1f213d8244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:47.625821 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f900108-db58-4a76-aec5-8d1f213d8244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:47.626267 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f900108-db58-4a76-aec5-8d1f213d8244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:47.627018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f900108-db58-4a76-aec5-8d1f213d8244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:47.627713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f900108-db58-4a76-aec5-8d1f213d8244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:47.757792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7f900108-db58-4a76-aec5-8d1f213d8244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:47.765645 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7f900108-db58-4a76-aec5-8d1f213d8244 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150674 Jun 20 07:35:47.775600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1151/2424] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:47 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:48.489452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7fd6306f-d29f-4104-a240-fcef945872a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:48.490062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7fd6306f-d29f-4104-a240-fcef945872a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:48.496503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fd6306f-d29f-4104-a240-fcef945872a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:48.496949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fd6306f-d29f-4104-a240-fcef945872a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:48.497699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fd6306f-d29f-4104-a240-fcef945872a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:48.498133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fd6306f-d29f-4104-a240-fcef945872a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:48.560789 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7fd6306f-d29f-4104-a240-fcef945872a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:48.568629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7fd6306f-d29f-4104-a240-fcef945872a4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083686 Jun 20 07:35:48.569190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1274/2425] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:48 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:48.782642 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d13db0ea-375d-4402-a056-0a97eaea2e4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:48.783253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d13db0ea-375d-4402-a056-0a97eaea2e4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:48.786157 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:35:48.791309 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d13db0ea-375d-4402-a056-0a97eaea2e4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:48.791752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d13db0ea-375d-4402-a056-0a97eaea2e4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:48.792524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d13db0ea-375d-4402-a056-0a97eaea2e4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:48.792962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d13db0ea-375d-4402-a056-0a97eaea2e4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:48.916666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d13db0ea-375d-4402-a056-0a97eaea2e4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:48.918806 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:35:48.925558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d13db0ea-375d-4402-a056-0a97eaea2e4b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146761 Jun 20 07:35:48.926119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1152/2426] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:48 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:49.585257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-22ec449a-eef0-4eb4-90ed-5a13929907fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:49.585864 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-22ec449a-eef0-4eb4-90ed-5a13929907fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:49.592392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22ec449a-eef0-4eb4-90ed-5a13929907fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:49.592872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22ec449a-eef0-4eb4-90ed-5a13929907fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:49.593640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22ec449a-eef0-4eb4-90ed-5a13929907fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:49.594081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-22ec449a-eef0-4eb4-90ed-5a13929907fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:49.653869 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-22ec449a-eef0-4eb4-90ed-5a13929907fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:49.661662 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-22ec449a-eef0-4eb4-90ed-5a13929907fb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080241 Jun 20 07:35:49.662221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1275/2427] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:49 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:49.942086 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0067186-19dd-460b-b4bd-4ff99594b059 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:49.942618 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f0067186-19dd-460b-b4bd-4ff99594b059 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:49.948959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0067186-19dd-460b-b4bd-4ff99594b059 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:49.949440 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0067186-19dd-460b-b4bd-4ff99594b059 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:49.950202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0067186-19dd-460b-b4bd-4ff99594b059 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:49.950638 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0067186-19dd-460b-b4bd-4ff99594b059 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:50.079688 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f0067186-19dd-460b-b4bd-4ff99594b059 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:50.088419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f0067186-19dd-460b-b4bd-4ff99594b059 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150578 Jun 20 07:35:50.088990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1153/2428] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:50.679028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9802139a-56b4-4360-a0a3-6f05d864380f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:50.679642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9802139a-56b4-4360-a0a3-6f05d864380f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:50.686254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9802139a-56b4-4360-a0a3-6f05d864380f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:50.686705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9802139a-56b4-4360-a0a3-6f05d864380f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:50.687467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9802139a-56b4-4360-a0a3-6f05d864380f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:50.687907 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9802139a-56b4-4360-a0a3-6f05d864380f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:50.748031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9802139a-56b4-4360-a0a3-6f05d864380f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:50.756213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9802139a-56b4-4360-a0a3-6f05d864380f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081701 Jun 20 07:35:50.756775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1276/2429] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:50 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:51.104351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-23803b26-0fb9-4093-8d3c-3763b1c2d5cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:51.104991 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-23803b26-0fb9-4093-8d3c-3763b1c2d5cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:51.111484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23803b26-0fb9-4093-8d3c-3763b1c2d5cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:51.111932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23803b26-0fb9-4093-8d3c-3763b1c2d5cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:51.112714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23803b26-0fb9-4093-8d3c-3763b1c2d5cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:51.113158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23803b26-0fb9-4093-8d3c-3763b1c2d5cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:51.238026 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-23803b26-0fb9-4093-8d3c-3763b1c2d5cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:51.245828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-23803b26-0fb9-4093-8d3c-3763b1c2d5cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145383 Jun 20 07:35:51.246395 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1154/2430] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:51.773440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-70732427-7c4c-49fb-9011-d96d67e09ca6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:51.774056 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-70732427-7c4c-49fb-9011-d96d67e09ca6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:51.776400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:35:51.781868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70732427-7c4c-49fb-9011-d96d67e09ca6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:51.782323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70732427-7c4c-49fb-9011-d96d67e09ca6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:51.783077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70732427-7c4c-49fb-9011-d96d67e09ca6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:51.783508 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70732427-7c4c-49fb-9011-d96d67e09ca6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:51.847880 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-70732427-7c4c-49fb-9011-d96d67e09ca6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:51.855698 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-70732427-7c4c-49fb-9011-d96d67e09ca6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086773 Jun 20 07:35:51.856282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1277/2431] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:51 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:52.262939 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-87987e82-e604-4dee-b1c3-108d4969f9f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:52.263563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-87987e82-e604-4dee-b1c3-108d4969f9f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:52.270136 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87987e82-e604-4dee-b1c3-108d4969f9f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:52.270615 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87987e82-e604-4dee-b1c3-108d4969f9f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:52.271373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87987e82-e604-4dee-b1c3-108d4969f9f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:52.271815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87987e82-e604-4dee-b1c3-108d4969f9f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:52.396486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87987e82-e604-4dee-b1c3-108d4969f9f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:52.404364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-87987e82-e604-4dee-b1c3-108d4969f9f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145266 Jun 20 07:35:52.404932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1155/2432] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:52.873014 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-df7a5821-f7f7-4ea6-8069-94f9bba2ee97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:52.873560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-df7a5821-f7f7-4ea6-8069-94f9bba2ee97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:52.880739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df7a5821-f7f7-4ea6-8069-94f9bba2ee97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:52.881185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df7a5821-f7f7-4ea6-8069-94f9bba2ee97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:52.881923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df7a5821-f7f7-4ea6-8069-94f9bba2ee97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:52.882376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-df7a5821-f7f7-4ea6-8069-94f9bba2ee97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:52.942321 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-df7a5821-f7f7-4ea6-8069-94f9bba2ee97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:52.950100 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-df7a5821-f7f7-4ea6-8069-94f9bba2ee97 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080962 Jun 20 07:35:52.950650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1278/2433] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:52 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:53.421310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-15311869-12d8-4b15-9f5b-97a41e795950 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:53.421922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-15311869-12d8-4b15-9f5b-97a41e795950 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:53.428505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15311869-12d8-4b15-9f5b-97a41e795950 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:53.428952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15311869-12d8-4b15-9f5b-97a41e795950 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:53.429697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15311869-12d8-4b15-9f5b-97a41e795950 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:53.430130 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15311869-12d8-4b15-9f5b-97a41e795950 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:53.560239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-15311869-12d8-4b15-9f5b-97a41e795950 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:53.568030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-15311869-12d8-4b15-9f5b-97a41e795950 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150543 Jun 20 07:35:53.568684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1156/2434] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:53.967538 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1bc45ca3-07f7-485d-8155-0bb06b55e2cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:53.968094 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1bc45ca3-07f7-485d-8155-0bb06b55e2cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:53.974623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bc45ca3-07f7-485d-8155-0bb06b55e2cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:53.975077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bc45ca3-07f7-485d-8155-0bb06b55e2cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:53.975838 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bc45ca3-07f7-485d-8155-0bb06b55e2cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:53.976308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1bc45ca3-07f7-485d-8155-0bb06b55e2cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:54.041372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1bc45ca3-07f7-485d-8155-0bb06b55e2cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:54.049247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1bc45ca3-07f7-485d-8155-0bb06b55e2cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085649 Jun 20 07:35:54.050324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1279/2435] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:53 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:54.584933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-66d11e45-3b26-493c-8fe8-19dc8670e478 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:54.585553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-66d11e45-3b26-493c-8fe8-19dc8670e478 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:54.591990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66d11e45-3b26-493c-8fe8-19dc8670e478 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:54.592539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66d11e45-3b26-493c-8fe8-19dc8670e478 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:54.593295 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66d11e45-3b26-493c-8fe8-19dc8670e478 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:54.593730 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66d11e45-3b26-493c-8fe8-19dc8670e478 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:54.719831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-66d11e45-3b26-493c-8fe8-19dc8670e478 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:54.730198 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-66d11e45-3b26-493c-8fe8-19dc8670e478 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149048 Jun 20 07:35:54.730774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1157/2436] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:54 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:55.066610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1a79d738-8b9e-4a72-8a29-71170796a5dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:55.067225 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a79d738-8b9e-4a72-8a29-71170796a5dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:55.073732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a79d738-8b9e-4a72-8a29-71170796a5dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:55.074183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a79d738-8b9e-4a72-8a29-71170796a5dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:55.074941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a79d738-8b9e-4a72-8a29-71170796a5dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:55.075378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a79d738-8b9e-4a72-8a29-71170796a5dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:55.138284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1a79d738-8b9e-4a72-8a29-71170796a5dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:55.146891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1a79d738-8b9e-4a72-8a29-71170796a5dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084157 Jun 20 07:35:55.147455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1280/2437] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:55 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:55.747655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b509c305-272c-4d38-b985-794b67fa6861 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:55.748310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b509c305-272c-4d38-b985-794b67fa6861 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:55.755632 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b509c305-272c-4d38-b985-794b67fa6861 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:55.756079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b509c305-272c-4d38-b985-794b67fa6861 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:55.756860 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b509c305-272c-4d38-b985-794b67fa6861 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:55.757296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b509c305-272c-4d38-b985-794b67fa6861 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:55.880145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b509c305-272c-4d38-b985-794b67fa6861 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:55.887971 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b509c305-272c-4d38-b985-794b67fa6861 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144126 Jun 20 07:35:55.888574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1158/2438] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:55 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:56.164588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5b871de5-0494-4213-b1d1-b6cb6357ca08 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:56.165180 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5b871de5-0494-4213-b1d1-b6cb6357ca08 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:56.171705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b871de5-0494-4213-b1d1-b6cb6357ca08 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:56.172176 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b871de5-0494-4213-b1d1-b6cb6357ca08 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:56.172930 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b871de5-0494-4213-b1d1-b6cb6357ca08 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:56.173367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b871de5-0494-4213-b1d1-b6cb6357ca08 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:56.232910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5b871de5-0494-4213-b1d1-b6cb6357ca08 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:56.241363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5b871de5-0494-4213-b1d1-b6cb6357ca08 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080626 Jun 20 07:35:56.241918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1281/2439] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:56 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:56.430589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:35:56.430771 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:35:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:35:56.904871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7c4524d5-46ca-4a60-aec3-e4c9fdb94749 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:56.905506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7c4524d5-46ca-4a60-aec3-e4c9fdb94749 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:56.911941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c4524d5-46ca-4a60-aec3-e4c9fdb94749 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:56.912421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c4524d5-46ca-4a60-aec3-e4c9fdb94749 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:56.913216 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c4524d5-46ca-4a60-aec3-e4c9fdb94749 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:56.913655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7c4524d5-46ca-4a60-aec3-e4c9fdb94749 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:57.042578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7c4524d5-46ca-4a60-aec3-e4c9fdb94749 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:57.051268 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7c4524d5-46ca-4a60-aec3-e4c9fdb94749 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150307 Jun 20 07:35:57.051830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1159/2440] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:57.258981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c87f453d-26ac-408c-9ebc-00e3a7b4952a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:57.259502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c87f453d-26ac-408c-9ebc-00e3a7b4952a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:57.266017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c87f453d-26ac-408c-9ebc-00e3a7b4952a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:57.266470 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c87f453d-26ac-408c-9ebc-00e3a7b4952a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:57.267224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c87f453d-26ac-408c-9ebc-00e3a7b4952a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:57.267665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c87f453d-26ac-408c-9ebc-00e3a7b4952a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:57.328862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c87f453d-26ac-408c-9ebc-00e3a7b4952a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:57.336770 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c87f453d-26ac-408c-9ebc-00e3a7b4952a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081727 Jun 20 07:35:57.337347 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1282/2441] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:57 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:58.068206 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7d5b9529-8777-4773-95ab-6c87d5332832 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:58.068824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7d5b9529-8777-4773-95ab-6c87d5332832 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:58.076057 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d5b9529-8777-4773-95ab-6c87d5332832 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:58.076533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d5b9529-8777-4773-95ab-6c87d5332832 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:58.077296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d5b9529-8777-4773-95ab-6c87d5332832 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:58.077732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d5b9529-8777-4773-95ab-6c87d5332832 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:58.211013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d5b9529-8777-4773-95ab-6c87d5332832 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:58.219203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7d5b9529-8777-4773-95ab-6c87d5332832 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.154920 Jun 20 07:35:58.219777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1160/2442] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:58.353379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0da0bd84-4c0c-4c61-b899-e804c12026c1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:58.353986 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0da0bd84-4c0c-4c61-b899-e804c12026c1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:58.360456 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0da0bd84-4c0c-4c61-b899-e804c12026c1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:58.360906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0da0bd84-4c0c-4c61-b899-e804c12026c1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:58.361687 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0da0bd84-4c0c-4c61-b899-e804c12026c1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:58.362163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0da0bd84-4c0c-4c61-b899-e804c12026c1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:58.427174 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0da0bd84-4c0c-4c61-b899-e804c12026c1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:58.435173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0da0bd84-4c0c-4c61-b899-e804c12026c1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085648 Jun 20 07:35:58.435736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1283/2443] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:58 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:59.238932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b9a9303-b69e-4b1a-962d-a34bd18952b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:59.239533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b9a9303-b69e-4b1a-962d-a34bd18952b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:59.245938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b9a9303-b69e-4b1a-962d-a34bd18952b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:59.246377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b9a9303-b69e-4b1a-962d-a34bd18952b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:59.247118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b9a9303-b69e-4b1a-962d-a34bd18952b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:59.247548 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b9a9303-b69e-4b1a-962d-a34bd18952b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:59.372973 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b9a9303-b69e-4b1a-962d-a34bd18952b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:59.381119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b9a9303-b69e-4b1a-962d-a34bd18952b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146605 Jun 20 07:35:59.381678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1161/2444] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:35:59.452040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ced1b51e-b28f-4ccb-92b8-960a3c7de13c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:35:59.452671 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ced1b51e-b28f-4ccb-92b8-960a3c7de13c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:35:59.459482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ced1b51e-b28f-4ccb-92b8-960a3c7de13c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:59.459923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ced1b51e-b28f-4ccb-92b8-960a3c7de13c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:59.460693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ced1b51e-b28f-4ccb-92b8-960a3c7de13c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:35:59.461122 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ced1b51e-b28f-4ccb-92b8-960a3c7de13c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:35:59.475827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:35:59.520935 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ced1b51e-b28f-4ccb-92b8-960a3c7de13c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:35:59.528614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ced1b51e-b28f-4ccb-92b8-960a3c7de13c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080343 Jun 20 07:35:59.529165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1284/2445] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:35:59 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:00.398282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0ca5eb0-2b51-4242-99d0-ec890e0e468a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:00.398905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f0ca5eb0-2b51-4242-99d0-ec890e0e468a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:00.405863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0ca5eb0-2b51-4242-99d0-ec890e0e468a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:00.406633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0ca5eb0-2b51-4242-99d0-ec890e0e468a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:00.407392 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0ca5eb0-2b51-4242-99d0-ec890e0e468a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:00.407824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0ca5eb0-2b51-4242-99d0-ec890e0e468a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:00.545972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b628e1d3-78ba-4948-b86b-682b59774023 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:00.546581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b628e1d3-78ba-4948-b86b-682b59774023 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:00.552034 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f0ca5eb0-2b51-4242-99d0-ec890e0e468a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:00.553650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b628e1d3-78ba-4948-b86b-682b59774023 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:00.554103 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b628e1d3-78ba-4948-b86b-682b59774023 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:00.554860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b628e1d3-78ba-4948-b86b-682b59774023 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:00.555298 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b628e1d3-78ba-4948-b86b-682b59774023 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:00.560004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f0ca5eb0-2b51-4242-99d0-ec890e0e468a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.165761 Jun 20 07:36:00.560619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1162/2446] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:00 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:00.617330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b628e1d3-78ba-4948-b86b-682b59774023 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:00.625644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b628e1d3-78ba-4948-b86b-682b59774023 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083576 Jun 20 07:36:00.626200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1285/2447] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:00 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:01.577092 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bc2a86a5-3e23-4502-81cd-94e7c600593a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:01.577710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bc2a86a5-3e23-4502-81cd-94e7c600593a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:01.584413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc2a86a5-3e23-4502-81cd-94e7c600593a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:01.584914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc2a86a5-3e23-4502-81cd-94e7c600593a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:01.585707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc2a86a5-3e23-4502-81cd-94e7c600593a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:01.586148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc2a86a5-3e23-4502-81cd-94e7c600593a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:01.642747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c329d7e9-1ee6-476a-a180-22b6ca434d46 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:01.643380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c329d7e9-1ee6-476a-a180-22b6ca434d46 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:01.649808 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c329d7e9-1ee6-476a-a180-22b6ca434d46 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:01.650368 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c329d7e9-1ee6-476a-a180-22b6ca434d46 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:01.651022 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c329d7e9-1ee6-476a-a180-22b6ca434d46 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:01.651458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c329d7e9-1ee6-476a-a180-22b6ca434d46 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:01.718350 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c329d7e9-1ee6-476a-a180-22b6ca434d46 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:01.726658 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c329d7e9-1ee6-476a-a180-22b6ca434d46 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.087736 Jun 20 07:36:01.731812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1286/2448] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:01 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:01.741142 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bc2a86a5-3e23-4502-81cd-94e7c600593a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:01.749218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bc2a86a5-3e23-4502-81cd-94e7c600593a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.175999 Jun 20 07:36:01.749779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1163/2449] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:01 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:02.742817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5b5a7083-878a-4792-807e-94dcdc424c55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:02.743431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5b5a7083-878a-4792-807e-94dcdc424c55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:02.750032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b5a7083-878a-4792-807e-94dcdc424c55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:02.750486 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b5a7083-878a-4792-807e-94dcdc424c55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:02.751243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b5a7083-878a-4792-807e-94dcdc424c55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:02.751681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b5a7083-878a-4792-807e-94dcdc424c55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:02.766632 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5aa47419-ac23-4303-94a4-6d9527315e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:02.767249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5aa47419-ac23-4303-94a4-6d9527315e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:02.774683 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5aa47419-ac23-4303-94a4-6d9527315e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:02.775070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5aa47419-ac23-4303-94a4-6d9527315e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:02.775831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5aa47419-ac23-4303-94a4-6d9527315e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:02.776307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5aa47419-ac23-4303-94a4-6d9527315e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:02.818821 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5b5a7083-878a-4792-807e-94dcdc424c55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:02.826883 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5b5a7083-878a-4792-807e-94dcdc424c55 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.087932 Jun 20 07:36:02.827461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1287/2450] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:02 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:02.909922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5aa47419-ac23-4303-94a4-6d9527315e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:02.917775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5aa47419-ac23-4303-94a4-6d9527315e75 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.155005 Jun 20 07:36:02.918332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1164/2451] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:03.844160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-85ff79c3-766f-4c7b-910b-1af4c1230724 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:03.844776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-85ff79c3-766f-4c7b-910b-1af4c1230724 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:03.851821 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85ff79c3-766f-4c7b-910b-1af4c1230724 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:03.852307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85ff79c3-766f-4c7b-910b-1af4c1230724 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:03.853059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85ff79c3-766f-4c7b-910b-1af4c1230724 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:03.853527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-85ff79c3-766f-4c7b-910b-1af4c1230724 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:03.913593 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-85ff79c3-766f-4c7b-910b-1af4c1230724 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:03.921440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-85ff79c3-766f-4c7b-910b-1af4c1230724 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081146 Jun 20 07:36:03.922009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1288/2452] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:03 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:03.934526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-600abb71-6ca9-46f8-b668-06c0e3c28571 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:03.935149 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-600abb71-6ca9-46f8-b668-06c0e3c28571 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:03.941689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-600abb71-6ca9-46f8-b668-06c0e3c28571 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:03.942144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-600abb71-6ca9-46f8-b668-06c0e3c28571 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:03.942899 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-600abb71-6ca9-46f8-b668-06c0e3c28571 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:03.943339 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-600abb71-6ca9-46f8-b668-06c0e3c28571 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:04.070428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-600abb71-6ca9-46f8-b668-06c0e3c28571 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:04.078307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-600abb71-6ca9-46f8-b668-06c0e3c28571 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147549 Jun 20 07:36:04.078878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1165/2453] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:03 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:04.938621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-12ac03ef-bd13-468c-b25a-eb8607546297 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:04.939185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-12ac03ef-bd13-468c-b25a-eb8607546297 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:04.945200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12ac03ef-bd13-468c-b25a-eb8607546297 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:04.945648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12ac03ef-bd13-468c-b25a-eb8607546297 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:04.946396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12ac03ef-bd13-468c-b25a-eb8607546297 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:04.946828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-12ac03ef-bd13-468c-b25a-eb8607546297 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:05.005665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-12ac03ef-bd13-468c-b25a-eb8607546297 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:05.013472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-12ac03ef-bd13-468c-b25a-eb8607546297 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.078947 Jun 20 07:36:05.014043 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1289/2454] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:04 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:05.096877 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-baf19a0c-7d5b-44ca-a3fd-c8e52e34f9b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:05.097497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-baf19a0c-7d5b-44ca-a3fd-c8e52e34f9b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:05.104027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-baf19a0c-7d5b-44ca-a3fd-c8e52e34f9b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:05.104515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-baf19a0c-7d5b-44ca-a3fd-c8e52e34f9b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:05.105276 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-baf19a0c-7d5b-44ca-a3fd-c8e52e34f9b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:05.105716 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-baf19a0c-7d5b-44ca-a3fd-c8e52e34f9b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:05.232875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-baf19a0c-7d5b-44ca-a3fd-c8e52e34f9b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:05.241263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-baf19a0c-7d5b-44ca-a3fd-c8e52e34f9b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148793 Jun 20 07:36:05.241819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1166/2455] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:05 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:06.030191 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-75685d34-4f7e-4e55-85ba-b560e1879746 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:06.030847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-75685d34-4f7e-4e55-85ba-b560e1879746 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:06.037288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75685d34-4f7e-4e55-85ba-b560e1879746 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:06.037731 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75685d34-4f7e-4e55-85ba-b560e1879746 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:06.038478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75685d34-4f7e-4e55-85ba-b560e1879746 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:06.038916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75685d34-4f7e-4e55-85ba-b560e1879746 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:06.104012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-75685d34-4f7e-4e55-85ba-b560e1879746 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:06.112467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-75685d34-4f7e-4e55-85ba-b560e1879746 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085669 Jun 20 07:36:06.113034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1290/2456] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:06 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:06.258846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-96e64708-1a9f-4a37-bb9c-f52792cf721a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:06.259504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-96e64708-1a9f-4a37-bb9c-f52792cf721a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:06.265978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96e64708-1a9f-4a37-bb9c-f52792cf721a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:06.266428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96e64708-1a9f-4a37-bb9c-f52792cf721a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:06.267188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96e64708-1a9f-4a37-bb9c-f52792cf721a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:06.267626 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96e64708-1a9f-4a37-bb9c-f52792cf721a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:06.393553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-96e64708-1a9f-4a37-bb9c-f52792cf721a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:06.401523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-96e64708-1a9f-4a37-bb9c-f52792cf721a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146468 Jun 20 07:36:06.402124 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1167/2457] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:06 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:07.130097 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5d608037-e080-493a-b341-fb3ce1714596 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:07.130712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5d608037-e080-493a-b341-fb3ce1714596 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:07.137284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d608037-e080-493a-b341-fb3ce1714596 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:07.137736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d608037-e080-493a-b341-fb3ce1714596 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:07.138496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d608037-e080-493a-b341-fb3ce1714596 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:07.138930 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d608037-e080-493a-b341-fb3ce1714596 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:07.197608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5d608037-e080-493a-b341-fb3ce1714596 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:07.206062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5d608037-e080-493a-b341-fb3ce1714596 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079979 Jun 20 07:36:07.206635 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1291/2458] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:07 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:07.418736 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7daa8212-31a5-4800-bb02-193bbdcaed48 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:07.419263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7daa8212-31a5-4800-bb02-193bbdcaed48 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:07.426176 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7daa8212-31a5-4800-bb02-193bbdcaed48 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:07.426679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7daa8212-31a5-4800-bb02-193bbdcaed48 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:07.427448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7daa8212-31a5-4800-bb02-193bbdcaed48 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:07.427888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7daa8212-31a5-4800-bb02-193bbdcaed48 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:07.555877 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7daa8212-31a5-4800-bb02-193bbdcaed48 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:07.564538 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7daa8212-31a5-4800-bb02-193bbdcaed48 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149712 Jun 20 07:36:07.565752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1168/2459] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:07 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:08.223699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4b9d85de-3c9c-40a8-8d9d-d14bef1e3133 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:08.224340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4b9d85de-3c9c-40a8-8d9d-d14bef1e3133 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:08.230761 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b9d85de-3c9c-40a8-8d9d-d14bef1e3133 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:08.231215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b9d85de-3c9c-40a8-8d9d-d14bef1e3133 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:08.231976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b9d85de-3c9c-40a8-8d9d-d14bef1e3133 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:08.232447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4b9d85de-3c9c-40a8-8d9d-d14bef1e3133 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:08.292786 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4b9d85de-3c9c-40a8-8d9d-d14bef1e3133 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:08.300531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4b9d85de-3c9c-40a8-8d9d-d14bef1e3133 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081491 Jun 20 07:36:08.301093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1292/2460] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:08 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:08.582595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-45439650-7756-42e4-bcd3-8489155b89a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:08.583203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-45439650-7756-42e4-bcd3-8489155b89a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:08.589587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45439650-7756-42e4-bcd3-8489155b89a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:08.590045 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45439650-7756-42e4-bcd3-8489155b89a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:08.590775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45439650-7756-42e4-bcd3-8489155b89a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:08.591206 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45439650-7756-42e4-bcd3-8489155b89a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:08.606188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:08.717041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45439650-7756-42e4-bcd3-8489155b89a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:08.724824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-45439650-7756-42e4-bcd3-8489155b89a9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146603 Jun 20 07:36:08.725378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1169/2461] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:08 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:09.316950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-951a5899-851b-4ec2-bdb5-c2ef4a441367 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:09.317559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-951a5899-851b-4ec2-bdb5-c2ef4a441367 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:09.323941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-951a5899-851b-4ec2-bdb5-c2ef4a441367 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:09.324416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-951a5899-851b-4ec2-bdb5-c2ef4a441367 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:09.325161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-951a5899-851b-4ec2-bdb5-c2ef4a441367 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:09.325588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-951a5899-851b-4ec2-bdb5-c2ef4a441367 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:09.387891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-951a5899-851b-4ec2-bdb5-c2ef4a441367 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:09.395673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-951a5899-851b-4ec2-bdb5-c2ef4a441367 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083209 Jun 20 07:36:09.396251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1293/2462] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:09 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:09.742169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d0c3ae26-7f6e-44e7-90e2-de6b05c02c45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:09.742776 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d0c3ae26-7f6e-44e7-90e2-de6b05c02c45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:09.749212 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0c3ae26-7f6e-44e7-90e2-de6b05c02c45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:09.749654 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0c3ae26-7f6e-44e7-90e2-de6b05c02c45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:09.750400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0c3ae26-7f6e-44e7-90e2-de6b05c02c45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:09.750828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0c3ae26-7f6e-44e7-90e2-de6b05c02c45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:09.878627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d0c3ae26-7f6e-44e7-90e2-de6b05c02c45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:09.886592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d0c3ae26-7f6e-44e7-90e2-de6b05c02c45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148172 Jun 20 07:36:09.887156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1170/2463] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:09 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:10.412394 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b38b2e59-ab58-4695-9c10-b4936f4c2a82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:10.412960 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b38b2e59-ab58-4695-9c10-b4936f4c2a82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:10.419376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b38b2e59-ab58-4695-9c10-b4936f4c2a82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:10.419816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b38b2e59-ab58-4695-9c10-b4936f4c2a82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:10.420592 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b38b2e59-ab58-4695-9c10-b4936f4c2a82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:10.421020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b38b2e59-ab58-4695-9c10-b4936f4c2a82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:10.480198 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b38b2e59-ab58-4695-9c10-b4936f4c2a82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:10.487943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b38b2e59-ab58-4695-9c10-b4936f4c2a82 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.079461 Jun 20 07:36:10.488520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1294/2464] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:10 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:10.904069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6df8e604-692a-4c41-909f-5bf5ea7f9f24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:10.904744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6df8e604-692a-4c41-909f-5bf5ea7f9f24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:10.911838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6df8e604-692a-4c41-909f-5bf5ea7f9f24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:10.912341 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6df8e604-692a-4c41-909f-5bf5ea7f9f24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:10.913105 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6df8e604-692a-4c41-909f-5bf5ea7f9f24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:10.913569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6df8e604-692a-4c41-909f-5bf5ea7f9f24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:11.042929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6df8e604-692a-4c41-909f-5bf5ea7f9f24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:11.051376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6df8e604-692a-4c41-909f-5bf5ea7f9f24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151238 Jun 20 07:36:11.051940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1171/2465] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:10 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:11.504694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1a48edc0-e9f0-42d5-826f-344974f14044 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:11.505300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a48edc0-e9f0-42d5-826f-344974f14044 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:11.511692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a48edc0-e9f0-42d5-826f-344974f14044 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:11.512165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a48edc0-e9f0-42d5-826f-344974f14044 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:11.512916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a48edc0-e9f0-42d5-826f-344974f14044 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:11.513344 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a48edc0-e9f0-42d5-826f-344974f14044 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:11.573145 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1a48edc0-e9f0-42d5-826f-344974f14044 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:11.581378 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1a48edc0-e9f0-42d5-826f-344974f14044 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080909 Jun 20 07:36:11.581941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1295/2466] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:11 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:12.068933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7eedef9b-d488-45c6-a130-4c3c4af80fdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:12.069550 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7eedef9b-d488-45c6-a130-4c3c4af80fdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:12.076010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7eedef9b-d488-45c6-a130-4c3c4af80fdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:12.076504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7eedef9b-d488-45c6-a130-4c3c4af80fdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:12.077259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7eedef9b-d488-45c6-a130-4c3c4af80fdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:12.077697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7eedef9b-d488-45c6-a130-4c3c4af80fdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:12.201430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7eedef9b-d488-45c6-a130-4c3c4af80fdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:12.209255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7eedef9b-d488-45c6-a130-4c3c4af80fdc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144786 Jun 20 07:36:12.209819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1172/2467] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:12 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:12.602469 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eccfecbd-87f2-4827-a188-b36b1d102ffa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:12.603109 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eccfecbd-87f2-4827-a188-b36b1d102ffa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:12.609585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eccfecbd-87f2-4827-a188-b36b1d102ffa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:12.610028 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eccfecbd-87f2-4827-a188-b36b1d102ffa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:12.610775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eccfecbd-87f2-4827-a188-b36b1d102ffa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:12.611204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eccfecbd-87f2-4827-a188-b36b1d102ffa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:12.673278 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eccfecbd-87f2-4827-a188-b36b1d102ffa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:12.681720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eccfecbd-87f2-4827-a188-b36b1d102ffa tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083094 Jun 20 07:36:12.682275 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1296/2468] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:12 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:13.226124 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a595b41a-1955-40b1-b507-43ba6e00a53b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:13.226745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a595b41a-1955-40b1-b507-43ba6e00a53b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:13.233164 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a595b41a-1955-40b1-b507-43ba6e00a53b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:13.233618 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a595b41a-1955-40b1-b507-43ba6e00a53b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:13.234383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a595b41a-1955-40b1-b507-43ba6e00a53b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:13.234826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a595b41a-1955-40b1-b507-43ba6e00a53b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:13.587914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a595b41a-1955-40b1-b507-43ba6e00a53b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:13.595894 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a595b41a-1955-40b1-b507-43ba6e00a53b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.373606 Jun 20 07:36:13.596488 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1173/2469] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:13 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:13.697935 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bd08d438-f2bf-4298-9c11-202b4236c456 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:13.698549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bd08d438-f2bf-4298-9c11-202b4236c456 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:13.705177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd08d438-f2bf-4298-9c11-202b4236c456 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:13.705629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd08d438-f2bf-4298-9c11-202b4236c456 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:13.706398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd08d438-f2bf-4298-9c11-202b4236c456 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:13.706831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bd08d438-f2bf-4298-9c11-202b4236c456 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:13.768388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bd08d438-f2bf-4298-9c11-202b4236c456 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:13.776193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bd08d438-f2bf-4298-9c11-202b4236c456 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082062 Jun 20 07:36:13.776757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1297/2470] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:13 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:14.612755 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d2b531c2-4f8a-4c14-85c3-c39009003f6e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:14.613365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d2b531c2-4f8a-4c14-85c3-c39009003f6e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:14.619923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2b531c2-4f8a-4c14-85c3-c39009003f6e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:14.620399 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2b531c2-4f8a-4c14-85c3-c39009003f6e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:14.621158 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2b531c2-4f8a-4c14-85c3-c39009003f6e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:14.621592 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2b531c2-4f8a-4c14-85c3-c39009003f6e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:14.749171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d2b531c2-4f8a-4c14-85c3-c39009003f6e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:14.757901 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d2b531c2-4f8a-4c14-85c3-c39009003f6e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148997 Jun 20 07:36:14.758466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1174/2471] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:14 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:14.793196 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6c19e94f-6969-4cec-8e06-a9ca0fea799d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:14.793753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6c19e94f-6969-4cec-8e06-a9ca0fea799d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:14.800239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c19e94f-6969-4cec-8e06-a9ca0fea799d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:14.800690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c19e94f-6969-4cec-8e06-a9ca0fea799d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:14.801447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c19e94f-6969-4cec-8e06-a9ca0fea799d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:14.801887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6c19e94f-6969-4cec-8e06-a9ca0fea799d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:14.861833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6c19e94f-6969-4cec-8e06-a9ca0fea799d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:14.869729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6c19e94f-6969-4cec-8e06-a9ca0fea799d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080409 Jun 20 07:36:14.870296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1298/2472] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:14 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:15.774314 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4e880ca1-45e5-4389-a549-d8e017ca413e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:15.774925 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4e880ca1-45e5-4389-a549-d8e017ca413e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:15.781348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e880ca1-45e5-4389-a549-d8e017ca413e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:15.781791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e880ca1-45e5-4389-a549-d8e017ca413e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:15.782533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e880ca1-45e5-4389-a549-d8e017ca413e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:15.782962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e880ca1-45e5-4389-a549-d8e017ca413e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:15.887791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0d42b95d-0012-4798-a004-cf8891dacfb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:15.888417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0d42b95d-0012-4798-a004-cf8891dacfb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:15.895291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d42b95d-0012-4798-a004-cf8891dacfb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:15.895732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d42b95d-0012-4798-a004-cf8891dacfb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:15.896518 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d42b95d-0012-4798-a004-cf8891dacfb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:15.896944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0d42b95d-0012-4798-a004-cf8891dacfb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:15.912067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4e880ca1-45e5-4389-a549-d8e017ca413e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:15.920081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4e880ca1-45e5-4389-a549-d8e017ca413e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149641 Jun 20 07:36:15.929460 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1175/2473] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:15 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:15.959103 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0d42b95d-0012-4798-a004-cf8891dacfb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:15.966825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0d42b95d-0012-4798-a004-cf8891dacfb9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.082878 Jun 20 07:36:15.967384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1299/2474] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:15 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:16.937249 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-48a9073a-9a3f-4c65-8e17-bbbe310d3b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:16.937788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-48a9073a-9a3f-4c65-8e17-bbbe310d3b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:16.944327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48a9073a-9a3f-4c65-8e17-bbbe310d3b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:16.944784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48a9073a-9a3f-4c65-8e17-bbbe310d3b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:16.945540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48a9073a-9a3f-4c65-8e17-bbbe310d3b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:16.945983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48a9073a-9a3f-4c65-8e17-bbbe310d3b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:16.983831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e30f0bf-c501-4ac0-b720-fd809b291738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:16.984561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e30f0bf-c501-4ac0-b720-fd809b291738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:16.991781 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e30f0bf-c501-4ac0-b720-fd809b291738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:16.992511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e30f0bf-c501-4ac0-b720-fd809b291738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:16.993276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e30f0bf-c501-4ac0-b720-fd809b291738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:16.993711 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e30f0bf-c501-4ac0-b720-fd809b291738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:17.065286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6e30f0bf-c501-4ac0-b720-fd809b291738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:17.073163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e30f0bf-c501-4ac0-b720-fd809b291738 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.093117 Jun 20 07:36:17.073737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1300/2475] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:16 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:17.094642 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48a9073a-9a3f-4c65-8e17-bbbe310d3b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:17.104942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-48a9073a-9a3f-4c65-8e17-bbbe310d3b9f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.171690 Jun 20 07:36:17.105504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1176/2476] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:16 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:18.089867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9d3371ca-bf6c-4007-a163-2bea174bf62e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:18.090480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9d3371ca-bf6c-4007-a163-2bea174bf62e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:18.097065 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d3371ca-bf6c-4007-a163-2bea174bf62e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:18.097517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d3371ca-bf6c-4007-a163-2bea174bf62e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:18.098268 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d3371ca-bf6c-4007-a163-2bea174bf62e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:18.098701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9d3371ca-bf6c-4007-a163-2bea174bf62e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:18.101168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:18.121948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-49a83b2d-366a-4429-9e93-306a9d58f35f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:18.122565 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-49a83b2d-366a-4429-9e93-306a9d58f35f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:18.129532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49a83b2d-366a-4429-9e93-306a9d58f35f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:18.129987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49a83b2d-366a-4429-9e93-306a9d58f35f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:18.130752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49a83b2d-366a-4429-9e93-306a9d58f35f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:18.131194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49a83b2d-366a-4429-9e93-306a9d58f35f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:18.159610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9d3371ca-bf6c-4007-a163-2bea174bf62e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:18.167580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9d3371ca-bf6c-4007-a163-2bea174bf62e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081532 Jun 20 07:36:18.168168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1301/2477] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:18 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:18.258598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-49a83b2d-366a-4429-9e93-306a9d58f35f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:18.266467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-49a83b2d-366a-4429-9e93-306a9d58f35f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148338 Jun 20 07:36:18.267031 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1177/2478] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:18 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:19.184965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-da9e5d1e-d12e-4387-81ce-5c37cd995a9a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:19.185510 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-da9e5d1e-d12e-4387-81ce-5c37cd995a9a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:19.192583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da9e5d1e-d12e-4387-81ce-5c37cd995a9a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:19.193036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da9e5d1e-d12e-4387-81ce-5c37cd995a9a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:19.193805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da9e5d1e-d12e-4387-81ce-5c37cd995a9a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:19.194241 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da9e5d1e-d12e-4387-81ce-5c37cd995a9a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:19.254207 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-da9e5d1e-d12e-4387-81ce-5c37cd995a9a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:19.262046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-da9e5d1e-d12e-4387-81ce-5c37cd995a9a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081113 Jun 20 07:36:19.262607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1302/2479] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:19 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:19.282448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0ad7e301-457e-4499-a16a-5cba54da9aa2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:19.283060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0ad7e301-457e-4499-a16a-5cba54da9aa2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:19.285389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:19.290663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ad7e301-457e-4499-a16a-5cba54da9aa2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:19.291110 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ad7e301-457e-4499-a16a-5cba54da9aa2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:19.291864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ad7e301-457e-4499-a16a-5cba54da9aa2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:19.292343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ad7e301-457e-4499-a16a-5cba54da9aa2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:19.417093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0ad7e301-457e-4499-a16a-5cba54da9aa2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:19.425003 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0ad7e301-457e-4499-a16a-5cba54da9aa2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146338 Jun 20 07:36:19.425570 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1178/2480] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:19 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:20.278789 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-563511a1-ac9e-41cf-9123-d16b777b2bc3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:20.279380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-563511a1-ac9e-41cf-9123-d16b777b2bc3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:20.286465 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-563511a1-ac9e-41cf-9123-d16b777b2bc3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:20.286907 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-563511a1-ac9e-41cf-9123-d16b777b2bc3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:20.287649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-563511a1-ac9e-41cf-9123-d16b777b2bc3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:20.288077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-563511a1-ac9e-41cf-9123-d16b777b2bc3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:20.351833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-563511a1-ac9e-41cf-9123-d16b777b2bc3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:20.359597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-563511a1-ac9e-41cf-9123-d16b777b2bc3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084678 Jun 20 07:36:20.360165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1303/2481] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:20 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:20.441786 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2eeb1c96-7bef-48f5-ba2a-ee23109a79a4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:20.442424 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2eeb1c96-7bef-48f5-ba2a-ee23109a79a4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:20.449695 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eeb1c96-7bef-48f5-ba2a-ee23109a79a4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:20.450136 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eeb1c96-7bef-48f5-ba2a-ee23109a79a4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:20.450953 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eeb1c96-7bef-48f5-ba2a-ee23109a79a4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:20.451376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eeb1c96-7bef-48f5-ba2a-ee23109a79a4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:20.577261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2eeb1c96-7bef-48f5-ba2a-ee23109a79a4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:20.585766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2eeb1c96-7bef-48f5-ba2a-ee23109a79a4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147800 Jun 20 07:36:20.586336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1179/2482] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:20 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:21.376188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-63540ca8-2e98-42d1-a4bc-10d22679a99c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:21.377442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-63540ca8-2e98-42d1-a4bc-10d22679a99c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:21.383845 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63540ca8-2e98-42d1-a4bc-10d22679a99c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:21.384338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63540ca8-2e98-42d1-a4bc-10d22679a99c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:21.385125 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63540ca8-2e98-42d1-a4bc-10d22679a99c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:21.385564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63540ca8-2e98-42d1-a4bc-10d22679a99c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:21.450356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-63540ca8-2e98-42d1-a4bc-10d22679a99c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:21.458217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-63540ca8-2e98-42d1-a4bc-10d22679a99c tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.085921 Jun 20 07:36:21.458782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1304/2483] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:21 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:21.602515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8e8dc25-b0f6-44c3-9b92-7822a6d8d21c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:21.603081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8e8dc25-b0f6-44c3-9b92-7822a6d8d21c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:21.609561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8e8dc25-b0f6-44c3-9b92-7822a6d8d21c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:21.610004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8e8dc25-b0f6-44c3-9b92-7822a6d8d21c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:21.610750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8e8dc25-b0f6-44c3-9b92-7822a6d8d21c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:21.611788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8e8dc25-b0f6-44c3-9b92-7822a6d8d21c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:21.743016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8e8dc25-b0f6-44c3-9b92-7822a6d8d21c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:21.750942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8e8dc25-b0f6-44c3-9b92-7822a6d8d21c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152389 Jun 20 07:36:21.751503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1180/2484] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:21 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:22.474886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4326c8ac-f87d-437f-966c-be273ca2a292 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:22.475489 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4326c8ac-f87d-437f-966c-be273ca2a292 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:22.477793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=56 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:22.483490 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4326c8ac-f87d-437f-966c-be273ca2a292 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:22.483942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4326c8ac-f87d-437f-966c-be273ca2a292 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:22.484740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4326c8ac-f87d-437f-966c-be273ca2a292 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:22.485174 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4326c8ac-f87d-437f-966c-be273ca2a292 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:22.546541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4326c8ac-f87d-437f-966c-be273ca2a292 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:22.554967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4326c8ac-f87d-437f-966c-be273ca2a292 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083968 Jun 20 07:36:22.555529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1305/2485] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:22 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:22.768995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61af3995-ac8f-4180-8ddc-aa4e8b4c9d69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:22.769622 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61af3995-ac8f-4180-8ddc-aa4e8b4c9d69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:22.776078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61af3995-ac8f-4180-8ddc-aa4e8b4c9d69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:22.776557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61af3995-ac8f-4180-8ddc-aa4e8b4c9d69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:22.777320 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61af3995-ac8f-4180-8ddc-aa4e8b4c9d69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:22.777762 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61af3995-ac8f-4180-8ddc-aa4e8b4c9d69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:22.902634 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61af3995-ac8f-4180-8ddc-aa4e8b4c9d69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:22.912235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61af3995-ac8f-4180-8ddc-aa4e8b4c9d69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147449 Jun 20 07:36:22.912802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1181/2486] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:22 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:23.571632 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d6a2911b-86e6-45df-8a5a-01cfe7fc6c32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:23.572261 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d6a2911b-86e6-45df-8a5a-01cfe7fc6c32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:23.578655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6a2911b-86e6-45df-8a5a-01cfe7fc6c32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:23.579093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6a2911b-86e6-45df-8a5a-01cfe7fc6c32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:23.579833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6a2911b-86e6-45df-8a5a-01cfe7fc6c32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:23.580305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d6a2911b-86e6-45df-8a5a-01cfe7fc6c32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:23.647616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d6a2911b-86e6-45df-8a5a-01cfe7fc6c32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:23.655507 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d6a2911b-86e6-45df-8a5a-01cfe7fc6c32 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.087698 Jun 20 07:36:23.656063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1306/2487] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:23 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:23.929922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-129387f5-91a0-4872-9c54-1ca4158b1e0a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:23.930497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-129387f5-91a0-4872-9c54-1ca4158b1e0a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:23.937025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-129387f5-91a0-4872-9c54-1ca4158b1e0a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:23.937478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-129387f5-91a0-4872-9c54-1ca4158b1e0a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:23.938241 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-129387f5-91a0-4872-9c54-1ca4158b1e0a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:23.938693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-129387f5-91a0-4872-9c54-1ca4158b1e0a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:24.065843 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-129387f5-91a0-4872-9c54-1ca4158b1e0a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:24.073770 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-129387f5-91a0-4872-9c54-1ca4158b1e0a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147823 Jun 20 07:36:24.076319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1182/2488] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:23 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:24.672063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f878b74c-2424-49b1-b905-16bc49e048e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:24.672688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f878b74c-2424-49b1-b905-16bc49e048e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:24.679208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f878b74c-2424-49b1-b905-16bc49e048e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:24.679650 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f878b74c-2424-49b1-b905-16bc49e048e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:24.680420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f878b74c-2424-49b1-b905-16bc49e048e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:24.680851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f878b74c-2424-49b1-b905-16bc49e048e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:24.741483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f878b74c-2424-49b1-b905-16bc49e048e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:24.749428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f878b74c-2424-49b1-b905-16bc49e048e0 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081147 Jun 20 07:36:24.749998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1307/2489] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:24 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:25.090669 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bfd47040-9c2c-48fe-9023-34b7819dbaba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:25.091469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bfd47040-9c2c-48fe-9023-34b7819dbaba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:25.098009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfd47040-9c2c-48fe-9023-34b7819dbaba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:25.098453 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfd47040-9c2c-48fe-9023-34b7819dbaba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:25.099190 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfd47040-9c2c-48fe-9023-34b7819dbaba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:25.099619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bfd47040-9c2c-48fe-9023-34b7819dbaba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:25.232386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bfd47040-9c2c-48fe-9023-34b7819dbaba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:25.240817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bfd47040-9c2c-48fe-9023-34b7819dbaba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.153974 Jun 20 07:36:25.241381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1183/2490] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:25 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:25.766831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8e369d2a-953a-47ad-980d-2c3dddc1ca01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:25.767956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8e369d2a-953a-47ad-980d-2c3dddc1ca01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:25.774445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e369d2a-953a-47ad-980d-2c3dddc1ca01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:25.774897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e369d2a-953a-47ad-980d-2c3dddc1ca01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:25.775654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e369d2a-953a-47ad-980d-2c3dddc1ca01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:25.776093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8e369d2a-953a-47ad-980d-2c3dddc1ca01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:25.835834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8e369d2a-953a-47ad-980d-2c3dddc1ca01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:25.843865 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8e369d2a-953a-47ad-980d-2c3dddc1ca01 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080906 Jun 20 07:36:25.844473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1308/2491] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:25 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:26.258489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-06e3cda1-7790-4705-8ce9-fa7ce96008a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:26.259118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-06e3cda1-7790-4705-8ce9-fa7ce96008a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:26.265481 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06e3cda1-7790-4705-8ce9-fa7ce96008a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:26.265928 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06e3cda1-7790-4705-8ce9-fa7ce96008a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:26.266670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06e3cda1-7790-4705-8ce9-fa7ce96008a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:26.267099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06e3cda1-7790-4705-8ce9-fa7ce96008a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:26.393205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-06e3cda1-7790-4705-8ce9-fa7ce96008a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:26.401383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-06e3cda1-7790-4705-8ce9-fa7ce96008a7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146429 Jun 20 07:36:26.401944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1184/2492] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:26 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:26.861351 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2cfa19fe-3da7-43b0-a511-09f4c8ebbf89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:26.861876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2cfa19fe-3da7-43b0-a511-09f4c8ebbf89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:26.868328 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2cfa19fe-3da7-43b0-a511-09f4c8ebbf89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:26.868779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2cfa19fe-3da7-43b0-a511-09f4c8ebbf89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:26.869527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2cfa19fe-3da7-43b0-a511-09f4c8ebbf89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:26.869954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2cfa19fe-3da7-43b0-a511-09f4c8ebbf89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:26.932852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2cfa19fe-3da7-43b0-a511-09f4c8ebbf89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:26.941443 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2cfa19fe-3da7-43b0-a511-09f4c8ebbf89 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083877 Jun 20 07:36:26.942017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1309/2493] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:26 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:27.418442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8e4aeedd-7c6a-400f-a97e-6619c97f4fb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:27.419065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8e4aeedd-7c6a-400f-a97e-6619c97f4fb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:27.426015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e4aeedd-7c6a-400f-a97e-6619c97f4fb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:27.426465 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e4aeedd-7c6a-400f-a97e-6619c97f4fb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:27.427219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e4aeedd-7c6a-400f-a97e-6619c97f4fb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:27.427656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e4aeedd-7c6a-400f-a97e-6619c97f4fb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:27.629693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8e4aeedd-7c6a-400f-a97e-6619c97f4fb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:27.638923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8e4aeedd-7c6a-400f-a97e-6619c97f4fb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.224279 Jun 20 07:36:27.639506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1185/2494] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:27 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:27.958634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-872124f9-3e3b-40c8-bbff-d1e0407367e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:27.959251 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-872124f9-3e3b-40c8-bbff-d1e0407367e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:27.965667 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-872124f9-3e3b-40c8-bbff-d1e0407367e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:27.966149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-872124f9-3e3b-40c8-bbff-d1e0407367e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:27.966923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-872124f9-3e3b-40c8-bbff-d1e0407367e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:27.967376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-872124f9-3e3b-40c8-bbff-d1e0407367e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:28.029400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-872124f9-3e3b-40c8-bbff-d1e0407367e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:28.041154 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-872124f9-3e3b-40c8-bbff-d1e0407367e2 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.086462 Jun 20 07:36:28.041454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1310/2495] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:27 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:28.657191 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0f6ff5df-baa0-4913-ab6a-5727202b609f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:28.658446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0f6ff5df-baa0-4913-ab6a-5727202b609f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:28.667808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f6ff5df-baa0-4913-ab6a-5727202b609f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:28.668296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f6ff5df-baa0-4913-ab6a-5727202b609f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:28.669061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f6ff5df-baa0-4913-ab6a-5727202b609f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:28.669503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f6ff5df-baa0-4913-ab6a-5727202b609f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:28.672037 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:28.799803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0f6ff5df-baa0-4913-ab6a-5727202b609f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:28.807645 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0f6ff5df-baa0-4913-ab6a-5727202b609f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.154307 Jun 20 07:36:28.808228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1186/2496] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:28 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:29.057603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4d6d21d1-fdd5-415f-9da0-d1b7abee3da7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:29.058141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4d6d21d1-fdd5-415f-9da0-d1b7abee3da7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:29.065201 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d6d21d1-fdd5-415f-9da0-d1b7abee3da7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:29.065636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d6d21d1-fdd5-415f-9da0-d1b7abee3da7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:29.066393 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d6d21d1-fdd5-415f-9da0-d1b7abee3da7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:29.066830 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d6d21d1-fdd5-415f-9da0-d1b7abee3da7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:29.127257 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4d6d21d1-fdd5-415f-9da0-d1b7abee3da7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:29.135096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4d6d21d1-fdd5-415f-9da0-d1b7abee3da7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081420 Jun 20 07:36:29.135659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1311/2497] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:29 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:29.824529 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-359a4e22-c856-4cc1-b97f-b594e28afdf5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:29.825148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-359a4e22-c856-4cc1-b97f-b594e28afdf5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:29.832260 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-359a4e22-c856-4cc1-b97f-b594e28afdf5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:29.832713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-359a4e22-c856-4cc1-b97f-b594e28afdf5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:29.833467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-359a4e22-c856-4cc1-b97f-b594e28afdf5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:29.833909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-359a4e22-c856-4cc1-b97f-b594e28afdf5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:29.958245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-359a4e22-c856-4cc1-b97f-b594e28afdf5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:29.966289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-359a4e22-c856-4cc1-b97f-b594e28afdf5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145538 Jun 20 07:36:29.966799 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1187/2498] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:29 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:30.152576 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-65c8d3f8-23fa-4f7d-a2bd-9a2856a82099 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:30.153190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-65c8d3f8-23fa-4f7d-a2bd-9a2856a82099 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:30.159692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65c8d3f8-23fa-4f7d-a2bd-9a2856a82099 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:30.160178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65c8d3f8-23fa-4f7d-a2bd-9a2856a82099 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:30.160940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65c8d3f8-23fa-4f7d-a2bd-9a2856a82099 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:30.161380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-65c8d3f8-23fa-4f7d-a2bd-9a2856a82099 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:30.224432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-65c8d3f8-23fa-4f7d-a2bd-9a2856a82099 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:30.232271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-65c8d3f8-23fa-4f7d-a2bd-9a2856a82099 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083498 Jun 20 07:36:30.232832 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1312/2499] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:30 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:30.982893 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4840b221-b356-4125-93de-f8f169e289e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:30.983425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4840b221-b356-4125-93de-f8f169e289e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:30.990585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4840b221-b356-4125-93de-f8f169e289e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:30.991039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4840b221-b356-4125-93de-f8f169e289e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:30.991800 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4840b221-b356-4125-93de-f8f169e289e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:30.992271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4840b221-b356-4125-93de-f8f169e289e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:31.117102 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4840b221-b356-4125-93de-f8f169e289e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:31.125025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4840b221-b356-4125-93de-f8f169e289e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146057 Jun 20 07:36:31.125599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1188/2500] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:30 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:31.249410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ce20ef7-8eb5-460e-b04c-5cfdcb33fa45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:31.249962 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1ce20ef7-8eb5-460e-b04c-5cfdcb33fa45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:31.256633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ce20ef7-8eb5-460e-b04c-5cfdcb33fa45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:31.257084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ce20ef7-8eb5-460e-b04c-5cfdcb33fa45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:31.257851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ce20ef7-8eb5-460e-b04c-5cfdcb33fa45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:31.258289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ce20ef7-8eb5-460e-b04c-5cfdcb33fa45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:31.318584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ce20ef7-8eb5-460e-b04c-5cfdcb33fa45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:31.326484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ce20ef7-8eb5-460e-b04c-5cfdcb33fa45 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081074 Jun 20 07:36:31.327056 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1313/2501] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:31 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:32.142731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-676c5f1f-e320-48e8-a43d-69f233baa9e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:32.143353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-676c5f1f-e320-48e8-a43d-69f233baa9e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:32.149747 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-676c5f1f-e320-48e8-a43d-69f233baa9e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:32.150191 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-676c5f1f-e320-48e8-a43d-69f233baa9e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:32.150936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-676c5f1f-e320-48e8-a43d-69f233baa9e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:32.151366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-676c5f1f-e320-48e8-a43d-69f233baa9e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:32.278887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-676c5f1f-e320-48e8-a43d-69f233baa9e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:32.287368 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-676c5f1f-e320-48e8-a43d-69f233baa9e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148480 Jun 20 07:36:32.287923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1189/2502] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:32 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:32.342688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a3b7bbed-2a6c-4835-9b5f-244c3a19d3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:32.343306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a3b7bbed-2a6c-4835-9b5f-244c3a19d3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:32.350423 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3b7bbed-2a6c-4835-9b5f-244c3a19d3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:32.350877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3b7bbed-2a6c-4835-9b5f-244c3a19d3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:32.351633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3b7bbed-2a6c-4835-9b5f-244c3a19d3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:32.352071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a3b7bbed-2a6c-4835-9b5f-244c3a19d3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:32.412456 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a3b7bbed-2a6c-4835-9b5f-244c3a19d3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:32.420656 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a3b7bbed-2a6c-4835-9b5f-244c3a19d3c7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.081393 Jun 20 07:36:32.421229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1314/2503] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:32 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:33.304731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8576c983-6bcc-4ca8-aaf8-0b1817dade31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:33.305352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8576c983-6bcc-4ca8-aaf8-0b1817dade31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:33.311822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8576c983-6bcc-4ca8-aaf8-0b1817dade31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:33.312325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8576c983-6bcc-4ca8-aaf8-0b1817dade31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:33.313087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8576c983-6bcc-4ca8-aaf8-0b1817dade31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:33.313522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8576c983-6bcc-4ca8-aaf8-0b1817dade31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:33.437522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d5946b79-f659-441d-a766-e193de8732b7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:33.438236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d5946b79-f659-441d-a766-e193de8732b7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:33.441818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8576c983-6bcc-4ca8-aaf8-0b1817dade31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:33.445326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5946b79-f659-441d-a766-e193de8732b7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:33.445947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5946b79-f659-441d-a766-e193de8732b7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:33.446794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5946b79-f659-441d-a766-e193de8732b7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:33.447210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5946b79-f659-441d-a766-e193de8732b7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:33.449839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8576c983-6bcc-4ca8-aaf8-0b1817dade31 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149014 Jun 20 07:36:33.450670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1190/2504] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:33 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:33.510289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d5946b79-f659-441d-a766-e193de8732b7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:33.518144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d5946b79-f659-441d-a766-e193de8732b7 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.084477 Jun 20 07:36:33.518697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1315/2505] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:33 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:34.466746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-55ca235a-c043-478d-81e7-500995e65438 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:34.467290 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-55ca235a-c043-478d-81e7-500995e65438 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:34.473722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55ca235a-c043-478d-81e7-500995e65438 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:34.474163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55ca235a-c043-478d-81e7-500995e65438 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:34.474916 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55ca235a-c043-478d-81e7-500995e65438 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:34.475350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55ca235a-c043-478d-81e7-500995e65438 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:34.535380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1dbad4be-34e4-411f-b5f1-63373ea9402b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:34.535767 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1dbad4be-34e4-411f-b5f1-63373ea9402b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:34.541594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1dbad4be-34e4-411f-b5f1-63373ea9402b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:34.542045 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1dbad4be-34e4-411f-b5f1-63373ea9402b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:34.542813 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1dbad4be-34e4-411f-b5f1-63373ea9402b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:34.543250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1dbad4be-34e4-411f-b5f1-63373ea9402b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:34.614389 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1dbad4be-34e4-411f-b5f1-63373ea9402b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:34.622253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1dbad4be-34e4-411f-b5f1-63373ea9402b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.091412 Jun 20 07:36:34.622833 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1316/2506] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:34 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:34.629300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-55ca235a-c043-478d-81e7-500995e65438 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:34.637395 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-55ca235a-c043-478d-81e7-500995e65438 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.174564 Jun 20 07:36:34.637957 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1191/2507] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:35.639887 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fc34a741-38b6-45a5-9dd8-9be452b02cb5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:35.640521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fc34a741-38b6-45a5-9dd8-9be452b02cb5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:35.647609 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc34a741-38b6-45a5-9dd8-9be452b02cb5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:35.648062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc34a741-38b6-45a5-9dd8-9be452b02cb5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:35.648926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc34a741-38b6-45a5-9dd8-9be452b02cb5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:35.649388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fc34a741-38b6-45a5-9dd8-9be452b02cb5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:35.653281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-658ce23c-3843-4753-a11b-8f1905ee8ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:35.653900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-658ce23c-3843-4753-a11b-8f1905ee8ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:35.660578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-658ce23c-3843-4753-a11b-8f1905ee8ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:35.661354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-658ce23c-3843-4753-a11b-8f1905ee8ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:35.662123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-658ce23c-3843-4753-a11b-8f1905ee8ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:35.662564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-658ce23c-3843-4753-a11b-8f1905ee8ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:35.723169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fc34a741-38b6-45a5-9dd8-9be452b02cb5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:35.725549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:35.732688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fc34a741-38b6-45a5-9dd8-9be452b02cb5 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.096600 Jun 20 07:36:35.733270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1317/2508] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:35 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:35.820971 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-658ce23c-3843-4753-a11b-8f1905ee8ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:35.828904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-658ce23c-3843-4753-a11b-8f1905ee8ccb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.179415 Jun 20 07:36:35.830084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1192/2509] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:35 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:36.749775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f03afbce-974f-48f6-b114-a64457807fee tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:36.750390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f03afbce-974f-48f6-b114-a64457807fee tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:36.757041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f03afbce-974f-48f6-b114-a64457807fee tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:36.757485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f03afbce-974f-48f6-b114-a64457807fee tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:36.758234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f03afbce-974f-48f6-b114-a64457807fee tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:36.758671 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f03afbce-974f-48f6-b114-a64457807fee tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:36.818089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f03afbce-974f-48f6-b114-a64457807fee tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:36.825886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f03afbce-974f-48f6-b114-a64457807fee tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080340 Jun 20 07:36:36.826454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1318/2510] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:36 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:36.846873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4537f926-87ab-42e4-b62f-8b22f3009406 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:36.847491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4537f926-87ab-42e4-b62f-8b22f3009406 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:36.853914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4537f926-87ab-42e4-b62f-8b22f3009406 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:36.854365 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4537f926-87ab-42e4-b62f-8b22f3009406 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:36.855117 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4537f926-87ab-42e4-b62f-8b22f3009406 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:36.855556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4537f926-87ab-42e4-b62f-8b22f3009406 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:36.984728 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4537f926-87ab-42e4-b62f-8b22f3009406 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:36.992633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4537f926-87ab-42e4-b62f-8b22f3009406 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150152 Jun 20 07:36:36.993185 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1193/2511] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:36 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:37.843038 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4d36108a-21fd-4816-9f2e-7848eb7e006d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:37.843645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4d36108a-21fd-4816-9f2e-7848eb7e006d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:37.850133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d36108a-21fd-4816-9f2e-7848eb7e006d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:37.850574 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d36108a-21fd-4816-9f2e-7848eb7e006d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:37.851320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d36108a-21fd-4816-9f2e-7848eb7e006d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:37.851746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4d36108a-21fd-4816-9f2e-7848eb7e006d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:37.912215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4d36108a-21fd-4816-9f2e-7848eb7e006d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:37.919884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4d36108a-21fd-4816-9f2e-7848eb7e006d tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.080668 Jun 20 07:36:37.920468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1319/2512] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:37 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:38.008979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0bc7eeb1-be20-4515-a2c4-5dc5e17259b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:38.009529 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0bc7eeb1-be20-4515-a2c4-5dc5e17259b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:38.015946 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bc7eeb1-be20-4515-a2c4-5dc5e17259b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:38.016500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bc7eeb1-be20-4515-a2c4-5dc5e17259b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:38.017255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bc7eeb1-be20-4515-a2c4-5dc5e17259b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:38.017692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bc7eeb1-be20-4515-a2c4-5dc5e17259b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:38.141819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0bc7eeb1-be20-4515-a2c4-5dc5e17259b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:38.149676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0bc7eeb1-be20-4515-a2c4-5dc5e17259b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144585 Jun 20 07:36:38.150235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1194/2513] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:38 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:38.937155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6225ae89-6a56-4f2c-8d8f-2ac3689aace8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:38.937697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6225ae89-6a56-4f2c-8d8f-2ac3689aace8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:38.944715 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6225ae89-6a56-4f2c-8d8f-2ac3689aace8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:38.945154 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6225ae89-6a56-4f2c-8d8f-2ac3689aace8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:38.945896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6225ae89-6a56-4f2c-8d8f-2ac3689aace8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:38.946321 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6225ae89-6a56-4f2c-8d8f-2ac3689aace8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:39.008971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6225ae89-6a56-4f2c-8d8f-2ac3689aace8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:39.017430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6225ae89-6a56-4f2c-8d8f-2ac3689aace8 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1368 microversion: 2.1 time: 0.083557 Jun 20 07:36:39.018015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1320/2514] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:38 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:39.033942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db884cac-22ec-40c3-8021-8bd33169610a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '.version_select at 0x7ffa1fae0ee0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:39.051758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db884cac-22ec-40c3-8021-8bd33169610a tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-249288607" status: 202 len: 0 microversion: 2.1 time: 0.021570 Jun 20 07:36:39.052328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1195/2515] 10.222.0.23 () {58 vars in 1217 bytes} [Mon Jun 20 07:36:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-249288607 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:36:39.166670 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fda26a58-36b0-4460-af03-79a788956127 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:39.167284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fda26a58-36b0-4460-af03-79a788956127 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:39.174133 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda26a58-36b0-4460-af03-79a788956127 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:39.174585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda26a58-36b0-4460-af03-79a788956127 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:39.175341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda26a58-36b0-4460-af03-79a788956127 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:39.175771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fda26a58-36b0-4460-af03-79a788956127 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:39.316630 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fda26a58-36b0-4460-af03-79a788956127 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:39.324619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fda26a58-36b0-4460-af03-79a788956127 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.161764 Jun 20 07:36:39.325173 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1321/2516] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:39 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:39.851769 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-21885db5-7d1f-4ff4-baee-3846db423fd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Action: 'create', calling method: .version_select at 0x7ffa1fb7d5e0>, body: {"keypair": {"name": "tempest-keypair-268247677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDciNvaXz/WX1+/usq9xVOJF21C1TD8IgM08qKnnshY0kvDta2SR/F19Gsdhw1/nav6aeGVYlhLR93BO7uYmJ25chfEMNf4N+y4xqbWRFuwJWbVCfqM27plMAkQoZojL0Q=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:36:39.866244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-21885db5-7d1f-4ff4-baee-3846db423fd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Getting quotas for project 0e19a3f933284f088747a9d623e9ec24. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:36:39.870512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-21885db5-7d1f-4ff4-baee-3846db423fd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Getting quotas for user 785140aa617e46608e8b3cf89aac5a44 and project 0e19a3f933284f088747a9d623e9ec24. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:36:39.892790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-21885db5-7d1f-4ff4-baee-3846db423fd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045003 Jun 20 07:36:39.893385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1196/2517] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 07:36:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:36:40.342145 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-60aa598b-8696-46c4-92c1-e0bda7e95ee4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:40.342776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-60aa598b-8696-46c4-92c1-e0bda7e95ee4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:40.349246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60aa598b-8696-46c4-92c1-e0bda7e95ee4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:40.349690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60aa598b-8696-46c4-92c1-e0bda7e95ee4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:40.350442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60aa598b-8696-46c4-92c1-e0bda7e95ee4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:40.350876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-60aa598b-8696-46c4-92c1-e0bda7e95ee4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:40.500985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-60aa598b-8696-46c4-92c1-e0bda7e95ee4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:40.515427 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-60aa598b-8696-46c4-92c1-e0bda7e95ee4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.176908 Jun 20 07:36:40.516503 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1322/2518] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:40 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:41.118602 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1416597051", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69e9f1e9-dc5c-4bf7-bef0-e92bd1c5f965"}], "security_groups": [{"name": "tempest-securitygroup--627447065"}], "key_name": "tempest-keypair-268247677", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:36:41.223345 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] validate_networks() for [('69e9f1e9-dc5c-4bf7-bef0-e92bd1c5f965', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:36:41.539018 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-481e57d9-9d54-44c3-a7ce-3b2369fbae42 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:41.539726 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-481e57d9-9d54-44c3-a7ce-3b2369fbae42 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:41.546188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-481e57d9-9d54-44c3-a7ce-3b2369fbae42 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:41.546633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-481e57d9-9d54-44c3-a7ce-3b2369fbae42 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:41.547398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-481e57d9-9d54-44c3-a7ce-3b2369fbae42 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:41.547868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-481e57d9-9d54-44c3-a7ce-3b2369fbae42 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:41.669994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:36:41.670501 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:36:41.671060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:36:41.671547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:36:41.672056 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:36:41.681653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:41.682196 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:41.683064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:41.683512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:41.701394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Getting quotas for project 0e19a3f933284f088747a9d623e9ec24. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:36:41.706516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Getting quotas for user 785140aa617e46608e8b3cf89aac5a44 and project 0e19a3f933284f088747a9d623e9ec24. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:36:41.716758 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-481e57d9-9d54-44c3-a7ce-3b2369fbae42 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:41.718245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:36:41.720770 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:36:41.726485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-481e57d9-9d54-44c3-a7ce-3b2369fbae42 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.191239 Jun 20 07:36:41.727782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1323/2519] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:41.778010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7fcbce1-5574-4abf-89ee-4bca0e1b6c10 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.664100 Jun 20 07:36:41.778655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1197/2520] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:36:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:36:41.788415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-88ee3bf1-c919-4973-9cd9-4144b7473fd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:41.789021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-88ee3bf1-c919-4973-9cd9-4144b7473fd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:41.840799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-88ee3bf1-c919-4973-9cd9-4144b7473fd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:41.847424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-88ee3bf1-c919-4973-9cd9-4144b7473fd4 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1237 microversion: 2.1 time: 0.062702 Jun 20 07:36:41.847990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1324/2521] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:41 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1237 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:42.289961 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-326b2221-cb60-4c2f-b898-6a9f2de74b77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:42.291339 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-326b2221-cb60-4c2f-b898-6a9f2de74b77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:42.300040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-326b2221-cb60-4c2f-b898-6a9f2de74b77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:42.301777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-326b2221-cb60-4c2f-b898-6a9f2de74b77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:42.303224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-326b2221-cb60-4c2f-b898-6a9f2de74b77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:42.303842 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-326b2221-cb60-4c2f-b898-6a9f2de74b77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:42.320204 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-326b2221-cb60-4c2f-b898-6a9f2de74b77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-326b2221-cb60-4c2f-b898-6a9f2de74b77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 HTTP/1.1 Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:36:42.321782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:36:42.323662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:36:42.323662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:36:42.323662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:36:42.323662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:36:42.323662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:36:42.323662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:36:42.323662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:36:42.323662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:36:42.323662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:36:42.323662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:36:42.323662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:36:42.323662 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '62ffe5f4-e1f6-4e33-9318-4ae736a72266'} Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:36:42.324611 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:36:42.326192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:36:42.327806 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-326b2221-cb60-4c2f-b898-6a9f2de74b77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:36:42.327806 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-326b2221-cb60-4c2f-b898-6a9f2de74b77 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 404 len: 111 microversion: 2.1 time: 0.037515 Jun 20 07:36:42.327806 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1198/2522] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:36:42 2022] DELETE /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:36:42.333247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa060fdb-949b-484e-828b-c3159892a3e4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:42.333869 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aa060fdb-949b-484e-828b-c3159892a3e4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 62ffe5f4-e1f6-4e33-9318-4ae736a72266] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:42.342200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa060fdb-949b-484e-828b-c3159892a3e4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:42.342479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa060fdb-949b-484e-828b-c3159892a3e4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:42.343247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa060fdb-949b-484e-828b-c3159892a3e4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:42.343684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa060fdb-949b-484e-828b-c3159892a3e4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:42.362050 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-aa060fdb-949b-484e-828b-c3159892a3e4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa060fdb-949b-484e-828b-c3159892a3e4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 HTTP/1.1 Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:36:42.364460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:36:42.366288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:36:42.366288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:36:42.366288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:36:42.366288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:36:42.366288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:36:42.366288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:36:42.366288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:36:42.366288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:36:42.366288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:36:42.366288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:36:42.366288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:36:42.366288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '62ffe5f4-e1f6-4e33-9318-4ae736a72266'} Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:36:42.367308 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. Jun 20 07:36:42.368980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:36:42.370491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa060fdb-949b-484e-828b-c3159892a3e4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 62ffe5f4-e1f6-4e33-9318-4ae736a72266 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:36:42.370491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aa060fdb-949b-484e-828b-c3159892a3e4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266" status: 404 len: 111 microversion: 2.1 time: 0.038041 Jun 20 07:36:42.370491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1325/2523] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:42 2022] GET /compute/v2.1/servers/62ffe5f4-e1f6-4e33-9318-4ae736a72266 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:36:42.744386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-323bda4c-a401-42cc-9767-d873264ff042 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:42.745023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-323bda4c-a401-42cc-9767-d873264ff042 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:42.761597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-323bda4c-a401-42cc-9767-d873264ff042 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:42.762048 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-323bda4c-a401-42cc-9767-d873264ff042 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:42.763013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-323bda4c-a401-42cc-9767-d873264ff042 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:42.763257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-323bda4c-a401-42cc-9767-d873264ff042 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:42.864264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0390e627-ae0d-4168-ace1-53ed1bec9cd1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:42.864881 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0390e627-ae0d-4168-ace1-53ed1bec9cd1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:42.871031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0390e627-ae0d-4168-ace1-53ed1bec9cd1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:42.871481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0390e627-ae0d-4168-ace1-53ed1bec9cd1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:42.872633 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0390e627-ae0d-4168-ace1-53ed1bec9cd1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:42.872788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0390e627-ae0d-4168-ace1-53ed1bec9cd1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:42.963495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0390e627-ae0d-4168-ace1-53ed1bec9cd1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:42.971974 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-323bda4c-a401-42cc-9767-d873264ff042 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:42.972623 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0390e627-ae0d-4168-ace1-53ed1bec9cd1 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1295 microversion: 2.1 time: 0.112207 Jun 20 07:36:42.982171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1326/2524] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:42 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1295 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:42.982364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-323bda4c-a401-42cc-9767-d873264ff042 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.239633 Jun 20 07:36:42.982364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1199/2525] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:42 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:43.989971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fb55869f-eec6-44f4-b66e-fd0167f52fe6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:43.996152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-249c0ff2-3965-42ac-9f98-f523d66c33d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:43.996774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-249c0ff2-3965-42ac-9f98-f523d66c33d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:44.000292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fb55869f-eec6-44f4-b66e-fd0167f52fe6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:44.009118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-249c0ff2-3965-42ac-9f98-f523d66c33d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:44.009564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-249c0ff2-3965-42ac-9f98-f523d66c33d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:44.010327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-249c0ff2-3965-42ac-9f98-f523d66c33d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:44.011990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-249c0ff2-3965-42ac-9f98-f523d66c33d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:44.016931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb55869f-eec6-44f4-b66e-fd0167f52fe6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:44.017376 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb55869f-eec6-44f4-b66e-fd0167f52fe6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:44.018144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb55869f-eec6-44f4-b66e-fd0167f52fe6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:44.018570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb55869f-eec6-44f4-b66e-fd0167f52fe6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:44.565030 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fb55869f-eec6-44f4-b66e-fd0167f52fe6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:44.572059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-249c0ff2-3965-42ac-9f98-f523d66c33d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:44.573429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fb55869f-eec6-44f4-b66e-fd0167f52fe6 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1362 microversion: 2.1 time: 0.587802 Jun 20 07:36:44.577952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1327/2526] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:43 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1362 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:44.582182 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-249c0ff2-3965-42ac-9f98-f523d66c33d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.590106 Jun 20 07:36:44.593530 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1200/2527] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:43 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:44.642634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-81b0405e-d208-48d7-b463-1571e8048e45 req-8f960e18-a6c2-44ab-82a5-eceaebb38e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8797f201-711b-4299-8eaa-bb430cec1210", "tag": "aed4fc54-d1a7-4f65-a4b3-8276ee7d8e1e"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:36:44.650631 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-81b0405e-d208-48d7-b463-1571e8048e45 req-8f960e18-a6c2-44ab-82a5-eceaebb38e2b service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:44.651077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-81b0405e-d208-48d7-b463-1571e8048e45 req-8f960e18-a6c2-44ab-82a5-eceaebb38e2b service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:44.661493 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-81b0405e-d208-48d7-b463-1571e8048e45 req-8f960e18-a6c2-44ab-82a5-eceaebb38e2b service nova] Creating event network-changed:aed4fc54-d1a7-4f65-a4b3-8276ee7d8e1e for instance 8797f201-711b-4299-8eaa-bb430cec1210 on hv-cinder-77819 Jun 20 07:36:44.666705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-81b0405e-d208-48d7-b463-1571e8048e45 req-8f960e18-a6c2-44ab-82a5-eceaebb38e2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086346 Jun 20 07:36:44.667302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1328/2528] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:36:45.589560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-92ec55d0-8084-475a-b852-4cf740de693e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:45.590176 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-92ec55d0-8084-475a-b852-4cf740de693e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:45.597349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92ec55d0-8084-475a-b852-4cf740de693e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:45.597792 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92ec55d0-8084-475a-b852-4cf740de693e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:45.598546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92ec55d0-8084-475a-b852-4cf740de693e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:45.598980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92ec55d0-8084-475a-b852-4cf740de693e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:45.599841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d5734784-b297-4191-9400-577fa141583d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:45.600571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d5734784-b297-4191-9400-577fa141583d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:45.606713 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5734784-b297-4191-9400-577fa141583d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:45.607170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5734784-b297-4191-9400-577fa141583d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:45.607934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5734784-b297-4191-9400-577fa141583d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:45.608403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5734784-b297-4191-9400-577fa141583d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:45.863036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d5734784-b297-4191-9400-577fa141583d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:45.871248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d5734784-b297-4191-9400-577fa141583d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.276419 Jun 20 07:36:45.871819 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1329/2529] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:45.879353 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-92ec55d0-8084-475a-b852-4cf740de693e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:45.886838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-92ec55d0-8084-475a-b852-4cf740de693e tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1362 microversion: 2.1 time: 0.301135 Jun 20 07:36:45.887404 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1201/2530] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:45 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:46.889182 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-613323a8-091c-446c-991b-8066882ea083 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:46.889762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-613323a8-091c-446c-991b-8066882ea083 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:46.895665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-613323a8-091c-446c-991b-8066882ea083 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:46.896129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-613323a8-091c-446c-991b-8066882ea083 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:46.896895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-613323a8-091c-446c-991b-8066882ea083 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:46.897326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-613323a8-091c-446c-991b-8066882ea083 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:46.903756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d58dd5c-ffbb-429a-bfd2-700b817e90ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:46.904403 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1d58dd5c-ffbb-429a-bfd2-700b817e90ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:46.911361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d58dd5c-ffbb-429a-bfd2-700b817e90ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:46.911819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d58dd5c-ffbb-429a-bfd2-700b817e90ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:46.912619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d58dd5c-ffbb-429a-bfd2-700b817e90ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:46.913059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d58dd5c-ffbb-429a-bfd2-700b817e90ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:47.096360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-613323a8-091c-446c-991b-8066882ea083 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:47.099427 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1d58dd5c-ffbb-429a-bfd2-700b817e90ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:47.105000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-613323a8-091c-446c-991b-8066882ea083 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.220181 Jun 20 07:36:47.105568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1330/2531] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:47.106845 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1d58dd5c-ffbb-429a-bfd2-700b817e90ba tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1362 microversion: 2.1 time: 0.206857 Jun 20 07:36:47.107440 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1202/2532] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:46 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:48.122732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8900fb89-ac1f-4600-b3a1-348285b4395c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:48.123347 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8900fb89-ac1f-4600-b3a1-348285b4395c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:48.123699 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1a9f939d-3866-46e3-bda7-90c092bd0965 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:48.124343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1a9f939d-3866-46e3-bda7-90c092bd0965 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:48.130872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8900fb89-ac1f-4600-b3a1-348285b4395c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:48.131319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8900fb89-ac1f-4600-b3a1-348285b4395c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:48.131511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a9f939d-3866-46e3-bda7-90c092bd0965 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:48.131954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a9f939d-3866-46e3-bda7-90c092bd0965 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:48.132075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8900fb89-ac1f-4600-b3a1-348285b4395c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:48.132556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8900fb89-ac1f-4600-b3a1-348285b4395c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:48.132748 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a9f939d-3866-46e3-bda7-90c092bd0965 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:48.133179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a9f939d-3866-46e3-bda7-90c092bd0965 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:48.323807 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a9f939d-3866-46e3-bda7-90c092bd0965 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:48.327567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8900fb89-ac1f-4600-b3a1-348285b4395c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:48.331325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1a9f939d-3866-46e3-bda7-90c092bd0965 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1362 microversion: 2.1 time: 0.211393 Jun 20 07:36:48.331893 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1203/2533] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:48 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:48.335513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8900fb89-ac1f-4600-b3a1-348285b4395c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.216626 Jun 20 07:36:48.336074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1331/2534] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:48 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:49.348281 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d52dbc90-f09f-434a-b6d2-e2ed65565c59 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:49.348938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d52dbc90-f09f-434a-b6d2-e2ed65565c59 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:49.351193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:49.352078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6fc9f9ac-a64c-464d-96d4-fa1824a4bb7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:49.352693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6fc9f9ac-a64c-464d-96d4-fa1824a4bb7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:49.356845 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d52dbc90-f09f-434a-b6d2-e2ed65565c59 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:49.357302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d52dbc90-f09f-434a-b6d2-e2ed65565c59 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:49.358076 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d52dbc90-f09f-434a-b6d2-e2ed65565c59 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:49.358517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d52dbc90-f09f-434a-b6d2-e2ed65565c59 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:49.359063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6fc9f9ac-a64c-464d-96d4-fa1824a4bb7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:49.359608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6fc9f9ac-a64c-464d-96d4-fa1824a4bb7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:49.360371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6fc9f9ac-a64c-464d-96d4-fa1824a4bb7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:49.360808 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6fc9f9ac-a64c-464d-96d4-fa1824a4bb7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:49.559703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d52dbc90-f09f-434a-b6d2-e2ed65565c59 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:49.563007 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6fc9f9ac-a64c-464d-96d4-fa1824a4bb7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:49.567884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d52dbc90-f09f-434a-b6d2-e2ed65565c59 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1362 microversion: 2.1 time: 0.223510 Jun 20 07:36:49.568500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1204/2535] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:49 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:49.571750 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6fc9f9ac-a64c-464d-96d4-fa1824a4bb7e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.223474 Jun 20 07:36:49.572425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1332/2536] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:50.583895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-5b93c644-10b7-45aa-b11f-e7736acccf45 req-4ade03dd-2d25-4841-ac52-83cd1f154d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8797f201-711b-4299-8eaa-bb430cec1210", "name": "network-vif-plugged", "status": "completed", "tag": "aed4fc54-d1a7-4f65-a4b3-8276ee7d8e1e"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:36:50.584985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-10dfef8a-260c-4d58-bd96-95fe85e65bcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:50.585607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-10dfef8a-260c-4d58-bd96-95fe85e65bcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:50.592188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10dfef8a-260c-4d58-bd96-95fe85e65bcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:50.592644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10dfef8a-260c-4d58-bd96-95fe85e65bcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:50.593414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10dfef8a-260c-4d58-bd96-95fe85e65bcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:50.593847 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-10dfef8a-260c-4d58-bd96-95fe85e65bcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:50.594126 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-5b93c644-10b7-45aa-b11f-e7736acccf45 req-4ade03dd-2d25-4841-ac52-83cd1f154d57 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:50.595123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-5b93c644-10b7-45aa-b11f-e7736acccf45 req-4ade03dd-2d25-4841-ac52-83cd1f154d57 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:50.609491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-5b93c644-10b7-45aa-b11f-e7736acccf45 req-4ade03dd-2d25-4841-ac52-83cd1f154d57 service nova] Creating event network-vif-plugged:aed4fc54-d1a7-4f65-a4b3-8276ee7d8e1e for instance 8797f201-711b-4299-8eaa-bb430cec1210 on hv-cinder-77819 Jun 20 07:36:50.617006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-5b93c644-10b7-45aa-b11f-e7736acccf45 req-4ade03dd-2d25-4841-ac52-83cd1f154d57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039074 Jun 20 07:36:50.617909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1205/2537] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:36:50.623781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8e566d4c-0920-4efc-9046-24ff2daf5c19 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:50.625401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8e566d4c-0920-4efc-9046-24ff2daf5c19 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:50.632851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e566d4c-0920-4efc-9046-24ff2daf5c19 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:50.633301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e566d4c-0920-4efc-9046-24ff2daf5c19 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:50.634286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e566d4c-0920-4efc-9046-24ff2daf5c19 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:50.635407 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8e566d4c-0920-4efc-9046-24ff2daf5c19 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:50.837271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-10dfef8a-260c-4d58-bd96-95fe85e65bcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:50.844692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-10dfef8a-260c-4d58-bd96-95fe85e65bcc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1362 microversion: 2.1 time: 0.263849 Jun 20 07:36:50.845356 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1333/2538] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:50 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:50.875220 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8e566d4c-0920-4efc-9046-24ff2daf5c19 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:50.878065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:50.885693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8e566d4c-0920-4efc-9046-24ff2daf5c19 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.266372 Jun 20 07:36:50.886292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1206/2539] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:51.861396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bc139a18-6800-4625-b041-03eff786a1ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:51.862016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bc139a18-6800-4625-b041-03eff786a1ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:51.864541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:51.870121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc139a18-6800-4625-b041-03eff786a1ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:51.870567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc139a18-6800-4625-b041-03eff786a1ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:51.871321 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc139a18-6800-4625-b041-03eff786a1ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:51.871754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc139a18-6800-4625-b041-03eff786a1ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:51.902579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-88dcd6ae-a321-463d-a1a7-d259f0318395 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:51.903287 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-88dcd6ae-a321-463d-a1a7-d259f0318395 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:51.905649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:51.906363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=10 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:51.912516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88dcd6ae-a321-463d-a1a7-d259f0318395 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:51.912962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88dcd6ae-a321-463d-a1a7-d259f0318395 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:51.913721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88dcd6ae-a321-463d-a1a7-d259f0318395 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:51.914155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88dcd6ae-a321-463d-a1a7-d259f0318395 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:52.051510 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bc139a18-6800-4625-b041-03eff786a1ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:52.058871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bc139a18-6800-4625-b041-03eff786a1ea tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1362 microversion: 2.1 time: 0.201387 Jun 20 07:36:52.059440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1334/2540] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:51 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:52.088167 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-88dcd6ae-a321-463d-a1a7-d259f0318395 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:52.102698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-88dcd6ae-a321-463d-a1a7-d259f0318395 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.203900 Jun 20 07:36:52.103265 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1207/2541] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:53.076363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0fe38f33-aeb7-413f-9bbf-301c528bd4d9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:53.076983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0fe38f33-aeb7-413f-9bbf-301c528bd4d9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:53.079346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=62 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:53.085662 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fe38f33-aeb7-413f-9bbf-301c528bd4d9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:53.086044 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fe38f33-aeb7-413f-9bbf-301c528bd4d9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:53.086796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fe38f33-aeb7-413f-9bbf-301c528bd4d9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:53.087226 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0fe38f33-aeb7-413f-9bbf-301c528bd4d9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:53.119513 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5d39afe9-0a64-4646-bbd3-a59667a7c5d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:53.120208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5d39afe9-0a64-4646-bbd3-a59667a7c5d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:53.127260 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d39afe9-0a64-4646-bbd3-a59667a7c5d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:53.127716 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d39afe9-0a64-4646-bbd3-a59667a7c5d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:53.128517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d39afe9-0a64-4646-bbd3-a59667a7c5d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:53.128959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d39afe9-0a64-4646-bbd3-a59667a7c5d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:53.265537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0fe38f33-aeb7-413f-9bbf-301c528bd4d9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:53.273572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0fe38f33-aeb7-413f-9bbf-301c528bd4d9 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1548 microversion: 2.1 time: 0.201040 Jun 20 07:36:53.274765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1335/2542] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:53 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1548 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:53.289577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-aa157b97-3c02-4acb-ad57-fdcf47b057cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:53.290074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-aa157b97-3c02-4acb-ad57-fdcf47b057cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:53.294001 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5d39afe9-0a64-4646-bbd3-a59667a7c5d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:53.296091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa157b97-3c02-4acb-ad57-fdcf47b057cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:53.296576 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa157b97-3c02-4acb-ad57-fdcf47b057cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:53.297342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa157b97-3c02-4acb-ad57-fdcf47b057cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:53.297781 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-aa157b97-3c02-4acb-ad57-fdcf47b057cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:53.302716 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5d39afe9-0a64-4646-bbd3-a59667a7c5d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.187610 Jun 20 07:36:53.303397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1208/2543] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:36:53.373032 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-aa157b97-3c02-4acb-ad57-fdcf47b057cb tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087172 Jun 20 07:36:53.373656 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1336/2544] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 07:36:53 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:36:54.271618 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-3b1ea7c1-5aff-40e1-8910-6730a8537abf req-a61be090-fc8c-41a4-8377-414e97bf04e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8797f201-711b-4299-8eaa-bb430cec1210", "tag": "aed4fc54-d1a7-4f65-a4b3-8276ee7d8e1e"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:36:54.280187 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-3b1ea7c1-5aff-40e1-8910-6730a8537abf req-a61be090-fc8c-41a4-8377-414e97bf04e6 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:54.280632 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-3b1ea7c1-5aff-40e1-8910-6730a8537abf req-a61be090-fc8c-41a4-8377-414e97bf04e6 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:54.291940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-3b1ea7c1-5aff-40e1-8910-6730a8537abf req-a61be090-fc8c-41a4-8377-414e97bf04e6 service nova] Creating event network-changed:aed4fc54-d1a7-4f65-a4b3-8276ee7d8e1e for instance 8797f201-711b-4299-8eaa-bb430cec1210 on hv-cinder-77819 Jun 20 07:36:54.297450 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-3b1ea7c1-5aff-40e1-8910-6730a8537abf req-a61be090-fc8c-41a4-8377-414e97bf04e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030130 Jun 20 07:36:54.298006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1209/2545] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:36:54.319009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-600b0be3-0e21-4abd-aa1c-8ada4acb2dbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:54.319735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-600b0be3-0e21-4abd-aa1c-8ada4acb2dbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:54.326580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-600b0be3-0e21-4abd-aa1c-8ada4acb2dbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:54.327271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-600b0be3-0e21-4abd-aa1c-8ada4acb2dbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:54.328040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-600b0be3-0e21-4abd-aa1c-8ada4acb2dbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:54.328686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-600b0be3-0e21-4abd-aa1c-8ada4acb2dbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:54.333543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=100 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:36:54.775938 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-600b0be3-0e21-4abd-aa1c-8ada4acb2dbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:54.784998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-600b0be3-0e21-4abd-aa1c-8ada4acb2dbd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.469754 Jun 20 07:36:54.794536 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1337/2546] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:54 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:55.803431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d51a8c80-a9e8-4a26-ac72-d04424d986da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:55.804183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d51a8c80-a9e8-4a26-ac72-d04424d986da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:55.810373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d51a8c80-a9e8-4a26-ac72-d04424d986da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:55.810810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d51a8c80-a9e8-4a26-ac72-d04424d986da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:55.811557 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d51a8c80-a9e8-4a26-ac72-d04424d986da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:55.811992 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d51a8c80-a9e8-4a26-ac72-d04424d986da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:55.943618 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d51a8c80-a9e8-4a26-ac72-d04424d986da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:55.951372 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d51a8c80-a9e8-4a26-ac72-d04424d986da tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.153094 Jun 20 07:36:55.951934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1210/2547] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:55 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:56.967531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-58fe9e05-d4b7-4996-b22f-66b1c083056e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:56.968175 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-58fe9e05-d4b7-4996-b22f-66b1c083056e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:56.974748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58fe9e05-d4b7-4996-b22f-66b1c083056e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:56.975198 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58fe9e05-d4b7-4996-b22f-66b1c083056e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:56.975987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58fe9e05-d4b7-4996-b22f-66b1c083056e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:56.976457 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-58fe9e05-d4b7-4996-b22f-66b1c083056e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:57.107219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-58fe9e05-d4b7-4996-b22f-66b1c083056e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:57.115672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-58fe9e05-d4b7-4996-b22f-66b1c083056e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152023 Jun 20 07:36:57.116271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1338/2548] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:58.133790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-afb79f22-e696-4e0a-8b4d-207e2c46ab24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:58.134426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-afb79f22-e696-4e0a-8b4d-207e2c46ab24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:58.140894 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afb79f22-e696-4e0a-8b4d-207e2c46ab24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:58.141343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afb79f22-e696-4e0a-8b4d-207e2c46ab24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:58.142096 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afb79f22-e696-4e0a-8b4d-207e2c46ab24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:58.142529 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afb79f22-e696-4e0a-8b4d-207e2c46ab24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:58.270435 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-afb79f22-e696-4e0a-8b4d-207e2c46ab24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:58.278338 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-afb79f22-e696-4e0a-8b4d-207e2c46ab24 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148623 Jun 20 07:36:58.278909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1211/2549] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:36:59.296739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b6cb4a4c-385d-468d-948e-bbb7ccafbc77 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:36:59.297416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b6cb4a4c-385d-468d-948e-bbb7ccafbc77 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:36:59.304386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6cb4a4c-385d-468d-948e-bbb7ccafbc77 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:59.304824 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6cb4a4c-385d-468d-948e-bbb7ccafbc77 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:59.305565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6cb4a4c-385d-468d-948e-bbb7ccafbc77 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:36:59.306255 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b6cb4a4c-385d-468d-948e-bbb7ccafbc77 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:36:59.431252 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b6cb4a4c-385d-468d-948e-bbb7ccafbc77 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:36:59.439198 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b6cb4a4c-385d-468d-948e-bbb7ccafbc77 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146586 Jun 20 07:36:59.440423 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1339/2550] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:36:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:00.457216 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a2991ea5-c43b-4d7a-a0b8-479cc26adaaf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:00.457858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a2991ea5-c43b-4d7a-a0b8-479cc26adaaf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:00.464296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2991ea5-c43b-4d7a-a0b8-479cc26adaaf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:00.464742 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2991ea5-c43b-4d7a-a0b8-479cc26adaaf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:00.465489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2991ea5-c43b-4d7a-a0b8-479cc26adaaf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:00.465922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a2991ea5-c43b-4d7a-a0b8-479cc26adaaf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:00.594583 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a2991ea5-c43b-4d7a-a0b8-479cc26adaaf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:00.602573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a2991ea5-c43b-4d7a-a0b8-479cc26adaaf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149774 Jun 20 07:37:00.603698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1212/2551] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:00 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:01.619460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-802e9736-7475-4066-b141-a586c20df56f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:01.620040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-802e9736-7475-4066-b141-a586c20df56f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:01.626776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-802e9736-7475-4066-b141-a586c20df56f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:01.627234 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-802e9736-7475-4066-b141-a586c20df56f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:01.627984 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-802e9736-7475-4066-b141-a586c20df56f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:01.628445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-802e9736-7475-4066-b141-a586c20df56f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:01.759210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-802e9736-7475-4066-b141-a586c20df56f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:01.767100 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-802e9736-7475-4066-b141-a586c20df56f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151588 Jun 20 07:37:01.768184 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1340/2552] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:01 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:02.785085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2126aa08-e6fa-436b-8b22-a9a12849a80a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:02.786173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2126aa08-e6fa-436b-8b22-a9a12849a80a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:02.793505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2126aa08-e6fa-436b-8b22-a9a12849a80a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:02.793949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2126aa08-e6fa-436b-8b22-a9a12849a80a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:02.794896 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2126aa08-e6fa-436b-8b22-a9a12849a80a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:02.795327 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2126aa08-e6fa-436b-8b22-a9a12849a80a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:02.921699 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2126aa08-e6fa-436b-8b22-a9a12849a80a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:02.929550 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2126aa08-e6fa-436b-8b22-a9a12849a80a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148847 Jun 20 07:37:02.930101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1213/2553] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:03.946374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b780f9ff-3dbe-4863-9065-2a0c751c3029 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:03.946977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b780f9ff-3dbe-4863-9065-2a0c751c3029 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:03.953506 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b780f9ff-3dbe-4863-9065-2a0c751c3029 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:03.953952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b780f9ff-3dbe-4863-9065-2a0c751c3029 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:03.954700 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b780f9ff-3dbe-4863-9065-2a0c751c3029 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:03.955128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b780f9ff-3dbe-4863-9065-2a0c751c3029 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:04.085719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b780f9ff-3dbe-4863-9065-2a0c751c3029 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:04.093594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b780f9ff-3dbe-4863-9065-2a0c751c3029 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151127 Jun 20 07:37:04.094159 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1341/2554] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:03 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:05.111086 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d2a26aa3-c088-4f94-b60a-3363e7556cb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:05.111711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d2a26aa3-c088-4f94-b60a-3363e7556cb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:05.119223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2a26aa3-c088-4f94-b60a-3363e7556cb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:05.119968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2a26aa3-c088-4f94-b60a-3363e7556cb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:05.120475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:37:05.120908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:37:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:37:05.121022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2a26aa3-c088-4f94-b60a-3363e7556cb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:05.121279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2a26aa3-c088-4f94-b60a-3363e7556cb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:05.247565 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d2a26aa3-c088-4f94-b60a-3363e7556cb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:05.256231 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d2a26aa3-c088-4f94-b60a-3363e7556cb9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149084 Jun 20 07:37:05.256796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1214/2555] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:05 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:06.273763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bc635140-4a5d-4387-ba10-1a10eb708d18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:06.274383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bc635140-4a5d-4387-ba10-1a10eb708d18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:06.280916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc635140-4a5d-4387-ba10-1a10eb708d18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:06.281367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc635140-4a5d-4387-ba10-1a10eb708d18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:06.282128 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc635140-4a5d-4387-ba10-1a10eb708d18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:06.282570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc635140-4a5d-4387-ba10-1a10eb708d18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:06.407946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bc635140-4a5d-4387-ba10-1a10eb708d18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:06.415848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bc635140-4a5d-4387-ba10-1a10eb708d18 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146026 Jun 20 07:37:06.416461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1342/2556] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:06 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:07.432888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b100aa86-b068-44b2-aee3-7222be9e43a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:07.433523 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b100aa86-b068-44b2-aee3-7222be9e43a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:07.440264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b100aa86-b068-44b2-aee3-7222be9e43a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:07.440721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b100aa86-b068-44b2-aee3-7222be9e43a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:07.441510 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b100aa86-b068-44b2-aee3-7222be9e43a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:07.441947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b100aa86-b068-44b2-aee3-7222be9e43a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:07.569432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b100aa86-b068-44b2-aee3-7222be9e43a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:07.577302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b100aa86-b068-44b2-aee3-7222be9e43a3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148300 Jun 20 07:37:07.577868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1215/2557] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:07 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:08.594673 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-612a0752-cf56-46ef-ae85-9dd4970a629f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:08.595288 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-612a0752-cf56-46ef-ae85-9dd4970a629f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:08.602466 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-612a0752-cf56-46ef-ae85-9dd4970a629f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:08.602913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-612a0752-cf56-46ef-ae85-9dd4970a629f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:08.603668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-612a0752-cf56-46ef-ae85-9dd4970a629f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:08.604124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-612a0752-cf56-46ef-ae85-9dd4970a629f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:08.730984 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-612a0752-cf56-46ef-ae85-9dd4970a629f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:08.739431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-612a0752-cf56-46ef-ae85-9dd4970a629f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148589 Jun 20 07:37:08.739992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1343/2558] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:08 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:09.756425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7e3944e-4f65-4f6a-b45c-825119710818 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:09.757044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7e3944e-4f65-4f6a-b45c-825119710818 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:09.763531 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7e3944e-4f65-4f6a-b45c-825119710818 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:09.763977 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7e3944e-4f65-4f6a-b45c-825119710818 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:09.764766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7e3944e-4f65-4f6a-b45c-825119710818 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:09.765206 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7e3944e-4f65-4f6a-b45c-825119710818 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:09.895602 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7e3944e-4f65-4f6a-b45c-825119710818 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:09.903475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7e3944e-4f65-4f6a-b45c-825119710818 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151734 Jun 20 07:37:09.904039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1216/2559] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:09 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:10.920639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-639ca7a8-2790-4542-a39b-67e0313777b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:10.921219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-639ca7a8-2790-4542-a39b-67e0313777b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:10.928388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-639ca7a8-2790-4542-a39b-67e0313777b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:10.928840 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-639ca7a8-2790-4542-a39b-67e0313777b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:10.929597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-639ca7a8-2790-4542-a39b-67e0313777b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:10.930036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-639ca7a8-2790-4542-a39b-67e0313777b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:11.055290 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-639ca7a8-2790-4542-a39b-67e0313777b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:11.063144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-639ca7a8-2790-4542-a39b-67e0313777b1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146427 Jun 20 07:37:11.063706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1344/2560] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:10 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:12.080413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a7b680d4-c56a-410a-82f9-f96dc5c54adf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:12.081044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a7b680d4-c56a-410a-82f9-f96dc5c54adf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:12.087564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7b680d4-c56a-410a-82f9-f96dc5c54adf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:12.088012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7b680d4-c56a-410a-82f9-f96dc5c54adf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:12.088802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7b680d4-c56a-410a-82f9-f96dc5c54adf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:12.089243 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a7b680d4-c56a-410a-82f9-f96dc5c54adf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:12.217059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a7b680d4-c56a-410a-82f9-f96dc5c54adf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:12.224884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a7b680d4-c56a-410a-82f9-f96dc5c54adf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148425 Jun 20 07:37:12.225442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1217/2561] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:12 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:12.806169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:37:12.806625 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:37:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:37:13.241793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-94dec1a3-617c-4425-845a-6d10f05eeb05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:13.242405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-94dec1a3-617c-4425-845a-6d10f05eeb05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:13.248937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94dec1a3-617c-4425-845a-6d10f05eeb05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:13.249388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94dec1a3-617c-4425-845a-6d10f05eeb05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:13.250149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94dec1a3-617c-4425-845a-6d10f05eeb05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:13.250585 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-94dec1a3-617c-4425-845a-6d10f05eeb05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:13.377980 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-94dec1a3-617c-4425-845a-6d10f05eeb05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:13.385866 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-94dec1a3-617c-4425-845a-6d10f05eeb05 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147965 Jun 20 07:37:13.386431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1345/2562] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:13 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:14.402713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-66055c41-f622-4d64-9fba-2e2a6910d781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:14.403255 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-66055c41-f622-4d64-9fba-2e2a6910d781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:14.409801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66055c41-f622-4d64-9fba-2e2a6910d781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:14.410247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66055c41-f622-4d64-9fba-2e2a6910d781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:14.411002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66055c41-f622-4d64-9fba-2e2a6910d781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:14.411439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66055c41-f622-4d64-9fba-2e2a6910d781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:14.536348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-66055c41-f622-4d64-9fba-2e2a6910d781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:14.544137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-66055c41-f622-4d64-9fba-2e2a6910d781 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145338 Jun 20 07:37:14.544700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1218/2563] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:14 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:15.561009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8f19faa8-2721-43e3-b270-68ccad436f35 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:15.561620 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8f19faa8-2721-43e3-b270-68ccad436f35 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:15.568749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f19faa8-2721-43e3-b270-68ccad436f35 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:15.569197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f19faa8-2721-43e3-b270-68ccad436f35 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:15.569946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f19faa8-2721-43e3-b270-68ccad436f35 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:15.570379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8f19faa8-2721-43e3-b270-68ccad436f35 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:15.700628 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8f19faa8-2721-43e3-b270-68ccad436f35 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:15.708734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8f19faa8-2721-43e3-b270-68ccad436f35 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151383 Jun 20 07:37:15.709127 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1346/2564] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:15 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:16.726705 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-58c1fde7-edc4-4b07-ae71-3d44ac9a6acc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:16.727317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-58c1fde7-edc4-4b07-ae71-3d44ac9a6acc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:16.733902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58c1fde7-edc4-4b07-ae71-3d44ac9a6acc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:16.734348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58c1fde7-edc4-4b07-ae71-3d44ac9a6acc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:16.735105 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58c1fde7-edc4-4b07-ae71-3d44ac9a6acc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:16.735543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58c1fde7-edc4-4b07-ae71-3d44ac9a6acc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:16.862089 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-58c1fde7-edc4-4b07-ae71-3d44ac9a6acc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:16.869884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-58c1fde7-edc4-4b07-ae71-3d44ac9a6acc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147668 Jun 20 07:37:16.870446 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1219/2565] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:16 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:17.887248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-70cb3194-ad4c-4845-be06-748f7be54a59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:17.887860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-70cb3194-ad4c-4845-be06-748f7be54a59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:17.895084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70cb3194-ad4c-4845-be06-748f7be54a59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:17.895531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70cb3194-ad4c-4845-be06-748f7be54a59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:17.896346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70cb3194-ad4c-4845-be06-748f7be54a59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:17.896756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-70cb3194-ad4c-4845-be06-748f7be54a59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:18.025498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-70cb3194-ad4c-4845-be06-748f7be54a59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:18.033384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-70cb3194-ad4c-4845-be06-748f7be54a59 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149988 Jun 20 07:37:18.033949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1347/2566] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:17 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:19.049931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-10d511f8-62c1-458c-b475-a0419f02a409 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:19.050552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-10d511f8-62c1-458c-b475-a0419f02a409 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:19.056968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10d511f8-62c1-458c-b475-a0419f02a409 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:19.057415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10d511f8-62c1-458c-b475-a0419f02a409 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:19.058169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10d511f8-62c1-458c-b475-a0419f02a409 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:19.058627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-10d511f8-62c1-458c-b475-a0419f02a409 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:19.333490 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-10d511f8-62c1-458c-b475-a0419f02a409 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:19.341310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-10d511f8-62c1-458c-b475-a0419f02a409 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.295200 Jun 20 07:37:19.341868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1220/2567] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:19 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:20.358235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e4aee909-2cda-4f14-998d-31c7109711f6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:20.358844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e4aee909-2cda-4f14-998d-31c7109711f6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:20.365366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4aee909-2cda-4f14-998d-31c7109711f6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:20.365811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4aee909-2cda-4f14-998d-31c7109711f6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:20.366562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4aee909-2cda-4f14-998d-31c7109711f6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:20.366995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4aee909-2cda-4f14-998d-31c7109711f6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:20.492461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e4aee909-2cda-4f14-998d-31c7109711f6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:20.500305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e4aee909-2cda-4f14-998d-31c7109711f6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145878 Jun 20 07:37:20.500874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1348/2568] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:20 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:21.517291 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-96a16d1d-e841-47e7-b015-b3f9d8bde37d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:21.517909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-96a16d1d-e841-47e7-b015-b3f9d8bde37d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:21.520095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=34 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:37:21.525449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96a16d1d-e841-47e7-b015-b3f9d8bde37d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:21.525903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96a16d1d-e841-47e7-b015-b3f9d8bde37d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:21.526660 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96a16d1d-e841-47e7-b015-b3f9d8bde37d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:21.527106 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96a16d1d-e841-47e7-b015-b3f9d8bde37d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:21.529891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=82 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:37:21.656229 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-96a16d1d-e841-47e7-b015-b3f9d8bde37d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:21.664589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-96a16d1d-e841-47e7-b015-b3f9d8bde37d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151206 Jun 20 07:37:21.665143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1221/2569] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:21 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:22.681219 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0f266150-cfc9-416b-85a5-b8e388fdc43b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:22.681825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0f266150-cfc9-416b-85a5-b8e388fdc43b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:22.688441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f266150-cfc9-416b-85a5-b8e388fdc43b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:22.688884 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f266150-cfc9-416b-85a5-b8e388fdc43b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:22.689632 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f266150-cfc9-416b-85a5-b8e388fdc43b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:22.690068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0f266150-cfc9-416b-85a5-b8e388fdc43b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:22.816705 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0f266150-cfc9-416b-85a5-b8e388fdc43b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:22.824737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0f266150-cfc9-416b-85a5-b8e388fdc43b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147385 Jun 20 07:37:22.825295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1349/2570] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:22 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:23.842063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5e5b996a-43c3-46c4-9dbf-67577d35f01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:23.842668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5e5b996a-43c3-46c4-9dbf-67577d35f01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:23.849118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e5b996a-43c3-46c4-9dbf-67577d35f01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:23.849566 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e5b996a-43c3-46c4-9dbf-67577d35f01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:23.850315 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e5b996a-43c3-46c4-9dbf-67577d35f01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:23.850744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e5b996a-43c3-46c4-9dbf-67577d35f01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:23.982512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5e5b996a-43c3-46c4-9dbf-67577d35f01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:23.990881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5e5b996a-43c3-46c4-9dbf-67577d35f01e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152649 Jun 20 07:37:23.991444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1222/2571] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:23 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:25.008203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-826d4466-8a58-4932-b86a-d8e130a5cd0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:25.008748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-826d4466-8a58-4932-b86a-d8e130a5cd0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:25.011079 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=30 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:37:25.016360 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-826d4466-8a58-4932-b86a-d8e130a5cd0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:25.016804 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-826d4466-8a58-4932-b86a-d8e130a5cd0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:25.017548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-826d4466-8a58-4932-b86a-d8e130a5cd0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:25.017979 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-826d4466-8a58-4932-b86a-d8e130a5cd0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:25.022440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=78 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:37:25.145119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-826d4466-8a58-4932-b86a-d8e130a5cd0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:25.152976 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-826d4466-8a58-4932-b86a-d8e130a5cd0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148703 Jun 20 07:37:25.153529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1350/2572] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:25 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:26.169793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5796a0cd-ae54-4e3e-8c77-4f17fb88fe11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:26.170400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5796a0cd-ae54-4e3e-8c77-4f17fb88fe11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:26.177387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5796a0cd-ae54-4e3e-8c77-4f17fb88fe11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:26.177853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5796a0cd-ae54-4e3e-8c77-4f17fb88fe11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:26.178593 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5796a0cd-ae54-4e3e-8c77-4f17fb88fe11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:26.179024 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5796a0cd-ae54-4e3e-8c77-4f17fb88fe11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:26.305610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5796a0cd-ae54-4e3e-8c77-4f17fb88fe11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:26.313336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5796a0cd-ae54-4e3e-8c77-4f17fb88fe11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147465 Jun 20 07:37:26.313892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1223/2573] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:26 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:27.330280 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c4b514d1-2cda-4747-9b81-63553443121c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:27.330885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c4b514d1-2cda-4747-9b81-63553443121c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:27.337324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4b514d1-2cda-4747-9b81-63553443121c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:27.337763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4b514d1-2cda-4747-9b81-63553443121c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:27.338537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4b514d1-2cda-4747-9b81-63553443121c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:27.338967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4b514d1-2cda-4747-9b81-63553443121c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:27.466485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c4b514d1-2cda-4747-9b81-63553443121c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:27.474831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c4b514d1-2cda-4747-9b81-63553443121c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148504 Jun 20 07:37:27.475385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1351/2574] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:27 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:28.380694 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2cd753c1-e3d7-4411-84fa-551a0aa81968 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:28.381288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2cd753c1-e3d7-4411-84fa-551a0aa81968 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:28.387519 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cd753c1-e3d7-4411-84fa-551a0aa81968 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:28.387964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cd753c1-e3d7-4411-84fa-551a0aa81968 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:28.388752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cd753c1-e3d7-4411-84fa-551a0aa81968 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:28.389184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cd753c1-e3d7-4411-84fa-551a0aa81968 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:28.411904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2cd753c1-e3d7-4411-84fa-551a0aa81968 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210/ips" status: 200 len: 145 microversion: 2.1 time: 0.035801 Jun 20 07:37:28.412687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1224/2575] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 07:37:28 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:37:28.491192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-37bc119a-1bb6-4aea-8954-104205e2d8ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:28.491726 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-37bc119a-1bb6-4aea-8954-104205e2d8ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:28.498178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37bc119a-1bb6-4aea-8954-104205e2d8ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:28.498629 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37bc119a-1bb6-4aea-8954-104205e2d8ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:28.499384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37bc119a-1bb6-4aea-8954-104205e2d8ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:28.499841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-37bc119a-1bb6-4aea-8954-104205e2d8ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:28.628952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-37bc119a-1bb6-4aea-8954-104205e2d8ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:28.636929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-37bc119a-1bb6-4aea-8954-104205e2d8ef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150203 Jun 20 07:37:28.637494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1352/2576] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:28 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:29.654064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca011e4c-27a0-4e73-b8ab-ab7de1832bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:29.654683 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca011e4c-27a0-4e73-b8ab-ab7de1832bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:29.661620 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca011e4c-27a0-4e73-b8ab-ab7de1832bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:29.662073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca011e4c-27a0-4e73-b8ab-ab7de1832bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:29.662840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca011e4c-27a0-4e73-b8ab-ab7de1832bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:29.663277 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca011e4c-27a0-4e73-b8ab-ab7de1832bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:29.819527 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca011e4c-27a0-4e73-b8ab-ab7de1832bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:29.827412 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca011e4c-27a0-4e73-b8ab-ab7de1832bbe tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.177224 Jun 20 07:37:29.827968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1225/2577] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:29 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:30.845031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eb81da65-a25b-4586-8098-0a9beaaf850b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:30.845704 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eb81da65-a25b-4586-8098-0a9beaaf850b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:30.852969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb81da65-a25b-4586-8098-0a9beaaf850b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:30.853419 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb81da65-a25b-4586-8098-0a9beaaf850b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:30.854177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb81da65-a25b-4586-8098-0a9beaaf850b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:30.854610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eb81da65-a25b-4586-8098-0a9beaaf850b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:30.979079 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eb81da65-a25b-4586-8098-0a9beaaf850b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:30.987193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eb81da65-a25b-4586-8098-0a9beaaf850b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145746 Jun 20 07:37:30.987763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1353/2578] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:30 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:32.004869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3d3c1265-f09a-498d-8c3b-3e7256ad597f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:32.005439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3d3c1265-f09a-498d-8c3b-3e7256ad597f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:32.011761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d3c1265-f09a-498d-8c3b-3e7256ad597f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:32.012235 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d3c1265-f09a-498d-8c3b-3e7256ad597f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:32.012987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d3c1265-f09a-498d-8c3b-3e7256ad597f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:32.013420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d3c1265-f09a-498d-8c3b-3e7256ad597f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:32.140875 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3d3c1265-f09a-498d-8c3b-3e7256ad597f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:32.149325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3d3c1265-f09a-498d-8c3b-3e7256ad597f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149164 Jun 20 07:37:32.149869 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1226/2579] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:31 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:33.166589 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-861aa725-70ad-4e94-b985-9841b11bcc1a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:33.167183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-861aa725-70ad-4e94-b985-9841b11bcc1a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:33.174048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-861aa725-70ad-4e94-b985-9841b11bcc1a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:33.174495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-861aa725-70ad-4e94-b985-9841b11bcc1a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:33.175247 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-861aa725-70ad-4e94-b985-9841b11bcc1a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:33.175682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-861aa725-70ad-4e94-b985-9841b11bcc1a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:33.305392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-861aa725-70ad-4e94-b985-9841b11bcc1a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:33.313951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-861aa725-70ad-4e94-b985-9841b11bcc1a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151595 Jun 20 07:37:33.314521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1354/2580] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:33 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:34.331901 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-43e18217-c84c-498f-8b48-85ac2cb2a3df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:34.332534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-43e18217-c84c-498f-8b48-85ac2cb2a3df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:34.339044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43e18217-c84c-498f-8b48-85ac2cb2a3df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:34.339494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43e18217-c84c-498f-8b48-85ac2cb2a3df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:34.340278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43e18217-c84c-498f-8b48-85ac2cb2a3df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:34.340719 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43e18217-c84c-498f-8b48-85ac2cb2a3df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:34.468385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-43e18217-c84c-498f-8b48-85ac2cb2a3df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:34.476099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-43e18217-c84c-498f-8b48-85ac2cb2a3df tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148699 Jun 20 07:37:34.476680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1227/2581] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:35.493022 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0cfe7085-9ddc-4ca8-b3a2-727a78af3a1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:35.493614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0cfe7085-9ddc-4ca8-b3a2-727a78af3a1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:35.499756 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cfe7085-9ddc-4ca8-b3a2-727a78af3a1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:35.500236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cfe7085-9ddc-4ca8-b3a2-727a78af3a1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:35.500981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cfe7085-9ddc-4ca8-b3a2-727a78af3a1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:35.501677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0cfe7085-9ddc-4ca8-b3a2-727a78af3a1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:35.625940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0cfe7085-9ddc-4ca8-b3a2-727a78af3a1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:35.634507 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0cfe7085-9ddc-4ca8-b3a2-727a78af3a1b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145360 Jun 20 07:37:35.635054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1355/2582] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:35 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:36.651895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dc2624b8-efb1-4203-b76c-3460899c9d3f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:36.652549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dc2624b8-efb1-4203-b76c-3460899c9d3f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:36.659079 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc2624b8-efb1-4203-b76c-3460899c9d3f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:36.659529 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc2624b8-efb1-4203-b76c-3460899c9d3f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:36.660317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc2624b8-efb1-4203-b76c-3460899c9d3f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:36.660759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc2624b8-efb1-4203-b76c-3460899c9d3f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:36.786540 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dc2624b8-efb1-4203-b76c-3460899c9d3f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:36.794323 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dc2624b8-efb1-4203-b76c-3460899c9d3f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146224 Jun 20 07:37:36.794870 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1228/2583] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:36 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:37.810722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-528e0f92-be2d-407f-814b-f6b11e7c8f0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:37.811333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-528e0f92-be2d-407f-814b-f6b11e7c8f0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:37.818401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-528e0f92-be2d-407f-814b-f6b11e7c8f0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:37.818851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-528e0f92-be2d-407f-814b-f6b11e7c8f0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:37.819611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-528e0f92-be2d-407f-814b-f6b11e7c8f0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:37.820047 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-528e0f92-be2d-407f-814b-f6b11e7c8f0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:37.946648 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-528e0f92-be2d-407f-814b-f6b11e7c8f0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:37.954501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-528e0f92-be2d-407f-814b-f6b11e7c8f0c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147682 Jun 20 07:37:37.955059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1356/2584] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:37 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:38.971889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6ba37fb8-019b-4359-a409-4250053636cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:38.973099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6ba37fb8-019b-4359-a409-4250053636cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:38.979566 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ba37fb8-019b-4359-a409-4250053636cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:38.980012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ba37fb8-019b-4359-a409-4250053636cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:38.980789 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ba37fb8-019b-4359-a409-4250053636cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:38.981259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ba37fb8-019b-4359-a409-4250053636cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:39.107087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ba37fb8-019b-4359-a409-4250053636cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:39.114846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6ba37fb8-019b-4359-a409-4250053636cd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146884 Jun 20 07:37:39.115395 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1229/2585] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:38 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:40.132229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-eaedea18-17da-4aa1-a429-0311b86aedef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:40.132848 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-eaedea18-17da-4aa1-a429-0311b86aedef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:40.139357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eaedea18-17da-4aa1-a429-0311b86aedef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:40.139809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eaedea18-17da-4aa1-a429-0311b86aedef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:40.140603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eaedea18-17da-4aa1-a429-0311b86aedef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:40.141040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-eaedea18-17da-4aa1-a429-0311b86aedef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:40.270937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-eaedea18-17da-4aa1-a429-0311b86aedef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:40.278812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-eaedea18-17da-4aa1-a429-0311b86aedef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150513 Jun 20 07:37:40.279373 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1357/2586] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:40 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:41.296924 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5da661c2-e82e-484a-a3a7-0c8bb4c51f32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:41.297655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5da661c2-e82e-484a-a3a7-0c8bb4c51f32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:41.304811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5da661c2-e82e-484a-a3a7-0c8bb4c51f32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:41.305270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5da661c2-e82e-484a-a3a7-0c8bb4c51f32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:41.306098 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5da661c2-e82e-484a-a3a7-0c8bb4c51f32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:41.306483 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5da661c2-e82e-484a-a3a7-0c8bb4c51f32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:41.445705 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5da661c2-e82e-484a-a3a7-0c8bb4c51f32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:41.453737 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5da661c2-e82e-484a-a3a7-0c8bb4c51f32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.161424 Jun 20 07:37:41.454294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1230/2587] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:42.469494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3e7d524a-3a7c-4798-9605-5fe8f1750a5d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:42.470111 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3e7d524a-3a7c-4798-9605-5fe8f1750a5d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:42.476675 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e7d524a-3a7c-4798-9605-5fe8f1750a5d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:42.477117 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e7d524a-3a7c-4798-9605-5fe8f1750a5d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:42.477861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e7d524a-3a7c-4798-9605-5fe8f1750a5d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:42.478289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3e7d524a-3a7c-4798-9605-5fe8f1750a5d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:42.605754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3e7d524a-3a7c-4798-9605-5fe8f1750a5d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:42.613622 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3e7d524a-3a7c-4798-9605-5fe8f1750a5d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147921 Jun 20 07:37:42.614186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1358/2588] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:42 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:43.634956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-192c4920-c260-4e22-b8fc-4d2f48091f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:43.635573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-192c4920-c260-4e22-b8fc-4d2f48091f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:43.642178 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-192c4920-c260-4e22-b8fc-4d2f48091f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:43.642629 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-192c4920-c260-4e22-b8fc-4d2f48091f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:43.643389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-192c4920-c260-4e22-b8fc-4d2f48091f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:43.644389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-192c4920-c260-4e22-b8fc-4d2f48091f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:43.775208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-192c4920-c260-4e22-b8fc-4d2f48091f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:43.784011 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-192c4920-c260-4e22-b8fc-4d2f48091f63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152930 Jun 20 07:37:43.785224 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1231/2589] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:43 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:44.801682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-476375dc-2784-46b2-9a77-499d9b61bc32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:44.802293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-476375dc-2784-46b2-9a77-499d9b61bc32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:44.808849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-476375dc-2784-46b2-9a77-499d9b61bc32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:44.809291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-476375dc-2784-46b2-9a77-499d9b61bc32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:44.810041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-476375dc-2784-46b2-9a77-499d9b61bc32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:44.810474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-476375dc-2784-46b2-9a77-499d9b61bc32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:44.936415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-476375dc-2784-46b2-9a77-499d9b61bc32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:44.944979 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-476375dc-2784-46b2-9a77-499d9b61bc32 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147186 Jun 20 07:37:44.945552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1359/2590] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:45.963839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-53fa17f7-778a-4e6d-b3fb-3f4baeada69c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:45.964421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-53fa17f7-778a-4e6d-b3fb-3f4baeada69c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:45.970832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53fa17f7-778a-4e6d-b3fb-3f4baeada69c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:45.971278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53fa17f7-778a-4e6d-b3fb-3f4baeada69c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:45.972708 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53fa17f7-778a-4e6d-b3fb-3f4baeada69c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:45.973146 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53fa17f7-778a-4e6d-b3fb-3f4baeada69c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:46.141994 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-53fa17f7-778a-4e6d-b3fb-3f4baeada69c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:46.150498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-53fa17f7-778a-4e6d-b3fb-3f4baeada69c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.192464 Jun 20 07:37:46.151058 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1232/2591] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:47.167366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-20dbe4e0-a5b0-49e2-90be-4175c35f1bcb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:47.167971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-20dbe4e0-a5b0-49e2-90be-4175c35f1bcb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:47.174405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20dbe4e0-a5b0-49e2-90be-4175c35f1bcb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:47.174849 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20dbe4e0-a5b0-49e2-90be-4175c35f1bcb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:47.175598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20dbe4e0-a5b0-49e2-90be-4175c35f1bcb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:47.176025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20dbe4e0-a5b0-49e2-90be-4175c35f1bcb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:47.299956 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20dbe4e0-a5b0-49e2-90be-4175c35f1bcb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:47.307740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-20dbe4e0-a5b0-49e2-90be-4175c35f1bcb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144189 Jun 20 07:37:47.308317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1360/2592] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:47 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:48.324921 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a50b4fd8-96e7-408c-beb5-65e57ecc7e7b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:48.325542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a50b4fd8-96e7-408c-beb5-65e57ecc7e7b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:48.332188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a50b4fd8-96e7-408c-beb5-65e57ecc7e7b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:48.332646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a50b4fd8-96e7-408c-beb5-65e57ecc7e7b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:48.333405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a50b4fd8-96e7-408c-beb5-65e57ecc7e7b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:48.333846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a50b4fd8-96e7-408c-beb5-65e57ecc7e7b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:48.467512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a50b4fd8-96e7-408c-beb5-65e57ecc7e7b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:48.476056 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a50b4fd8-96e7-408c-beb5-65e57ecc7e7b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.154989 Jun 20 07:37:48.476664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1233/2593] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:48 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:49.493480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-89085a41-0bf8-468c-8460-be909b51a998 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:49.494096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-89085a41-0bf8-468c-8460-be909b51a998 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:49.500669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89085a41-0bf8-468c-8460-be909b51a998 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:49.501374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89085a41-0bf8-468c-8460-be909b51a998 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:49.502139 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89085a41-0bf8-468c-8460-be909b51a998 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:49.502581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-89085a41-0bf8-468c-8460-be909b51a998 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:49.628784 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-89085a41-0bf8-468c-8460-be909b51a998 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:49.636664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-89085a41-0bf8-468c-8460-be909b51a998 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147072 Jun 20 07:37:49.637232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1361/2594] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:37:50.653535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e97fba18-b6e2-4ae8-a3e6-af6c59e5511d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:50.654154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e97fba18-b6e2-4ae8-a3e6-af6c59e5511d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:50.660966 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e97fba18-b6e2-4ae8-a3e6-af6c59e5511d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:50.661422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e97fba18-b6e2-4ae8-a3e6-af6c59e5511d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:50.662179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e97fba18-b6e2-4ae8-a3e6-af6c59e5511d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:50.662622 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e97fba18-b6e2-4ae8-a3e6-af6c59e5511d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:50.788633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e97fba18-b6e2-4ae8-a3e6-af6c59e5511d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:50.796458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e97fba18-b6e2-4ae8-a3e6-af6c59e5511d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146744 Jun 20 07:37:50.797015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1234/2595] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:51.814578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5c73a2c3-5578-4fe3-878b-b75e704d4872 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:51.815192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5c73a2c3-5578-4fe3-878b-b75e704d4872 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:51.822381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c73a2c3-5578-4fe3-878b-b75e704d4872 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:51.822831 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c73a2c3-5578-4fe3-878b-b75e704d4872 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:51.823581 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c73a2c3-5578-4fe3-878b-b75e704d4872 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:51.824016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5c73a2c3-5578-4fe3-878b-b75e704d4872 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:51.952871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5c73a2c3-5578-4fe3-878b-b75e704d4872 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:51.960734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5c73a2c3-5578-4fe3-878b-b75e704d4872 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150000 Jun 20 07:37:51.961239 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1362/2596] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:52.977610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fc34715b-71fd-4c57-b0b5-efde7e3940f1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:52.978145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fc34715b-71fd-4c57-b0b5-efde7e3940f1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:52.980556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=28 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:37:52.985703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc34715b-71fd-4c57-b0b5-efde7e3940f1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:52.986152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc34715b-71fd-4c57-b0b5-efde7e3940f1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:52.986909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc34715b-71fd-4c57-b0b5-efde7e3940f1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:52.987346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc34715b-71fd-4c57-b0b5-efde7e3940f1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:52.990330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=82 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:37:53.117598 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fc34715b-71fd-4c57-b0b5-efde7e3940f1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:53.125821 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fc34715b-71fd-4c57-b0b5-efde7e3940f1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152132 Jun 20 07:37:53.126659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1235/2597] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:54.142608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f1211b39-bdc6-4e6d-8d26-fcb772dda8de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:54.143191 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f1211b39-bdc6-4e6d-8d26-fcb772dda8de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:54.149939 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1211b39-bdc6-4e6d-8d26-fcb772dda8de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:54.150383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1211b39-bdc6-4e6d-8d26-fcb772dda8de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:54.151127 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1211b39-bdc6-4e6d-8d26-fcb772dda8de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:54.151556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f1211b39-bdc6-4e6d-8d26-fcb772dda8de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:54.278389 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f1211b39-bdc6-4e6d-8d26-fcb772dda8de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:54.286573 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f1211b39-bdc6-4e6d-8d26-fcb772dda8de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147757 Jun 20 07:37:54.287130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1363/2598] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:54 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:55.303355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9913a2c7-09cc-4c2b-9f93-4d114ee93824 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:55.303969 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9913a2c7-09cc-4c2b-9f93-4d114ee93824 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:55.310461 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9913a2c7-09cc-4c2b-9f93-4d114ee93824 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:55.310905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9913a2c7-09cc-4c2b-9f93-4d114ee93824 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:55.311659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9913a2c7-09cc-4c2b-9f93-4d114ee93824 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:55.312095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9913a2c7-09cc-4c2b-9f93-4d114ee93824 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:55.437881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9913a2c7-09cc-4c2b-9f93-4d114ee93824 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:55.445940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9913a2c7-09cc-4c2b-9f93-4d114ee93824 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147127 Jun 20 07:37:55.446538 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1236/2599] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:55 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:56.463067 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-924b69ec-644f-4110-82c1-7c945b943bb3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:56.463599 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-924b69ec-644f-4110-82c1-7c945b943bb3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:56.465965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=28 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:37:56.471204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-924b69ec-644f-4110-82c1-7c945b943bb3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:56.471653 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-924b69ec-644f-4110-82c1-7c945b943bb3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:56.472441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-924b69ec-644f-4110-82c1-7c945b943bb3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:56.472880 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-924b69ec-644f-4110-82c1-7c945b943bb3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:56.476871 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=84 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:37:56.603516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-924b69ec-644f-4110-82c1-7c945b943bb3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:56.611379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-924b69ec-644f-4110-82c1-7c945b943bb3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152312 Jun 20 07:37:56.612596 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1364/2600] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:57.628886 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3144b5f0-e6bd-4074-81e0-31f00d0c5978 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:57.629513 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3144b5f0-e6bd-4074-81e0-31f00d0c5978 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:57.635976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3144b5f0-e6bd-4074-81e0-31f00d0c5978 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:57.636467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3144b5f0-e6bd-4074-81e0-31f00d0c5978 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:57.637236 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3144b5f0-e6bd-4074-81e0-31f00d0c5978 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:57.637678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3144b5f0-e6bd-4074-81e0-31f00d0c5978 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:57.764603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3144b5f0-e6bd-4074-81e0-31f00d0c5978 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:57.772929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3144b5f0-e6bd-4074-81e0-31f00d0c5978 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148226 Jun 20 07:37:57.773489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1237/2601] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:57 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:58.790305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b45757fa-c52b-411b-82c3-012bce091fa4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:58.790975 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b45757fa-c52b-411b-82c3-012bce091fa4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:58.797441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b45757fa-c52b-411b-82c3-012bce091fa4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:58.797891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b45757fa-c52b-411b-82c3-012bce091fa4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:58.798647 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b45757fa-c52b-411b-82c3-012bce091fa4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:58.799084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b45757fa-c52b-411b-82c3-012bce091fa4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:58.923135 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b45757fa-c52b-411b-82c3-012bce091fa4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:37:58.931578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b45757fa-c52b-411b-82c3-012bce091fa4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145134 Jun 20 07:37:58.932171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1365/2602] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:37:59.948442 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b16ceafe-ed67-4039-8c20-5928490ce498 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:37:59.949049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b16ceafe-ed67-4039-8c20-5928490ce498 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:37:59.955532 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b16ceafe-ed67-4039-8c20-5928490ce498 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:59.955977 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b16ceafe-ed67-4039-8c20-5928490ce498 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:37:59.956778 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b16ceafe-ed67-4039-8c20-5928490ce498 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:37:59.957238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b16ceafe-ed67-4039-8c20-5928490ce498 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:00.094851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b16ceafe-ed67-4039-8c20-5928490ce498 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:00.102840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b16ceafe-ed67-4039-8c20-5928490ce498 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.158200 Jun 20 07:38:00.103406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1238/2603] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:37:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:01.120359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b37271c5-b6fe-488c-b2cb-873ef355cea0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:01.121467 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b37271c5-b6fe-488c-b2cb-873ef355cea0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:01.129710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b37271c5-b6fe-488c-b2cb-873ef355cea0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:01.130166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b37271c5-b6fe-488c-b2cb-873ef355cea0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:01.130941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b37271c5-b6fe-488c-b2cb-873ef355cea0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:01.131380 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b37271c5-b6fe-488c-b2cb-873ef355cea0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:01.263252 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b37271c5-b6fe-488c-b2cb-873ef355cea0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:01.271144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b37271c5-b6fe-488c-b2cb-873ef355cea0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.154898 Jun 20 07:38:01.271708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1366/2604] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:01 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:02.289389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e2b58dd2-d6a9-4b0f-9092-bb389211cc11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:02.290024 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e2b58dd2-d6a9-4b0f-9092-bb389211cc11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:02.296561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2b58dd2-d6a9-4b0f-9092-bb389211cc11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:02.297016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2b58dd2-d6a9-4b0f-9092-bb389211cc11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:02.297774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2b58dd2-d6a9-4b0f-9092-bb389211cc11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:02.298216 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e2b58dd2-d6a9-4b0f-9092-bb389211cc11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:02.432526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e2b58dd2-d6a9-4b0f-9092-bb389211cc11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:02.440406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e2b58dd2-d6a9-4b0f-9092-bb389211cc11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.154878 Jun 20 07:38:02.440972 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1239/2605] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:03.457381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-db86b530-133a-4ff0-aa56-206c4e8c2b83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:03.457968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-db86b530-133a-4ff0-aa56-206c4e8c2b83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:03.464294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db86b530-133a-4ff0-aa56-206c4e8c2b83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:03.464739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db86b530-133a-4ff0-aa56-206c4e8c2b83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:03.465483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db86b530-133a-4ff0-aa56-206c4e8c2b83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:03.465913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-db86b530-133a-4ff0-aa56-206c4e8c2b83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:03.604043 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-db86b530-133a-4ff0-aa56-206c4e8c2b83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:03.612534 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-db86b530-133a-4ff0-aa56-206c4e8c2b83 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.158710 Jun 20 07:38:03.613077 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1367/2606] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:03 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:04.630334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5926a403-b42a-49d1-9a69-6ad302601056 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:04.630940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5926a403-b42a-49d1-9a69-6ad302601056 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:04.637387 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5926a403-b42a-49d1-9a69-6ad302601056 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:04.637830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5926a403-b42a-49d1-9a69-6ad302601056 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:04.638575 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5926a403-b42a-49d1-9a69-6ad302601056 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:04.639008 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5926a403-b42a-49d1-9a69-6ad302601056 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:04.765812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5926a403-b42a-49d1-9a69-6ad302601056 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:04.773581 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5926a403-b42a-49d1-9a69-6ad302601056 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147953 Jun 20 07:38:04.774143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1240/2607] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:04 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:05.790448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9bdcd1d7-a164-4679-b744-e7e0843eb9f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:05.791054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9bdcd1d7-a164-4679-b744-e7e0843eb9f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:05.797178 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bdcd1d7-a164-4679-b744-e7e0843eb9f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:05.797619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bdcd1d7-a164-4679-b744-e7e0843eb9f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:05.798364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bdcd1d7-a164-4679-b744-e7e0843eb9f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:05.798793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9bdcd1d7-a164-4679-b744-e7e0843eb9f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:05.926122 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9bdcd1d7-a164-4679-b744-e7e0843eb9f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:05.933974 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9bdcd1d7-a164-4679-b744-e7e0843eb9f8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147359 Jun 20 07:38:05.934539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1368/2608] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:05 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:06.951347 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a6d7026f-d143-426a-95c7-a84de64cc06c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:06.951891 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a6d7026f-d143-426a-95c7-a84de64cc06c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:06.958513 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6d7026f-d143-426a-95c7-a84de64cc06c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:06.958968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6d7026f-d143-426a-95c7-a84de64cc06c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:06.959731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6d7026f-d143-426a-95c7-a84de64cc06c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:06.960202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6d7026f-d143-426a-95c7-a84de64cc06c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:07.085758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6d7026f-d143-426a-95c7-a84de64cc06c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:07.094426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a6d7026f-d143-426a-95c7-a84de64cc06c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146995 Jun 20 07:38:07.095017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1241/2609] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:06 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:08.111860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-81e62ae3-b625-4841-8ca3-e992e93ab3e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:08.112565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-81e62ae3-b625-4841-8ca3-e992e93ab3e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:08.119062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81e62ae3-b625-4841-8ca3-e992e93ab3e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:08.119509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81e62ae3-b625-4841-8ca3-e992e93ab3e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:08.120300 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81e62ae3-b625-4841-8ca3-e992e93ab3e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:08.120737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-81e62ae3-b625-4841-8ca3-e992e93ab3e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:08.258912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-81e62ae3-b625-4841-8ca3-e992e93ab3e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:08.266774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-81e62ae3-b625-4841-8ca3-e992e93ab3e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.158763 Jun 20 07:38:08.267329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1369/2610] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:08 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:09.284524 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba237f2d-a36d-484c-995a-58d29cd3b986 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:09.285145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba237f2d-a36d-484c-995a-58d29cd3b986 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:09.291559 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba237f2d-a36d-484c-995a-58d29cd3b986 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:09.292012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba237f2d-a36d-484c-995a-58d29cd3b986 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:09.292808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba237f2d-a36d-484c-995a-58d29cd3b986 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:09.293253 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba237f2d-a36d-484c-995a-58d29cd3b986 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:09.418783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ba237f2d-a36d-484c-995a-58d29cd3b986 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:09.426770 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba237f2d-a36d-484c-995a-58d29cd3b986 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146106 Jun 20 07:38:09.427341 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1242/2611] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:09 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:10.443711 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d29218d4-f250-451a-9d0d-fc2c408a4f1c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:10.444349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d29218d4-f250-451a-9d0d-fc2c408a4f1c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:10.450734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d29218d4-f250-451a-9d0d-fc2c408a4f1c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:10.451175 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d29218d4-f250-451a-9d0d-fc2c408a4f1c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:10.451919 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d29218d4-f250-451a-9d0d-fc2c408a4f1c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:10.452379 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d29218d4-f250-451a-9d0d-fc2c408a4f1c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:10.579043 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d29218d4-f250-451a-9d0d-fc2c408a4f1c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:10.587507 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d29218d4-f250-451a-9d0d-fc2c408a4f1c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147629 Jun 20 07:38:10.588070 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1370/2612] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:10 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:11.604484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9b0e5d9a-a775-41cf-9bfd-998ca353c3bb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:11.605105 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9b0e5d9a-a775-41cf-9bfd-998ca353c3bb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:11.611636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b0e5d9a-a775-41cf-9bfd-998ca353c3bb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:11.612095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b0e5d9a-a775-41cf-9bfd-998ca353c3bb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:11.613464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b0e5d9a-a775-41cf-9bfd-998ca353c3bb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:11.613911 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b0e5d9a-a775-41cf-9bfd-998ca353c3bb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:11.741492 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9b0e5d9a-a775-41cf-9bfd-998ca353c3bb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:11.749470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9b0e5d9a-a775-41cf-9bfd-998ca353c3bb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148852 Jun 20 07:38:11.750037 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1243/2613] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:11 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:12.766139 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d79faf05-b3f3-4707-b2f1-63f874243c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:12.766748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d79faf05-b3f3-4707-b2f1-63f874243c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:12.773733 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d79faf05-b3f3-4707-b2f1-63f874243c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:12.774179 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d79faf05-b3f3-4707-b2f1-63f874243c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:12.774932 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d79faf05-b3f3-4707-b2f1-63f874243c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:12.775364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d79faf05-b3f3-4707-b2f1-63f874243c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:12.906063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d79faf05-b3f3-4707-b2f1-63f874243c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:12.914552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d79faf05-b3f3-4707-b2f1-63f874243c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152279 Jun 20 07:38:12.915115 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1371/2614] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:12 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:13.931962 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-23943d56-c7fb-4df6-b1ea-97f44f050962 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:13.932574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-23943d56-c7fb-4df6-b1ea-97f44f050962 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:13.939246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23943d56-c7fb-4df6-b1ea-97f44f050962 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:13.939688 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23943d56-c7fb-4df6-b1ea-97f44f050962 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:13.940468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23943d56-c7fb-4df6-b1ea-97f44f050962 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:13.940901 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-23943d56-c7fb-4df6-b1ea-97f44f050962 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:14.068940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-23943d56-c7fb-4df6-b1ea-97f44f050962 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:14.076763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-23943d56-c7fb-4df6-b1ea-97f44f050962 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148805 Jun 20 07:38:14.077332 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1244/2615] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:13 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:15.093779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-48a77c60-36ae-4746-b2b7-d9480fecaf2f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:15.094430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-48a77c60-36ae-4746-b2b7-d9480fecaf2f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:15.100930 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-48a77c60-36ae-4746-b2b7-d9480fecaf2f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:15.101384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-48a77c60-36ae-4746-b2b7-d9480fecaf2f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:15.102141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-48a77c60-36ae-4746-b2b7-d9480fecaf2f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:15.102580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-48a77c60-36ae-4746-b2b7-d9480fecaf2f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:15.230432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-48a77c60-36ae-4746-b2b7-d9480fecaf2f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:15.238811 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-48a77c60-36ae-4746-b2b7-d9480fecaf2f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148899 Jun 20 07:38:15.239372 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1372/2616] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:15 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:16.256558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5910f47c-dc23-494f-b370-d80ddeb58146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:16.257186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5910f47c-dc23-494f-b370-d80ddeb58146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:16.263610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5910f47c-dc23-494f-b370-d80ddeb58146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:16.264062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5910f47c-dc23-494f-b370-d80ddeb58146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:16.264852 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5910f47c-dc23-494f-b370-d80ddeb58146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:16.265298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5910f47c-dc23-494f-b370-d80ddeb58146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:16.395895 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5910f47c-dc23-494f-b370-d80ddeb58146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:16.403764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5910f47c-dc23-494f-b370-d80ddeb58146 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151723 Jun 20 07:38:16.404363 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1245/2617] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:16 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:17.420834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f9a0106d-cdfa-43bd-ae93-e379808dc0b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:17.421479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f9a0106d-cdfa-43bd-ae93-e379808dc0b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:17.428224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9a0106d-cdfa-43bd-ae93-e379808dc0b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:17.428670 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9a0106d-cdfa-43bd-ae93-e379808dc0b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:17.429427 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9a0106d-cdfa-43bd-ae93-e379808dc0b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:17.429861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f9a0106d-cdfa-43bd-ae93-e379808dc0b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:17.555052 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f9a0106d-cdfa-43bd-ae93-e379808dc0b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:17.562953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f9a0106d-cdfa-43bd-ae93-e379808dc0b4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146132 Jun 20 07:38:17.563508 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1373/2618] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:17 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:18.580692 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-849f0373-170b-4fdd-af0d-dc8e2de58acb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:18.581335 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-849f0373-170b-4fdd-af0d-dc8e2de58acb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:18.587783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-849f0373-170b-4fdd-af0d-dc8e2de58acb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:18.588259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-849f0373-170b-4fdd-af0d-dc8e2de58acb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:18.589010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-849f0373-170b-4fdd-af0d-dc8e2de58acb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:18.589454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-849f0373-170b-4fdd-af0d-dc8e2de58acb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:18.714797 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-849f0373-170b-4fdd-af0d-dc8e2de58acb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:18.723292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-849f0373-170b-4fdd-af0d-dc8e2de58acb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146595 Jun 20 07:38:18.723852 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1246/2619] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:18 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:19.740670 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b3bd0d20-0024-4457-8270-c38a4983d4b2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:19.741284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b3bd0d20-0024-4457-8270-c38a4983d4b2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:19.747812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3bd0d20-0024-4457-8270-c38a4983d4b2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:19.748305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3bd0d20-0024-4457-8270-c38a4983d4b2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:19.749061 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3bd0d20-0024-4457-8270-c38a4983d4b2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:19.749504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3bd0d20-0024-4457-8270-c38a4983d4b2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:19.879042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b3bd0d20-0024-4457-8270-c38a4983d4b2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:19.886967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b3bd0d20-0024-4457-8270-c38a4983d4b2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150688 Jun 20 07:38:19.887529 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1374/2620] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:19 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:20.903345 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cba4f6ec-6704-4b5b-88b7-49c92bcdcf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:20.903967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cba4f6ec-6704-4b5b-88b7-49c92bcdcf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:20.910589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cba4f6ec-6704-4b5b-88b7-49c92bcdcf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:20.911049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cba4f6ec-6704-4b5b-88b7-49c92bcdcf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:20.911806 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cba4f6ec-6704-4b5b-88b7-49c92bcdcf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:20.912285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cba4f6ec-6704-4b5b-88b7-49c92bcdcf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:21.035738 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cba4f6ec-6704-4b5b-88b7-49c92bcdcf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:21.043576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cba4f6ec-6704-4b5b-88b7-49c92bcdcf3b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144274 Jun 20 07:38:21.044154 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1247/2621] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:20 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:22.060426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f12514d2-3881-435d-a2d0-78755802972b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:22.061076 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f12514d2-3881-435d-a2d0-78755802972b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:22.067548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f12514d2-3881-435d-a2d0-78755802972b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:22.067997 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f12514d2-3881-435d-a2d0-78755802972b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:22.068787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f12514d2-3881-435d-a2d0-78755802972b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:22.069226 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f12514d2-3881-435d-a2d0-78755802972b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:22.207865 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f12514d2-3881-435d-a2d0-78755802972b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:22.215876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f12514d2-3881-435d-a2d0-78755802972b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.159309 Jun 20 07:38:22.216488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1375/2622] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:22 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:23.232959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-298b63fe-7c21-478e-8533-4657d084d350 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:23.233623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-298b63fe-7c21-478e-8533-4657d084d350 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:23.236064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=26 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:38:23.242264 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-298b63fe-7c21-478e-8533-4657d084d350 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:23.246741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-298b63fe-7c21-478e-8533-4657d084d350 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:23.247533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-298b63fe-7c21-478e-8533-4657d084d350 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:23.247989 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-298b63fe-7c21-478e-8533-4657d084d350 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:23.250607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=78 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:38:23.373744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-298b63fe-7c21-478e-8533-4657d084d350 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:23.382488 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-298b63fe-7c21-478e-8533-4657d084d350 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.153446 Jun 20 07:38:23.383060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1248/2623] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:23 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:24.399681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-997a3e82-a149-4202-b222-cbd4d4b79d11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:24.400298 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-997a3e82-a149-4202-b222-cbd4d4b79d11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:24.406494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-997a3e82-a149-4202-b222-cbd4d4b79d11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:24.406940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-997a3e82-a149-4202-b222-cbd4d4b79d11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:24.407729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-997a3e82-a149-4202-b222-cbd4d4b79d11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:24.408192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-997a3e82-a149-4202-b222-cbd4d4b79d11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:24.534417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-997a3e82-a149-4202-b222-cbd4d4b79d11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:24.542231 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-997a3e82-a149-4202-b222-cbd4d4b79d11 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146827 Jun 20 07:38:24.542795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1376/2624] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:24 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:25.559071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dc85511d-c867-4ee5-96cc-53ce079f7d50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:25.559596 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dc85511d-c867-4ee5-96cc-53ce079f7d50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:25.566129 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc85511d-c867-4ee5-96cc-53ce079f7d50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:25.566582 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc85511d-c867-4ee5-96cc-53ce079f7d50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:25.567340 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc85511d-c867-4ee5-96cc-53ce079f7d50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:25.567782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dc85511d-c867-4ee5-96cc-53ce079f7d50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:25.692779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dc85511d-c867-4ee5-96cc-53ce079f7d50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:25.700571 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dc85511d-c867-4ee5-96cc-53ce079f7d50 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145389 Jun 20 07:38:25.701132 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1249/2625] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:25 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:26.718747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dc2c4a37-f000-402c-83ae-67bd98a53d39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:26.719354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dc2c4a37-f000-402c-83ae-67bd98a53d39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:26.721718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=26 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:38:26.726992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc2c4a37-f000-402c-83ae-67bd98a53d39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:26.727434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc2c4a37-f000-402c-83ae-67bd98a53d39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:26.728212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc2c4a37-f000-402c-83ae-67bd98a53d39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:26.728647 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dc2c4a37-f000-402c-83ae-67bd98a53d39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:26.732566 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=78 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:38:26.855110 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dc2c4a37-f000-402c-83ae-67bd98a53d39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:26.863528 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dc2c4a37-f000-402c-83ae-67bd98a53d39 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148793 Jun 20 07:38:26.864114 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1377/2626] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:26 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:27.880883 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e145ae45-16f1-47c3-8091-79381a19a02b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:27.881461 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e145ae45-16f1-47c3-8091-79381a19a02b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:27.887970 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e145ae45-16f1-47c3-8091-79381a19a02b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:27.888457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e145ae45-16f1-47c3-8091-79381a19a02b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:27.889222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e145ae45-16f1-47c3-8091-79381a19a02b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:27.889670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e145ae45-16f1-47c3-8091-79381a19a02b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:28.016649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e145ae45-16f1-47c3-8091-79381a19a02b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:28.025171 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e145ae45-16f1-47c3-8091-79381a19a02b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148251 Jun 20 07:38:28.025734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1250/2627] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:27 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:28.550443 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d5575701-e17e-4181-acad-9842dd5a3d6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:28.550937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d5575701-e17e-4181-acad-9842dd5a3d6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:28.556898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5575701-e17e-4181-acad-9842dd5a3d6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:28.557351 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5575701-e17e-4181-acad-9842dd5a3d6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:28.558116 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5575701-e17e-4181-acad-9842dd5a3d6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:28.558553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d5575701-e17e-4181-acad-9842dd5a3d6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:28.584005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d5575701-e17e-4181-acad-9842dd5a3d6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:38:28.659124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d5575701-e17e-4181-acad-9842dd5a3d6f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 204 len: 0 microversion: 2.1 time: 0.175428 Jun 20 07:38:28.660138 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1378/2628] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:38:28 2022] DELETE /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:38:28.669730 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aee5b6e0-5898-456f-bff5-30c60a56f123 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:28.670348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aee5b6e0-5898-456f-bff5-30c60a56f123 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:28.676952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aee5b6e0-5898-456f-bff5-30c60a56f123 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:28.677455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aee5b6e0-5898-456f-bff5-30c60a56f123 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:28.678214 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aee5b6e0-5898-456f-bff5-30c60a56f123 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:28.678652 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aee5b6e0-5898-456f-bff5-30c60a56f123 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:28.805744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aee5b6e0-5898-456f-bff5-30c60a56f123 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:28.813139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aee5b6e0-5898-456f-bff5-30c60a56f123 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1672 microversion: 2.1 time: 0.147230 Jun 20 07:38:28.813693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1251/2629] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:28 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:29.042561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ba50f90c-59c6-4dec-aed6-9ff11e2426c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:29.043264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ba50f90c-59c6-4dec-aed6-9ff11e2426c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:29.049250 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba50f90c-59c6-4dec-aed6-9ff11e2426c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:29.049699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba50f90c-59c6-4dec-aed6-9ff11e2426c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:29.051067 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba50f90c-59c6-4dec-aed6-9ff11e2426c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:29.051504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba50f90c-59c6-4dec-aed6-9ff11e2426c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:29.410310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ba50f90c-59c6-4dec-aed6-9ff11e2426c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:29.418175 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ba50f90c-59c6-4dec-aed6-9ff11e2426c7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.379837 Jun 20 07:38:29.418738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1379/2630] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:29 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:29.830775 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-54fc9cc8-60f5-4f6a-ac2d-bbdd94020cca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:29.831999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-54fc9cc8-60f5-4f6a-ac2d-bbdd94020cca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:29.838397 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54fc9cc8-60f5-4f6a-ac2d-bbdd94020cca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:29.838850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54fc9cc8-60f5-4f6a-ac2d-bbdd94020cca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:29.840390 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54fc9cc8-60f5-4f6a-ac2d-bbdd94020cca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:29.840837 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54fc9cc8-60f5-4f6a-ac2d-bbdd94020cca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:29.966724 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-54fc9cc8-60f5-4f6a-ac2d-bbdd94020cca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:29.974616 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-54fc9cc8-60f5-4f6a-ac2d-bbdd94020cca tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1672 microversion: 2.1 time: 0.147834 Jun 20 07:38:29.975348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1252/2631] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:29 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:30.434684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-93c8ce84-4d85-4092-a069-b50c66849cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:30.435284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-93c8ce84-4d85-4092-a069-b50c66849cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:30.442024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-93c8ce84-4d85-4092-a069-b50c66849cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:30.442472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-93c8ce84-4d85-4092-a069-b50c66849cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:30.443254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-93c8ce84-4d85-4092-a069-b50c66849cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:30.443704 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-93c8ce84-4d85-4092-a069-b50c66849cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:30.734796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-93c8ce84-4d85-4092-a069-b50c66849cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:30.743396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-93c8ce84-4d85-4092-a069-b50c66849cfa tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.312556 Jun 20 07:38:30.743999 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1380/2632] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:30 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:30.991901 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-676a62d4-1e57-4c67-a450-5a0bd3f04abc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:30.992561 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-676a62d4-1e57-4c67-a450-5a0bd3f04abc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:30.999030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-676a62d4-1e57-4c67-a450-5a0bd3f04abc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:30.999487 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-676a62d4-1e57-4c67-a450-5a0bd3f04abc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:31.000289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-676a62d4-1e57-4c67-a450-5a0bd3f04abc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:31.000730 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-676a62d4-1e57-4c67-a450-5a0bd3f04abc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:31.110284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-676a62d4-1e57-4c67-a450-5a0bd3f04abc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:31.118007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-676a62d4-1e57-4c67-a450-5a0bd3f04abc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 200 len: 1605 microversion: 2.1 time: 0.129872 Jun 20 07:38:31.118589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1253/2633] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:30 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 1605 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:31.379090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-83d1ab88-e59f-4ed6-84f7-36c326890608 req-ce82de14-846d-400b-a9bd-f503de78170c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8797f201-711b-4299-8eaa-bb430cec1210", "name": "network-vif-deleted", "tag": "aed4fc54-d1a7-4f65-a4b3-8276ee7d8e1e"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:38:31.389594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-83d1ab88-e59f-4ed6-84f7-36c326890608 req-ce82de14-846d-400b-a9bd-f503de78170c service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:31.390344 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-83d1ab88-e59f-4ed6-84f7-36c326890608 req-ce82de14-846d-400b-a9bd-f503de78170c service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:31.402399 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-83d1ab88-e59f-4ed6-84f7-36c326890608 req-ce82de14-846d-400b-a9bd-f503de78170c service nova] Creating event network-vif-deleted:aed4fc54-d1a7-4f65-a4b3-8276ee7d8e1e for instance 8797f201-711b-4299-8eaa-bb430cec1210 on hv-cinder-77819 Jun 20 07:38:31.407950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-83d1ab88-e59f-4ed6-84f7-36c326890608 req-ce82de14-846d-400b-a9bd-f503de78170c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034489 Jun 20 07:38:31.408780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1381/2634] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:38:31.761979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7ab5dc58-6b23-4eb4-a4e5-f8ac51507111 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:31.762825 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7ab5dc58-6b23-4eb4-a4e5-f8ac51507111 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:31.769461 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ab5dc58-6b23-4eb4-a4e5-f8ac51507111 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:31.769908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ab5dc58-6b23-4eb4-a4e5-f8ac51507111 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:31.770671 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ab5dc58-6b23-4eb4-a4e5-f8ac51507111 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:31.771107 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ab5dc58-6b23-4eb4-a4e5-f8ac51507111 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:31.913047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7ab5dc58-6b23-4eb4-a4e5-f8ac51507111 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:31.921247 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7ab5dc58-6b23-4eb4-a4e5-f8ac51507111 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.164222 Jun 20 07:38:31.921830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1254/2635] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:31 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:32.135640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2ffb5870-09ad-4d71-8d31-f3c4e6b8922f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:32.136363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2ffb5870-09ad-4d71-8d31-f3c4e6b8922f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:32.142654 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ffb5870-09ad-4d71-8d31-f3c4e6b8922f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:32.143100 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ffb5870-09ad-4d71-8d31-f3c4e6b8922f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:32.144397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ffb5870-09ad-4d71-8d31-f3c4e6b8922f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:32.144834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2ffb5870-09ad-4d71-8d31-f3c4e6b8922f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:32.158192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-2ffb5870-09ad-4d71-8d31-f3c4e6b8922f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] HTTP exception thrown: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2ffb5870-09ad-4d71-8d31-f3c4e6b8922f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Request method failure captured: Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 HTTP/1.1 Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisByYZRAmmeV_xJRAsbXax6y3B16P9HTxXDu_RStWYF4tfJaAXTTfF-zs2-agzoeE2gxpRHCHOydhiXF9KSQ8PspeytJOiyka0y3ShrutaYLijgw-aKsyKSWnWxZpTsE2ClphDdXzYi2VUfotFEg9t7IdaO-FEkMA4t8M6UbOx91oBb0 Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 0e19a3f933284f088747a9d623e9ec24 Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeTestJSON-864634126 Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:38:32.160621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:38:32.163055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:38:32.163055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeTestJSON-864634126 Jun 20 07:38:32.163055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 0e19a3f933284f088747a9d623e9ec24 Jun 20 07:38:32.163055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeTestJSON-864634126 Jun 20 07:38:32.163055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeTestJSON-864634126-project Jun 20 07:38:32.163055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:38:32.163055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:38:32.163055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 785140aa617e46608e8b3cf89aac5a44 Jun 20 07:38:32.163055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeTestJSON-864634126-project Jun 20 07:38:32.163055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:38:32.163055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:32.163055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '8797f201-711b-4299-8eaa-bb430cec1210'} Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:38:32.164458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:32.166926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:38:32.168432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2ffb5870-09ad-4d71-8d31-f3c4e6b8922f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Returning 404 to user: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:38:32.168432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2ffb5870-09ad-4d71-8d31-f3c4e6b8922f tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 404 len: 111 microversion: 2.1 time: 0.032473 Jun 20 07:38:32.168432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1382/2636] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:32 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:38:32.174027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4ddec951-0f81-4175-80af-cde31aa34584 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '.version_select at 0x7ffa30517a60>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:32.193025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4ddec951-0f81-4175-80af-cde31aa34584 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-268247677" status: 202 len: 0 microversion: 2.1 time: 0.022853 Jun 20 07:38:32.193822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1255/2637] 10.222.0.23 () {58 vars in 1217 bytes} [Mon Jun 20 07:38:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-268247677 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:38:32.938794 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a5d31f1f-ac4e-4035-a7c4-ce00144a275e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:32.939421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a5d31f1f-ac4e-4035-a7c4-ce00144a275e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:32.946150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5d31f1f-ac4e-4035-a7c4-ce00144a275e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:32.946619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5d31f1f-ac4e-4035-a7c4-ce00144a275e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:32.947369 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5d31f1f-ac4e-4035-a7c4-ce00144a275e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:32.947826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a5d31f1f-ac4e-4035-a7c4-ce00144a275e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:33.035606 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-93c80206-809f-4005-b8b4-e19ae466fa83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:33.036234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-93c80206-809f-4005-b8b4-e19ae466fa83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:33.043334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93c80206-809f-4005-b8b4-e19ae466fa83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:33.043887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93c80206-809f-4005-b8b4-e19ae466fa83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:33.044783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93c80206-809f-4005-b8b4-e19ae466fa83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:33.045302 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93c80206-809f-4005-b8b4-e19ae466fa83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:33.060735 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-93c80206-809f-4005-b8b4-e19ae466fa83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] HTTP exception thrown: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-93c80206-809f-4005-b8b4-e19ae466fa83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Request method failure captured: Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 HTTP/1.1 Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByYZRAmmeV_xJRAsbXax6y3B16P9HTxXDu_RStWYF4tfJaAXTTfF-zs2-agzoeE2gxpRHCHOydhiXF9KSQ8PspeytJOiyka0y3ShrutaYLijgw-aKsyKSWnWxZpTsE2ClphDdXzYi2VUfotFEg9t7IdaO-FEkMA4t8M6UbOx91oBb0 Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 0e19a3f933284f088747a9d623e9ec24 Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeTestJSON-864634126 Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:38:33.062612 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:38:33.064456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:38:33.064456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeTestJSON-864634126 Jun 20 07:38:33.064456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 0e19a3f933284f088747a9d623e9ec24 Jun 20 07:38:33.064456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeTestJSON-864634126 Jun 20 07:38:33.064456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeTestJSON-864634126-project Jun 20 07:38:33.064456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:38:33.064456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:38:33.064456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: 785140aa617e46608e8b3cf89aac5a44 Jun 20 07:38:33.064456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeTestJSON-864634126-project Jun 20 07:38:33.064456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:38:33.064456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:33.064456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '8797f201-711b-4299-8eaa-bb430cec1210'} Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:38:33.066155 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:33.067832 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:38:33.070521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-93c80206-809f-4005-b8b4-e19ae466fa83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Returning 404 to user: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:38:33.070521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-93c80206-809f-4005-b8b4-e19ae466fa83 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 404 len: 111 microversion: 2.1 time: 0.035138 Jun 20 07:38:33.075810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1256/2638] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:38:33 2022] DELETE /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:38:33.087682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a3fbe19-e889-41fa-b403-ff40e6e166dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:33.091839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6a3fbe19-e889-41fa-b403-ff40e6e166dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 8797f201-711b-4299-8eaa-bb430cec1210] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:33.093334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a5d31f1f-ac4e-4035-a7c4-ce00144a275e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:33.104600 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a5d31f1f-ac4e-4035-a7c4-ce00144a275e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.169604 Jun 20 07:38:33.105484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1383/2639] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:32 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:33.106745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a3fbe19-e889-41fa-b403-ff40e6e166dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:33.107313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a3fbe19-e889-41fa-b403-ff40e6e166dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:33.108216 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a3fbe19-e889-41fa-b403-ff40e6e166dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:33.108753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a3fbe19-e889-41fa-b403-ff40e6e166dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:33.124989 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-6a3fbe19-e889-41fa-b403-ff40e6e166dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] HTTP exception thrown: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a3fbe19-e889-41fa-b403-ff40e6e166dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Request method failure captured: Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 HTTP/1.1 Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByYZRAmmeV_xJRAsbXax6y3B16P9HTxXDu_RStWYF4tfJaAXTTfF-zs2-agzoeE2gxpRHCHOydhiXF9KSQ8PspeytJOiyka0y3ShrutaYLijgw-aKsyKSWnWxZpTsE2ClphDdXzYi2VUfotFEg9t7IdaO-FEkMA4t8M6UbOx91oBb0 Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 0e19a3f933284f088747a9d623e9ec24 Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeTestJSON-864634126 Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:38:33.126824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:38:33.129430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:38:33.129430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeTestJSON-864634126 Jun 20 07:38:33.129430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 0e19a3f933284f088747a9d623e9ec24 Jun 20 07:38:33.129430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeTestJSON-864634126 Jun 20 07:38:33.129430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeTestJSON-864634126-project Jun 20 07:38:33.129430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:38:33.129430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:38:33.129430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: 785140aa617e46608e8b3cf89aac5a44 Jun 20 07:38:33.129430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeTestJSON-864634126-project Jun 20 07:38:33.129430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:38:33.129430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:33.129430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '8797f201-711b-4299-8eaa-bb430cec1210'} Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:38:33.130500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. Jun 20 07:38:33.132210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:38:33.133814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a3fbe19-e889-41fa-b403-ff40e6e166dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Returning 404 to user: Instance 8797f201-711b-4299-8eaa-bb430cec1210 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:38:33.133814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6a3fbe19-e889-41fa-b403-ff40e6e166dc tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210" status: 404 len: 111 microversion: 2.1 time: 0.046753 Jun 20 07:38:33.133814 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1257/2640] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:33 2022] GET /compute/v2.1/servers/8797f201-711b-4299-8eaa-bb430cec1210 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:38:34.122080 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-82fcd198-1da4-4a82-9517-500d6f849b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:34.122699 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-82fcd198-1da4-4a82-9517-500d6f849b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:34.129569 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82fcd198-1da4-4a82-9517-500d6f849b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:34.130020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82fcd198-1da4-4a82-9517-500d6f849b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:34.130779 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82fcd198-1da4-4a82-9517-500d6f849b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:34.131218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82fcd198-1da4-4a82-9517-500d6f849b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:34.273676 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-82fcd198-1da4-4a82-9517-500d6f849b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:34.281514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-82fcd198-1da4-4a82-9517-500d6f849b14 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.163250 Jun 20 07:38:34.282074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1384/2641] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:35.298453 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-18267f98-8561-4174-ad25-23e973b00313 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:35.299068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-18267f98-8561-4174-ad25-23e973b00313 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:35.305735 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18267f98-8561-4174-ad25-23e973b00313 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:35.306184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18267f98-8561-4174-ad25-23e973b00313 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:35.306938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18267f98-8561-4174-ad25-23e973b00313 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:35.307372 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18267f98-8561-4174-ad25-23e973b00313 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:35.431448 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-18267f98-8561-4174-ad25-23e973b00313 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:35.439414 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-18267f98-8561-4174-ad25-23e973b00313 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144947 Jun 20 07:38:35.439970 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1258/2642] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:35 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:36.456761 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a8786e5b-ec41-4e0e-b87e-8f3f5e225ceb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:36.457365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a8786e5b-ec41-4e0e-b87e-8f3f5e225ceb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:36.463945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8786e5b-ec41-4e0e-b87e-8f3f5e225ceb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:36.464417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8786e5b-ec41-4e0e-b87e-8f3f5e225ceb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:36.465166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8786e5b-ec41-4e0e-b87e-8f3f5e225ceb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:36.465597 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a8786e5b-ec41-4e0e-b87e-8f3f5e225ceb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:36.593087 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a8786e5b-ec41-4e0e-b87e-8f3f5e225ceb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:36.601570 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a8786e5b-ec41-4e0e-b87e-8f3f5e225ceb tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148657 Jun 20 07:38:36.602124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1385/2643] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:36 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:37.618502 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-57f5432d-bed3-4808-b00e-99bc71689ced tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:37.619126 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-57f5432d-bed3-4808-b00e-99bc71689ced tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:37.625502 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57f5432d-bed3-4808-b00e-99bc71689ced tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:37.626210 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57f5432d-bed3-4808-b00e-99bc71689ced tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:37.626959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57f5432d-bed3-4808-b00e-99bc71689ced tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:37.627388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57f5432d-bed3-4808-b00e-99bc71689ced tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:37.754252 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-57f5432d-bed3-4808-b00e-99bc71689ced tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:37.762114 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-57f5432d-bed3-4808-b00e-99bc71689ced tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147500 Jun 20 07:38:37.762670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1259/2644] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:37 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:38.778920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-933d14d6-c01a-41a5-828b-829023c09446 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:38.779526 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-933d14d6-c01a-41a5-828b-829023c09446 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:38.787901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-933d14d6-c01a-41a5-828b-829023c09446 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:38.788370 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-933d14d6-c01a-41a5-828b-829023c09446 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:38.789126 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-933d14d6-c01a-41a5-828b-829023c09446 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:38.789555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-933d14d6-c01a-41a5-828b-829023c09446 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:38.926738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-933d14d6-c01a-41a5-828b-829023c09446 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:38.934498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-933d14d6-c01a-41a5-828b-829023c09446 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.159433 Jun 20 07:38:38.935058 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1386/2645] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:38 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:39.951344 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6cb5b157-052d-4e86-ab34-1b7fad107980 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:39.951952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6cb5b157-052d-4e86-ab34-1b7fad107980 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:39.958473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cb5b157-052d-4e86-ab34-1b7fad107980 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:39.958858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cb5b157-052d-4e86-ab34-1b7fad107980 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:39.959604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cb5b157-052d-4e86-ab34-1b7fad107980 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:39.960037 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6cb5b157-052d-4e86-ab34-1b7fad107980 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:40.087319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6cb5b157-052d-4e86-ab34-1b7fad107980 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:40.095143 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6cb5b157-052d-4e86-ab34-1b7fad107980 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147637 Jun 20 07:38:40.095694 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1260/2646] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:39 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:41.113073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1acc3f8b-1c82-4ecd-831c-60292c76833e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:41.113686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1acc3f8b-1c82-4ecd-831c-60292c76833e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:41.120218 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1acc3f8b-1c82-4ecd-831c-60292c76833e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:41.120666 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1acc3f8b-1c82-4ecd-831c-60292c76833e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:41.121417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1acc3f8b-1c82-4ecd-831c-60292c76833e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:41.121853 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1acc3f8b-1c82-4ecd-831c-60292c76833e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:41.247691 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1acc3f8b-1c82-4ecd-831c-60292c76833e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:41.256494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1acc3f8b-1c82-4ecd-831c-60292c76833e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147832 Jun 20 07:38:41.257062 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1387/2647] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:42.273656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f5202c2e-19d3-4723-af66-f1f2c31a4610 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:42.274276 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f5202c2e-19d3-4723-af66-f1f2c31a4610 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:42.280756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5202c2e-19d3-4723-af66-f1f2c31a4610 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:42.281205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5202c2e-19d3-4723-af66-f1f2c31a4610 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:42.281959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5202c2e-19d3-4723-af66-f1f2c31a4610 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:42.282419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5202c2e-19d3-4723-af66-f1f2c31a4610 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:42.416376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f5202c2e-19d3-4723-af66-f1f2c31a4610 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:42.425181 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f5202c2e-19d3-4723-af66-f1f2c31a4610 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.154801 Jun 20 07:38:42.426213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1261/2648] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:42 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:43.442324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c4287992-a614-470c-8f24-feab60764dbf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:43.442946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c4287992-a614-470c-8f24-feab60764dbf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:43.449549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4287992-a614-470c-8f24-feab60764dbf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:43.449997 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4287992-a614-470c-8f24-feab60764dbf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:43.450763 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4287992-a614-470c-8f24-feab60764dbf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:43.451204 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c4287992-a614-470c-8f24-feab60764dbf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:43.623215 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c4287992-a614-470c-8f24-feab60764dbf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:43.631509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c4287992-a614-470c-8f24-feab60764dbf tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.193036 Jun 20 07:38:43.632080 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1388/2649] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:43 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:44.649474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fec2edf5-8e88-4eb2-b985-435dee4b1a38 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:44.650089 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fec2edf5-8e88-4eb2-b985-435dee4b1a38 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:44.656558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fec2edf5-8e88-4eb2-b985-435dee4b1a38 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:44.657005 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fec2edf5-8e88-4eb2-b985-435dee4b1a38 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:44.657758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fec2edf5-8e88-4eb2-b985-435dee4b1a38 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:44.658194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fec2edf5-8e88-4eb2-b985-435dee4b1a38 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:44.787781 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fec2edf5-8e88-4eb2-b985-435dee4b1a38 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:44.795638 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fec2edf5-8e88-4eb2-b985-435dee4b1a38 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150056 Jun 20 07:38:44.796221 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1262/2650] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:45.812659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-20298f97-1dd7-4c02-a478-e2ee01c2ab8a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:45.813276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-20298f97-1dd7-4c02-a478-e2ee01c2ab8a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:45.819725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20298f97-1dd7-4c02-a478-e2ee01c2ab8a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:45.820208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20298f97-1dd7-4c02-a478-e2ee01c2ab8a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:45.820984 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20298f97-1dd7-4c02-a478-e2ee01c2ab8a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:45.821427 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20298f97-1dd7-4c02-a478-e2ee01c2ab8a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:45.948256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20298f97-1dd7-4c02-a478-e2ee01c2ab8a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:45.956587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-20298f97-1dd7-4c02-a478-e2ee01c2ab8a tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147842 Jun 20 07:38:45.957147 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1389/2651] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:46.973902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f73684de-4f37-4d8d-93ac-7edee10bcfb8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:46.974471 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f73684de-4f37-4d8d-93ac-7edee10bcfb8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:46.981071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f73684de-4f37-4d8d-93ac-7edee10bcfb8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:46.981525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f73684de-4f37-4d8d-93ac-7edee10bcfb8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:46.982274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f73684de-4f37-4d8d-93ac-7edee10bcfb8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:46.982714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f73684de-4f37-4d8d-93ac-7edee10bcfb8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:47.108161 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f73684de-4f37-4d8d-93ac-7edee10bcfb8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:47.116064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f73684de-4f37-4d8d-93ac-7edee10bcfb8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146613 Jun 20 07:38:47.116644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1263/2652] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:48.133701 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f0c37093-bd85-4dc1-9b0b-ad991a2fc380 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:48.134327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f0c37093-bd85-4dc1-9b0b-ad991a2fc380 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:48.140838 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0c37093-bd85-4dc1-9b0b-ad991a2fc380 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:48.141285 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0c37093-bd85-4dc1-9b0b-ad991a2fc380 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:48.142040 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0c37093-bd85-4dc1-9b0b-ad991a2fc380 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:48.142474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f0c37093-bd85-4dc1-9b0b-ad991a2fc380 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:48.274898 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f0c37093-bd85-4dc1-9b0b-ad991a2fc380 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:48.282676 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f0c37093-bd85-4dc1-9b0b-ad991a2fc380 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152833 Jun 20 07:38:48.283233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1390/2653] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:48 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:38:49.299215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2025dcfc-05ff-4dce-9cad-788b35d12f55 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:49.299829 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2025dcfc-05ff-4dce-9cad-788b35d12f55 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:49.306309 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2025dcfc-05ff-4dce-9cad-788b35d12f55 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:49.306756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2025dcfc-05ff-4dce-9cad-788b35d12f55 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:49.307506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2025dcfc-05ff-4dce-9cad-788b35d12f55 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:49.307942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2025dcfc-05ff-4dce-9cad-788b35d12f55 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:49.434535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2025dcfc-05ff-4dce-9cad-788b35d12f55 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:49.443232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2025dcfc-05ff-4dce-9cad-788b35d12f55 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147920 Jun 20 07:38:49.443793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1264/2654] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:50.461148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-dffbe98e-d5f3-4a38-a6d4-6959c5e3aef3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:50.461744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-dffbe98e-d5f3-4a38-a6d4-6959c5e3aef3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:50.468359 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dffbe98e-d5f3-4a38-a6d4-6959c5e3aef3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:50.468904 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dffbe98e-d5f3-4a38-a6d4-6959c5e3aef3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:50.469677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dffbe98e-d5f3-4a38-a6d4-6959c5e3aef3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:50.470121 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-dffbe98e-d5f3-4a38-a6d4-6959c5e3aef3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:50.601418 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-dffbe98e-d5f3-4a38-a6d4-6959c5e3aef3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:50.609270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-dffbe98e-d5f3-4a38-a6d4-6959c5e3aef3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.153020 Jun 20 07:38:50.609829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1391/2655] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:51.625956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-897887b2-e26b-482e-a8f8-176903542121 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:51.626585 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-897887b2-e26b-482e-a8f8-176903542121 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:51.632636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-897887b2-e26b-482e-a8f8-176903542121 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:51.633090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-897887b2-e26b-482e-a8f8-176903542121 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:51.633849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-897887b2-e26b-482e-a8f8-176903542121 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:51.634293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-897887b2-e26b-482e-a8f8-176903542121 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:51.761784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-897887b2-e26b-482e-a8f8-176903542121 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:51.770285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-897887b2-e26b-482e-a8f8-176903542121 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148602 Jun 20 07:38:51.770847 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1265/2656] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:52.581371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:38:52.581543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:38:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:38:52.787655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7fb0a9fc-c8ce-4c9a-b7b4-e5a01fc63957 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:52.788292 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7fb0a9fc-c8ce-4c9a-b7b4-e5a01fc63957 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:52.794795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fb0a9fc-c8ce-4c9a-b7b4-e5a01fc63957 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:52.795245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fb0a9fc-c8ce-4c9a-b7b4-e5a01fc63957 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:52.795997 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fb0a9fc-c8ce-4c9a-b7b4-e5a01fc63957 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:52.796473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7fb0a9fc-c8ce-4c9a-b7b4-e5a01fc63957 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:52.920557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7fb0a9fc-c8ce-4c9a-b7b4-e5a01fc63957 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:52.928978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7fb0a9fc-c8ce-4c9a-b7b4-e5a01fc63957 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145679 Jun 20 07:38:52.929550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1392/2657] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:53.946644 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d36098c-af72-4ef0-8f41-50e70f03fc76 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:53.947274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d36098c-af72-4ef0-8f41-50e70f03fc76 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:53.949545 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:38:53.955109 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d36098c-af72-4ef0-8f41-50e70f03fc76 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:53.955551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d36098c-af72-4ef0-8f41-50e70f03fc76 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:53.956337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d36098c-af72-4ef0-8f41-50e70f03fc76 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:53.956768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d36098c-af72-4ef0-8f41-50e70f03fc76 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:53.959702 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=94 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:38:54.086116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d36098c-af72-4ef0-8f41-50e70f03fc76 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:54.093920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d36098c-af72-4ef0-8f41-50e70f03fc76 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151159 Jun 20 07:38:54.094468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1266/2658] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:55.111915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5a405470-d117-4da8-b397-c8fa1fa1e88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:55.112553 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5a405470-d117-4da8-b397-c8fa1fa1e88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:55.119027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a405470-d117-4da8-b397-c8fa1fa1e88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:55.119481 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a405470-d117-4da8-b397-c8fa1fa1e88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:55.120270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a405470-d117-4da8-b397-c8fa1fa1e88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:55.120741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a405470-d117-4da8-b397-c8fa1fa1e88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:55.136264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:38:55.248878 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5a405470-d117-4da8-b397-c8fa1fa1e88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:55.257440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5a405470-d117-4da8-b397-c8fa1fa1e88d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149401 Jun 20 07:38:55.258001 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1393/2659] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:55 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:56.274816 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-77642aa1-42b4-478d-8fcc-76906a04ffed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:56.275437 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-77642aa1-42b4-478d-8fcc-76906a04ffed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:56.281877 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77642aa1-42b4-478d-8fcc-76906a04ffed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:56.282328 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77642aa1-42b4-478d-8fcc-76906a04ffed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:56.283087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77642aa1-42b4-478d-8fcc-76906a04ffed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:56.283527 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77642aa1-42b4-478d-8fcc-76906a04ffed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:56.415955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-77642aa1-42b4-478d-8fcc-76906a04ffed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:56.423783 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-77642aa1-42b4-478d-8fcc-76906a04ffed tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152842 Jun 20 07:38:56.424371 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1267/2660] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:57.441224 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f4864f4f-3188-46ab-a272-6f7b97561233 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:57.441834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f4864f4f-3188-46ab-a272-6f7b97561233 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:57.444230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:38:57.450006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4864f4f-3188-46ab-a272-6f7b97561233 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:57.450454 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4864f4f-3188-46ab-a272-6f7b97561233 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:57.451213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4864f4f-3188-46ab-a272-6f7b97561233 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:57.451644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f4864f4f-3188-46ab-a272-6f7b97561233 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:57.578902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f4864f4f-3188-46ab-a272-6f7b97561233 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:57.587496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f4864f4f-3188-46ab-a272-6f7b97561233 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150099 Jun 20 07:38:57.588089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1394/2661] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:57 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:58.609310 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-42c1c773-edf2-4405-a01a-b463a138d0f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:58.609933 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-42c1c773-edf2-4405-a01a-b463a138d0f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:58.616968 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42c1c773-edf2-4405-a01a-b463a138d0f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:58.617464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42c1c773-edf2-4405-a01a-b463a138d0f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:58.618225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42c1c773-edf2-4405-a01a-b463a138d0f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:58.618665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42c1c773-edf2-4405-a01a-b463a138d0f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:58.752087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-42c1c773-edf2-4405-a01a-b463a138d0f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:58.760070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-42c1c773-edf2-4405-a01a-b463a138d0f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.154636 Jun 20 07:38:58.760667 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1268/2662] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:38:59.776212 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5b6268d8-1474-4b1c-af68-39e4ce9a736b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:38:59.776820 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5b6268d8-1474-4b1c-af68-39e4ce9a736b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:38:59.783311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b6268d8-1474-4b1c-af68-39e4ce9a736b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:59.783757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b6268d8-1474-4b1c-af68-39e4ce9a736b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:59.784524 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b6268d8-1474-4b1c-af68-39e4ce9a736b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:38:59.784959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5b6268d8-1474-4b1c-af68-39e4ce9a736b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:38:59.910114 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5b6268d8-1474-4b1c-af68-39e4ce9a736b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:38:59.917990 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5b6268d8-1474-4b1c-af68-39e4ce9a736b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145607 Jun 20 07:38:59.918561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1395/2663] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:38:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:00.935533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6e6773c3-44c2-41a2-bbb1-ec932ab294ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:00.936069 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6e6773c3-44c2-41a2-bbb1-ec932ab294ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:00.942581 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e6773c3-44c2-41a2-bbb1-ec932ab294ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:00.943022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e6773c3-44c2-41a2-bbb1-ec932ab294ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:00.943801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e6773c3-44c2-41a2-bbb1-ec932ab294ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:00.944267 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6e6773c3-44c2-41a2-bbb1-ec932ab294ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:01.069234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6e6773c3-44c2-41a2-bbb1-ec932ab294ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:01.077045 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6e6773c3-44c2-41a2-bbb1-ec932ab294ac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145477 Jun 20 07:39:01.077604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1269/2664] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:00 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:02.095221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-301cc26c-6f3d-472e-8099-a4ae6fd066fc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:02.095856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-301cc26c-6f3d-472e-8099-a4ae6fd066fc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:02.102413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-301cc26c-6f3d-472e-8099-a4ae6fd066fc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:02.102862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-301cc26c-6f3d-472e-8099-a4ae6fd066fc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:02.103618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-301cc26c-6f3d-472e-8099-a4ae6fd066fc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:02.104057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-301cc26c-6f3d-472e-8099-a4ae6fd066fc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:02.231054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-301cc26c-6f3d-472e-8099-a4ae6fd066fc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:02.239478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-301cc26c-6f3d-472e-8099-a4ae6fd066fc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148079 Jun 20 07:39:02.240039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1396/2665] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:03.257574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-76af751f-dc2b-44e9-abc8-90234526b9f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:03.258227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-76af751f-dc2b-44e9-abc8-90234526b9f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:03.264680 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76af751f-dc2b-44e9-abc8-90234526b9f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:03.265132 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76af751f-dc2b-44e9-abc8-90234526b9f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:03.265897 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76af751f-dc2b-44e9-abc8-90234526b9f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:03.266340 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-76af751f-dc2b-44e9-abc8-90234526b9f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:03.391376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-76af751f-dc2b-44e9-abc8-90234526b9f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:03.399318 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-76af751f-dc2b-44e9-abc8-90234526b9f2 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145738 Jun 20 07:39:03.399879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1270/2666] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:03 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:04.416432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-28afa465-682b-47d9-8ef5-f2975f77b611 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:04.417035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-28afa465-682b-47d9-8ef5-f2975f77b611 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:04.423057 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28afa465-682b-47d9-8ef5-f2975f77b611 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:04.423499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28afa465-682b-47d9-8ef5-f2975f77b611 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:04.424270 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28afa465-682b-47d9-8ef5-f2975f77b611 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:04.425474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28afa465-682b-47d9-8ef5-f2975f77b611 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:04.564008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-28afa465-682b-47d9-8ef5-f2975f77b611 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:04.572569 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-28afa465-682b-47d9-8ef5-f2975f77b611 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.160148 Jun 20 07:39:04.573132 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1397/2667] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:04 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:05.589486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dcd8baa1-f041-43ae-ad35-823094e40198 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:05.590091 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dcd8baa1-f041-43ae-ad35-823094e40198 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:05.596539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcd8baa1-f041-43ae-ad35-823094e40198 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:05.596988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcd8baa1-f041-43ae-ad35-823094e40198 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:05.597732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcd8baa1-f041-43ae-ad35-823094e40198 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:05.598161 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dcd8baa1-f041-43ae-ad35-823094e40198 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:05.724838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dcd8baa1-f041-43ae-ad35-823094e40198 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:05.732663 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dcd8baa1-f041-43ae-ad35-823094e40198 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147073 Jun 20 07:39:05.733219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1271/2668] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:05 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:06.749279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-9a2510d5-0d44-4c0c-99c8-a3daa3a177e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:06.749896 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-9a2510d5-0d44-4c0c-99c8-a3daa3a177e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:06.757338 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a2510d5-0d44-4c0c-99c8-a3daa3a177e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:06.757787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a2510d5-0d44-4c0c-99c8-a3daa3a177e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:06.758539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a2510d5-0d44-4c0c-99c8-a3daa3a177e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:06.758972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-9a2510d5-0d44-4c0c-99c8-a3daa3a177e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:06.883411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-9a2510d5-0d44-4c0c-99c8-a3daa3a177e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:06.891188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-9a2510d5-0d44-4c0c-99c8-a3daa3a177e8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145757 Jun 20 07:39:06.891755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1398/2669] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:06 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:07.908023 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-afcb9f76-4103-4c6c-a188-02fc692b79c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:07.908595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-afcb9f76-4103-4c6c-a188-02fc692b79c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:07.915033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afcb9f76-4103-4c6c-a188-02fc692b79c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:07.915485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afcb9f76-4103-4c6c-a188-02fc692b79c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:07.916274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afcb9f76-4103-4c6c-a188-02fc692b79c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:07.916713 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afcb9f76-4103-4c6c-a188-02fc692b79c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:08.044550 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-afcb9f76-4103-4c6c-a188-02fc692b79c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:08.052495 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-afcb9f76-4103-4c6c-a188-02fc692b79c8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148348 Jun 20 07:39:08.053061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1272/2670] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:07 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:09.069604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7128dbc1-1cc7-404c-bd42-0e32911355e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:09.070217 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7128dbc1-1cc7-404c-bd42-0e32911355e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:09.076933 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7128dbc1-1cc7-404c-bd42-0e32911355e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:09.077417 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7128dbc1-1cc7-404c-bd42-0e32911355e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:09.078185 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7128dbc1-1cc7-404c-bd42-0e32911355e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:09.078624 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7128dbc1-1cc7-404c-bd42-0e32911355e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:09.208011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7128dbc1-1cc7-404c-bd42-0e32911355e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:09.215889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7128dbc1-1cc7-404c-bd42-0e32911355e6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150116 Jun 20 07:39:09.216557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1399/2671] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:09 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:10.233639 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2eb85da8-5a96-43a7-821e-84cfd79f44f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:10.234266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2eb85da8-5a96-43a7-821e-84cfd79f44f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:10.241619 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eb85da8-5a96-43a7-821e-84cfd79f44f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:10.242072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eb85da8-5a96-43a7-821e-84cfd79f44f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:10.242831 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eb85da8-5a96-43a7-821e-84cfd79f44f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:10.243274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2eb85da8-5a96-43a7-821e-84cfd79f44f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:10.375955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2eb85da8-5a96-43a7-821e-84cfd79f44f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:10.383834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2eb85da8-5a96-43a7-821e-84cfd79f44f4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.154045 Jun 20 07:39:10.384430 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1273/2672] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:10 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:11.400711 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-20a3348b-95a9-4cd6-bfb1-ec4f28ad7e20 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:11.401725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-20a3348b-95a9-4cd6-bfb1-ec4f28ad7e20 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:11.407816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20a3348b-95a9-4cd6-bfb1-ec4f28ad7e20 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:11.408298 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20a3348b-95a9-4cd6-bfb1-ec4f28ad7e20 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:11.409074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20a3348b-95a9-4cd6-bfb1-ec4f28ad7e20 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:11.409509 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-20a3348b-95a9-4cd6-bfb1-ec4f28ad7e20 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:11.536354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-20a3348b-95a9-4cd6-bfb1-ec4f28ad7e20 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:11.544260 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-20a3348b-95a9-4cd6-bfb1-ec4f28ad7e20 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147404 Jun 20 07:39:11.544829 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1400/2673] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:11 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:12.561771 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-72ded01e-2499-4dbc-a2e8-23e7b0eeb1d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:12.562405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-72ded01e-2499-4dbc-a2e8-23e7b0eeb1d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:12.569352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ded01e-2499-4dbc-a2e8-23e7b0eeb1d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:12.569802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ded01e-2499-4dbc-a2e8-23e7b0eeb1d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:12.570553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ded01e-2499-4dbc-a2e8-23e7b0eeb1d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:12.570986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ded01e-2499-4dbc-a2e8-23e7b0eeb1d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:12.702172 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-72ded01e-2499-4dbc-a2e8-23e7b0eeb1d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:12.710068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-72ded01e-2499-4dbc-a2e8-23e7b0eeb1d6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152174 Jun 20 07:39:12.710682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1274/2674] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:12 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:13.726651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2d314662-4154-4567-8674-55111fac0378 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:13.727264 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2d314662-4154-4567-8674-55111fac0378 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:13.733767 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d314662-4154-4567-8674-55111fac0378 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:13.734216 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d314662-4154-4567-8674-55111fac0378 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:13.734971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d314662-4154-4567-8674-55111fac0378 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:13.735405 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2d314662-4154-4567-8674-55111fac0378 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:13.861584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2d314662-4154-4567-8674-55111fac0378 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:13.869463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2d314662-4154-4567-8674-55111fac0378 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146650 Jun 20 07:39:13.870031 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1401/2675] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:13 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:14.887232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-52a33e33-9814-43f4-8fba-a87a6276a888 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:14.887805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-52a33e33-9814-43f4-8fba-a87a6276a888 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:14.894754 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52a33e33-9814-43f4-8fba-a87a6276a888 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:14.895201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52a33e33-9814-43f4-8fba-a87a6276a888 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:14.895949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52a33e33-9814-43f4-8fba-a87a6276a888 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:14.896415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-52a33e33-9814-43f4-8fba-a87a6276a888 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:15.019505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-52a33e33-9814-43f4-8fba-a87a6276a888 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:15.027370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-52a33e33-9814-43f4-8fba-a87a6276a888 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144073 Jun 20 07:39:15.027935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1275/2676] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:14 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:16.044841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-13acbf55-d38f-4b6c-b598-7f9ae5f7df5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:16.045486 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-13acbf55-d38f-4b6c-b598-7f9ae5f7df5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:16.052626 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13acbf55-d38f-4b6c-b598-7f9ae5f7df5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:16.053073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13acbf55-d38f-4b6c-b598-7f9ae5f7df5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:16.053828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13acbf55-d38f-4b6c-b598-7f9ae5f7df5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:16.054262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-13acbf55-d38f-4b6c-b598-7f9ae5f7df5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:16.181021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-13acbf55-d38f-4b6c-b598-7f9ae5f7df5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:16.188868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-13acbf55-d38f-4b6c-b598-7f9ae5f7df5c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147905 Jun 20 07:39:16.189435 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1402/2677] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:16 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:16.438078 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:39:16.438632 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:39:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:39:17.205786 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-57ef0665-3b45-41fa-b1fb-a98b31f3e6d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:17.206407 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-57ef0665-3b45-41fa-b1fb-a98b31f3e6d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:17.212931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57ef0665-3b45-41fa-b1fb-a98b31f3e6d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:17.213385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57ef0665-3b45-41fa-b1fb-a98b31f3e6d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:17.214140 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57ef0665-3b45-41fa-b1fb-a98b31f3e6d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:17.214579 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57ef0665-3b45-41fa-b1fb-a98b31f3e6d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:17.338573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-57ef0665-3b45-41fa-b1fb-a98b31f3e6d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:17.346445 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-57ef0665-3b45-41fa-b1fb-a98b31f3e6d4 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144504 Jun 20 07:39:17.347015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1276/2678] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:17 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:18.363713 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b1597cd1-4b08-409b-bf5e-2b8e46bb029b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:18.364357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b1597cd1-4b08-409b-bf5e-2b8e46bb029b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:18.370823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1597cd1-4b08-409b-bf5e-2b8e46bb029b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:18.371302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1597cd1-4b08-409b-bf5e-2b8e46bb029b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:18.372063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1597cd1-4b08-409b-bf5e-2b8e46bb029b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:18.372533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1597cd1-4b08-409b-bf5e-2b8e46bb029b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:18.501909 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b1597cd1-4b08-409b-bf5e-2b8e46bb029b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:18.510166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b1597cd1-4b08-409b-bf5e-2b8e46bb029b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150418 Jun 20 07:39:18.510724 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1403/2679] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:18 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:19.527668 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-542d16ef-210d-4b3b-8116-40a5c0e577dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:19.528316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-542d16ef-210d-4b3b-8116-40a5c0e577dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:19.534979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-542d16ef-210d-4b3b-8116-40a5c0e577dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:19.535452 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-542d16ef-210d-4b3b-8116-40a5c0e577dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:19.536242 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-542d16ef-210d-4b3b-8116-40a5c0e577dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:19.536684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-542d16ef-210d-4b3b-8116-40a5c0e577dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:19.660053 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-542d16ef-210d-4b3b-8116-40a5c0e577dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:19.667915 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-542d16ef-210d-4b3b-8116-40a5c0e577dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144435 Jun 20 07:39:19.668499 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1277/2680] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:19 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:20.685006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-948b4854-f81d-4265-9744-fcfcf3f7380f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:20.685614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-948b4854-f81d-4265-9744-fcfcf3f7380f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:20.692586 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-948b4854-f81d-4265-9744-fcfcf3f7380f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:20.693039 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-948b4854-f81d-4265-9744-fcfcf3f7380f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:20.693795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-948b4854-f81d-4265-9744-fcfcf3f7380f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:20.694230 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-948b4854-f81d-4265-9744-fcfcf3f7380f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:20.825800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-948b4854-f81d-4265-9744-fcfcf3f7380f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:20.833823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-948b4854-f81d-4265-9744-fcfcf3f7380f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152633 Jun 20 07:39:20.834386 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1404/2681] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:20 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:21.850578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9eb8e1ae-6089-4563-88dc-a2ca892cfccc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:21.851225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9eb8e1ae-6089-4563-88dc-a2ca892cfccc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:21.857758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9eb8e1ae-6089-4563-88dc-a2ca892cfccc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:21.858209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9eb8e1ae-6089-4563-88dc-a2ca892cfccc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:21.858961 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9eb8e1ae-6089-4563-88dc-a2ca892cfccc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:21.859403 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9eb8e1ae-6089-4563-88dc-a2ca892cfccc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:21.989016 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9eb8e1ae-6089-4563-88dc-a2ca892cfccc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:21.996849 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9eb8e1ae-6089-4563-88dc-a2ca892cfccc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150193 Jun 20 07:39:21.997423 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1278/2682] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:21 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:23.014319 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8be37ab3-7dff-4d9c-9101-b4f77f67d05d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:23.014924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8be37ab3-7dff-4d9c-9101-b4f77f67d05d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:23.021499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8be37ab3-7dff-4d9c-9101-b4f77f67d05d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:23.021942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8be37ab3-7dff-4d9c-9101-b4f77f67d05d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:23.022686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8be37ab3-7dff-4d9c-9101-b4f77f67d05d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:23.023119 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8be37ab3-7dff-4d9c-9101-b4f77f67d05d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:23.153852 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8be37ab3-7dff-4d9c-9101-b4f77f67d05d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:23.162291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8be37ab3-7dff-4d9c-9101-b4f77f67d05d tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151812 Jun 20 07:39:23.162860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1405/2683] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:23 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:24.178859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-28907f54-12d8-4710-a1f6-7922459607cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:24.179485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-28907f54-12d8-4710-a1f6-7922459607cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:24.181819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=26 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:39:24.187010 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28907f54-12d8-4710-a1f6-7922459607cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:24.187467 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28907f54-12d8-4710-a1f6-7922459607cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:24.188280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28907f54-12d8-4710-a1f6-7922459607cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:24.188723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28907f54-12d8-4710-a1f6-7922459607cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:24.193364 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=78 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:39:24.317067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-28907f54-12d8-4710-a1f6-7922459607cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:24.324904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-28907f54-12d8-4710-a1f6-7922459607cc tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149971 Jun 20 07:39:24.325474 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1279/2684] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:24 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:25.342455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d75c8c3b-20cf-48b4-849a-2717c0157d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:25.343075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d75c8c3b-20cf-48b4-849a-2717c0157d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:25.350248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d75c8c3b-20cf-48b4-849a-2717c0157d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:25.350702 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d75c8c3b-20cf-48b4-849a-2717c0157d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:25.351458 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d75c8c3b-20cf-48b4-849a-2717c0157d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:25.351897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d75c8c3b-20cf-48b4-849a-2717c0157d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:25.355724 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=76 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:39:25.481354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d75c8c3b-20cf-48b4-849a-2717c0157d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:25.489327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d75c8c3b-20cf-48b4-849a-2717c0157d12 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150818 Jun 20 07:39:25.489888 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1406/2685] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:25 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:26.506669 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-39a694fd-437c-40d9-bf90-063c0151c379 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:26.507322 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-39a694fd-437c-40d9-bf90-063c0151c379 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:26.513838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39a694fd-437c-40d9-bf90-063c0151c379 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:26.514287 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39a694fd-437c-40d9-bf90-063c0151c379 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:26.515047 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39a694fd-437c-40d9-bf90-063c0151c379 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:26.515484 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-39a694fd-437c-40d9-bf90-063c0151c379 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:26.641504 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-39a694fd-437c-40d9-bf90-063c0151c379 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:26.649386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-39a694fd-437c-40d9-bf90-063c0151c379 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146575 Jun 20 07:39:26.649950 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1280/2686] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:26 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:27.666472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4f395e29-73aa-4143-8add-3a7ff5acd725 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:27.667085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4f395e29-73aa-4143-8add-3a7ff5acd725 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:27.669552 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=26 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:39:27.675556 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f395e29-73aa-4143-8add-3a7ff5acd725 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:27.676003 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f395e29-73aa-4143-8add-3a7ff5acd725 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:27.676801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f395e29-73aa-4143-8add-3a7ff5acd725 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:27.677236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4f395e29-73aa-4143-8add-3a7ff5acd725 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:28.031143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4f395e29-73aa-4143-8add-3a7ff5acd725 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:28.039561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4f395e29-73aa-4143-8add-3a7ff5acd725 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.377025 Jun 20 07:39:28.040148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1407/2687] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:27 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:29.056941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c1aba968-9125-4c55-a692-1ffa4e1aa546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:29.057590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c1aba968-9125-4c55-a692-1ffa4e1aa546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:29.063991 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1aba968-9125-4c55-a692-1ffa4e1aa546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:29.064470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1aba968-9125-4c55-a692-1ffa4e1aa546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:29.065222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1aba968-9125-4c55-a692-1ffa4e1aa546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:29.065820 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1aba968-9125-4c55-a692-1ffa4e1aa546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:29.201138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c1aba968-9125-4c55-a692-1ffa4e1aa546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:29.209377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c1aba968-9125-4c55-a692-1ffa4e1aa546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.156373 Jun 20 07:39:29.209940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1281/2688] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:29 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:30.226229 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f3bedfb8-bd2e-413b-a318-13b129e09d63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:30.226846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f3bedfb8-bd2e-413b-a318-13b129e09d63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:30.233612 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3bedfb8-bd2e-413b-a318-13b129e09d63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:30.234096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3bedfb8-bd2e-413b-a318-13b129e09d63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:30.234860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3bedfb8-bd2e-413b-a318-13b129e09d63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:30.235299 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f3bedfb8-bd2e-413b-a318-13b129e09d63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:30.364068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f3bedfb8-bd2e-413b-a318-13b129e09d63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:30.372985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f3bedfb8-bd2e-413b-a318-13b129e09d63 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150663 Jun 20 07:39:30.373640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1408/2689] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:30 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:31.390947 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-776797de-c994-4345-9f6c-947de0fbb2a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:31.391577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-776797de-c994-4345-9f6c-947de0fbb2a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:31.398652 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-776797de-c994-4345-9f6c-947de0fbb2a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:31.399312 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-776797de-c994-4345-9f6c-947de0fbb2a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:31.400087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-776797de-c994-4345-9f6c-947de0fbb2a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:31.400552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-776797de-c994-4345-9f6c-947de0fbb2a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:31.613570 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-776797de-c994-4345-9f6c-947de0fbb2a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:31.621555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-776797de-c994-4345-9f6c-947de0fbb2a6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.234477 Jun 20 07:39:31.622193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1282/2690] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:31 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:32.638563 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7e6b2dbd-9e5d-474f-b188-93331f500bac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:32.639177 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7e6b2dbd-9e5d-474f-b188-93331f500bac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:32.645721 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e6b2dbd-9e5d-474f-b188-93331f500bac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:32.646168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e6b2dbd-9e5d-474f-b188-93331f500bac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:32.646944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e6b2dbd-9e5d-474f-b188-93331f500bac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:32.647375 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7e6b2dbd-9e5d-474f-b188-93331f500bac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:32.774188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7e6b2dbd-9e5d-474f-b188-93331f500bac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:32.782001 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7e6b2dbd-9e5d-474f-b188-93331f500bac tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147266 Jun 20 07:39:32.782562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1409/2691] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:32 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:33.799084 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f6bf9546-e3e4-43e8-ae61-e0e28a0060dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:33.800246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f6bf9546-e3e4-43e8-ae61-e0e28a0060dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:33.806821 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6bf9546-e3e4-43e8-ae61-e0e28a0060dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:33.807275 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6bf9546-e3e4-43e8-ae61-e0e28a0060dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:33.808028 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6bf9546-e3e4-43e8-ae61-e0e28a0060dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:33.808491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6bf9546-e3e4-43e8-ae61-e0e28a0060dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:33.933307 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f6bf9546-e3e4-43e8-ae61-e0e28a0060dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:33.941810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f6bf9546-e3e4-43e8-ae61-e0e28a0060dd tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146610 Jun 20 07:39:33.942377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1283/2692] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:33 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:34.959514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-faede5a1-d9ab-435f-a146-b628a80f47d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:34.960046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-faede5a1-d9ab-435f-a146-b628a80f47d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:34.966090 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-faede5a1-d9ab-435f-a146-b628a80f47d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:34.966537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-faede5a1-d9ab-435f-a146-b628a80f47d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:34.967299 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-faede5a1-d9ab-435f-a146-b628a80f47d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:34.967733 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-faede5a1-d9ab-435f-a146-b628a80f47d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:35.096357 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-faede5a1-d9ab-435f-a146-b628a80f47d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:35.104327 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-faede5a1-d9ab-435f-a146-b628a80f47d3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149388 Jun 20 07:39:35.104892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1410/2693] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:36.122111 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cd3261b5-9400-4be0-a1e7-201a8a9f0089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:36.122732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cd3261b5-9400-4be0-a1e7-201a8a9f0089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:36.129699 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd3261b5-9400-4be0-a1e7-201a8a9f0089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:36.130150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd3261b5-9400-4be0-a1e7-201a8a9f0089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:36.130914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd3261b5-9400-4be0-a1e7-201a8a9f0089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:36.131346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cd3261b5-9400-4be0-a1e7-201a8a9f0089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:36.262169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cd3261b5-9400-4be0-a1e7-201a8a9f0089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:36.270621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cd3261b5-9400-4be0-a1e7-201a8a9f0089 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152403 Jun 20 07:39:36.271176 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1284/2694] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:36 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:37.288340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b1b7ef5c-d2a8-4b38-9e7a-8b27e7b8203c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:37.288942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b1b7ef5c-d2a8-4b38-9e7a-8b27e7b8203c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:37.295246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1b7ef5c-d2a8-4b38-9e7a-8b27e7b8203c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:37.295682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1b7ef5c-d2a8-4b38-9e7a-8b27e7b8203c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:37.296463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1b7ef5c-d2a8-4b38-9e7a-8b27e7b8203c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:37.296892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b1b7ef5c-d2a8-4b38-9e7a-8b27e7b8203c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:37.425233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b1b7ef5c-d2a8-4b38-9e7a-8b27e7b8203c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:37.433102 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b1b7ef5c-d2a8-4b38-9e7a-8b27e7b8203c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149169 Jun 20 07:39:37.433661 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1411/2695] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:37 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:38.450062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9c6f0034-63cd-44f7-abb4-b38b06d8d283 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:38.450731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9c6f0034-63cd-44f7-abb4-b38b06d8d283 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:38.457156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c6f0034-63cd-44f7-abb4-b38b06d8d283 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:38.457603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c6f0034-63cd-44f7-abb4-b38b06d8d283 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:38.458362 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c6f0034-63cd-44f7-abb4-b38b06d8d283 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:38.458796 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9c6f0034-63cd-44f7-abb4-b38b06d8d283 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:38.584046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9c6f0034-63cd-44f7-abb4-b38b06d8d283 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:38.591861 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9c6f0034-63cd-44f7-abb4-b38b06d8d283 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145697 Jun 20 07:39:38.592449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1285/2696] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:38 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:39.609190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a1768717-1af5-4d40-81b5-5778e9868dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:39.609834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a1768717-1af5-4d40-81b5-5778e9868dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:39.616860 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1768717-1af5-4d40-81b5-5778e9868dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:39.617311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1768717-1af5-4d40-81b5-5778e9868dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:39.618069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1768717-1af5-4d40-81b5-5778e9868dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:39.618505 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a1768717-1af5-4d40-81b5-5778e9868dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:39.743249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a1768717-1af5-4d40-81b5-5778e9868dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:39.751374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a1768717-1af5-4d40-81b5-5778e9868dde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.146003 Jun 20 07:39:39.751947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1412/2697] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:39 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:40.769862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab5fa75f-8e04-4fae-abb8-61826f68b024 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:40.770502 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab5fa75f-8e04-4fae-abb8-61826f68b024 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:40.777055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab5fa75f-8e04-4fae-abb8-61826f68b024 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:40.777505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab5fa75f-8e04-4fae-abb8-61826f68b024 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:40.778262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab5fa75f-8e04-4fae-abb8-61826f68b024 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:40.778704 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab5fa75f-8e04-4fae-abb8-61826f68b024 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:40.907720 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab5fa75f-8e04-4fae-abb8-61826f68b024 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:40.915651 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab5fa75f-8e04-4fae-abb8-61826f68b024 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150359 Jun 20 07:39:40.916231 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1286/2698] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:40 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:42.052610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-edb1ffff-3535-4204-b759-c0b2c42b7c6c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:42.053233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-edb1ffff-3535-4204-b759-c0b2c42b7c6c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:42.059123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edb1ffff-3535-4204-b759-c0b2c42b7c6c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:42.059569 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edb1ffff-3535-4204-b759-c0b2c42b7c6c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:42.060354 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edb1ffff-3535-4204-b759-c0b2c42b7c6c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:42.060800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-edb1ffff-3535-4204-b759-c0b2c42b7c6c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:42.186575 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-edb1ffff-3535-4204-b759-c0b2c42b7c6c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:42.194851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-edb1ffff-3535-4204-b759-c0b2c42b7c6c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.266747 Jun 20 07:39:42.195414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1413/2699] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:43.211595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2890d60f-b7db-459e-8535-b5309194a1e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:43.212222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2890d60f-b7db-459e-8535-b5309194a1e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:43.218665 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2890d60f-b7db-459e-8535-b5309194a1e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:43.219120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2890d60f-b7db-459e-8535-b5309194a1e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:43.219876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2890d60f-b7db-459e-8535-b5309194a1e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:43.220351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2890d60f-b7db-459e-8535-b5309194a1e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:43.351850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2890d60f-b7db-459e-8535-b5309194a1e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:43.359655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2890d60f-b7db-459e-8535-b5309194a1e7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.151908 Jun 20 07:39:43.360244 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1287/2700] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:43 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:44.376825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-da6053a1-6d38-4663-8206-daabbc638a13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:44.377436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-da6053a1-6d38-4663-8206-daabbc638a13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:44.384015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da6053a1-6d38-4663-8206-daabbc638a13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:44.384501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da6053a1-6d38-4663-8206-daabbc638a13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:44.385266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da6053a1-6d38-4663-8206-daabbc638a13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:44.385710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da6053a1-6d38-4663-8206-daabbc638a13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:44.523015 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-da6053a1-6d38-4663-8206-daabbc638a13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:44.530949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-da6053a1-6d38-4663-8206-daabbc638a13 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.158236 Jun 20 07:39:44.531511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1414/2701] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:44 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:45.548013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b5740b17-07f8-40e2-ae7a-6ec8049e4a4f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:45.548671 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b5740b17-07f8-40e2-ae7a-6ec8049e4a4f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:45.555830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5740b17-07f8-40e2-ae7a-6ec8049e4a4f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:45.556331 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5740b17-07f8-40e2-ae7a-6ec8049e4a4f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:45.557121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5740b17-07f8-40e2-ae7a-6ec8049e4a4f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:45.557564 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5740b17-07f8-40e2-ae7a-6ec8049e4a4f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:45.686852 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b5740b17-07f8-40e2-ae7a-6ec8049e4a4f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:45.694794 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b5740b17-07f8-40e2-ae7a-6ec8049e4a4f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150602 Jun 20 07:39:45.695361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1288/2702] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:45 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:46.711274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-96430882-b7e4-4b2c-bb41-a2f3fb833d51 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:46.711892 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-96430882-b7e4-4b2c-bb41-a2f3fb833d51 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:46.718520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96430882-b7e4-4b2c-bb41-a2f3fb833d51 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:46.718972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96430882-b7e4-4b2c-bb41-a2f3fb833d51 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:46.719730 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96430882-b7e4-4b2c-bb41-a2f3fb833d51 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:46.720207 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-96430882-b7e4-4b2c-bb41-a2f3fb833d51 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:46.846828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-96430882-b7e4-4b2c-bb41-a2f3fb833d51 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:46.854667 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-96430882-b7e4-4b2c-bb41-a2f3fb833d51 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147238 Jun 20 07:39:46.855225 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1415/2703] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:46 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:47.872188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e63a6e43-bfe1-4562-ae16-c7c3569608f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:47.872733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e63a6e43-bfe1-4562-ae16-c7c3569608f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:47.879376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e63a6e43-bfe1-4562-ae16-c7c3569608f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:47.879818 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e63a6e43-bfe1-4562-ae16-c7c3569608f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:47.880595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e63a6e43-bfe1-4562-ae16-c7c3569608f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:47.881025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e63a6e43-bfe1-4562-ae16-c7c3569608f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:48.008422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e63a6e43-bfe1-4562-ae16-c7c3569608f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:48.016413 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e63a6e43-bfe1-4562-ae16-c7c3569608f0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148121 Jun 20 07:39:48.017085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1289/2704] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:47 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:49.034664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4094bb1e-73d4-4963-bd66-9eb9b6a543b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:49.035283 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4094bb1e-73d4-4963-bd66-9eb9b6a543b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:49.041778 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4094bb1e-73d4-4963-bd66-9eb9b6a543b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:49.042232 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4094bb1e-73d4-4963-bd66-9eb9b6a543b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:49.042993 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4094bb1e-73d4-4963-bd66-9eb9b6a543b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:49.043432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4094bb1e-73d4-4963-bd66-9eb9b6a543b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:49.174480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4094bb1e-73d4-4963-bd66-9eb9b6a543b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:49.182965 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4094bb1e-73d4-4963-bd66-9eb9b6a543b9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152748 Jun 20 07:39:49.183533 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1416/2705] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:49 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:50.199671 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4ae679ee-bc34-46b7-a394-7eb3efb09c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:50.200341 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4ae679ee-bc34-46b7-a394-7eb3efb09c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:50.206493 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ae679ee-bc34-46b7-a394-7eb3efb09c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:50.206942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ae679ee-bc34-46b7-a394-7eb3efb09c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:50.207691 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ae679ee-bc34-46b7-a394-7eb3efb09c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:50.208162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ae679ee-bc34-46b7-a394-7eb3efb09c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:50.332219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ae679ee-bc34-46b7-a394-7eb3efb09c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:50.340035 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4ae679ee-bc34-46b7-a394-7eb3efb09c6b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144213 Jun 20 07:39:50.340623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1290/2706] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:50 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:51.356859 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-598317f5-7865-433a-851d-42dcb499afef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:51.357456 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-598317f5-7865-433a-851d-42dcb499afef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:51.364587 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-598317f5-7865-433a-851d-42dcb499afef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:51.365037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-598317f5-7865-433a-851d-42dcb499afef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:51.365793 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-598317f5-7865-433a-851d-42dcb499afef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:51.366228 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-598317f5-7865-433a-851d-42dcb499afef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:51.498541 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-598317f5-7865-433a-851d-42dcb499afef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:51.506667 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-598317f5-7865-433a-851d-42dcb499afef tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.153708 Jun 20 07:39:51.507233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1417/2707] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:51 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:52.523563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6b7400d9-9ff9-4020-ad34-e0454624fd56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:52.524234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6b7400d9-9ff9-4020-ad34-e0454624fd56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:52.530685 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b7400d9-9ff9-4020-ad34-e0454624fd56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:52.531139 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b7400d9-9ff9-4020-ad34-e0454624fd56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:52.531901 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b7400d9-9ff9-4020-ad34-e0454624fd56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:52.532370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b7400d9-9ff9-4020-ad34-e0454624fd56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:52.657569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6b7400d9-9ff9-4020-ad34-e0454624fd56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:52.665486 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6b7400d9-9ff9-4020-ad34-e0454624fd56 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145771 Jun 20 07:39:52.666049 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1291/2708] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:52 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:53.682657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e9c3431a-ce08-4260-9728-4a7fe338435b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:53.683279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e9c3431a-ce08-4260-9728-4a7fe338435b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:53.690276 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9c3431a-ce08-4260-9728-4a7fe338435b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:53.690716 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9c3431a-ce08-4260-9728-4a7fe338435b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:53.691472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9c3431a-ce08-4260-9728-4a7fe338435b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:53.691900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e9c3431a-ce08-4260-9728-4a7fe338435b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:53.818100 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e9c3431a-ce08-4260-9728-4a7fe338435b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:53.825982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e9c3431a-ce08-4260-9728-4a7fe338435b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147188 Jun 20 07:39:53.826546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1418/2709] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:53 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:54.843513 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-88776191-50b2-4264-8cab-59fadd497cea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:54.844163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-88776191-50b2-4264-8cab-59fadd497cea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:54.847260 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=26 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:39:54.852594 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88776191-50b2-4264-8cab-59fadd497cea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:54.853046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88776191-50b2-4264-8cab-59fadd497cea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:54.853803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88776191-50b2-4264-8cab-59fadd497cea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:54.854242 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88776191-50b2-4264-8cab-59fadd497cea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:54.858276 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=78 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:39:54.985959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-88776191-50b2-4264-8cab-59fadd497cea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:54.993819 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-88776191-50b2-4264-8cab-59fadd497cea tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.154160 Jun 20 07:39:54.994380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1292/2710] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:54 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:56.011621 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3dd9cec8-9970-415b-bfe9-a16e3d50fdf3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:56.012259 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3dd9cec8-9970-415b-bfe9-a16e3d50fdf3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:56.018707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3dd9cec8-9970-415b-bfe9-a16e3d50fdf3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:56.019162 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3dd9cec8-9970-415b-bfe9-a16e3d50fdf3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:56.019920 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3dd9cec8-9970-415b-bfe9-a16e3d50fdf3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:56.020384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3dd9cec8-9970-415b-bfe9-a16e3d50fdf3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:56.022832 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=78 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:39:56.148583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3dd9cec8-9970-415b-bfe9-a16e3d50fdf3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:56.156363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3dd9cec8-9970-415b-bfe9-a16e3d50fdf3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148620 Jun 20 07:39:56.156950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1419/2711] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:56 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:57.173215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-06af2615-490e-4327-b3f2-c6d341d141b8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:57.174419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-06af2615-490e-4327-b3f2-c6d341d141b8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:57.181003 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06af2615-490e-4327-b3f2-c6d341d141b8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:57.181449 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06af2615-490e-4327-b3f2-c6d341d141b8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:57.182198 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06af2615-490e-4327-b3f2-c6d341d141b8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:57.182640 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06af2615-490e-4327-b3f2-c6d341d141b8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:57.310257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-06af2615-490e-4327-b3f2-c6d341d141b8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:57.318130 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-06af2615-490e-4327-b3f2-c6d341d141b8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148745 Jun 20 07:39:57.318689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1293/2712] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:57 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:58.335321 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-de7a5792-51ba-430d-abba-c62f3020fdff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:58.335929 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-de7a5792-51ba-430d-abba-c62f3020fdff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:58.338284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=26 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:39:58.343430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de7a5792-51ba-430d-abba-c62f3020fdff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:58.343872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de7a5792-51ba-430d-abba-c62f3020fdff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:58.344641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de7a5792-51ba-430d-abba-c62f3020fdff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:58.345071 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-de7a5792-51ba-430d-abba-c62f3020fdff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:58.472345 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-de7a5792-51ba-430d-abba-c62f3020fdff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:58.480188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-de7a5792-51ba-430d-abba-c62f3020fdff tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148642 Jun 20 07:39:58.480751 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1420/2713] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:58 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:39:59.497086 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb1d8912-10ce-4eea-b592-a2729626d636 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:39:59.497706 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb1d8912-10ce-4eea-b592-a2729626d636 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:39:59.504503 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb1d8912-10ce-4eea-b592-a2729626d636 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:59.504956 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb1d8912-10ce-4eea-b592-a2729626d636 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:59.505708 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb1d8912-10ce-4eea-b592-a2729626d636 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:39:59.506148 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb1d8912-10ce-4eea-b592-a2729626d636 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:39:59.636326 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb1d8912-10ce-4eea-b592-a2729626d636 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:39:59.644162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb1d8912-10ce-4eea-b592-a2729626d636 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150966 Jun 20 07:39:59.644719 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1294/2714] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:39:59 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:00.660452 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-32fd7ada-5082-49a4-a77e-c6e74cb962b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:00.661098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-32fd7ada-5082-49a4-a77e-c6e74cb962b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:00.667605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32fd7ada-5082-49a4-a77e-c6e74cb962b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:00.668055 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32fd7ada-5082-49a4-a77e-c6e74cb962b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:00.668846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32fd7ada-5082-49a4-a77e-c6e74cb962b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:00.669284 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-32fd7ada-5082-49a4-a77e-c6e74cb962b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:00.795213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-32fd7ada-5082-49a4-a77e-c6e74cb962b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:00.803584 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-32fd7ada-5082-49a4-a77e-c6e74cb962b6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147100 Jun 20 07:40:00.804165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1421/2715] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:00 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:01.820995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c58882ea-204c-4c76-8042-6a58c6969517 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:01.821600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c58882ea-204c-4c76-8042-6a58c6969517 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:01.827942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c58882ea-204c-4c76-8042-6a58c6969517 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:01.828418 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c58882ea-204c-4c76-8042-6a58c6969517 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:01.829163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c58882ea-204c-4c76-8042-6a58c6969517 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:01.829711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c58882ea-204c-4c76-8042-6a58c6969517 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:01.954330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c58882ea-204c-4c76-8042-6a58c6969517 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:01.962780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c58882ea-204c-4c76-8042-6a58c6969517 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145546 Jun 20 07:40:01.963305 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1295/2716] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:01 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:02.979747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-80ec2bcf-973c-427a-a4d6-0a597c1d41c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:02.980325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-80ec2bcf-973c-427a-a4d6-0a597c1d41c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:02.986912 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-80ec2bcf-973c-427a-a4d6-0a597c1d41c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:02.987362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-80ec2bcf-973c-427a-a4d6-0a597c1d41c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:02.988143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-80ec2bcf-973c-427a-a4d6-0a597c1d41c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:02.988590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-80ec2bcf-973c-427a-a4d6-0a597c1d41c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:03.122126 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-80ec2bcf-973c-427a-a4d6-0a597c1d41c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:03.130491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-80ec2bcf-973c-427a-a4d6-0a597c1d41c9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.154599 Jun 20 07:40:03.131063 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1422/2717] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:02 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:04.147342 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-77c532ba-289d-48e9-9fc7-bd0fb670899f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:04.147964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-77c532ba-289d-48e9-9fc7-bd0fb670899f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:04.154499 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77c532ba-289d-48e9-9fc7-bd0fb670899f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:04.154954 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77c532ba-289d-48e9-9fc7-bd0fb670899f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:04.155714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77c532ba-289d-48e9-9fc7-bd0fb670899f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:04.156193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77c532ba-289d-48e9-9fc7-bd0fb670899f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:04.280609 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-77c532ba-289d-48e9-9fc7-bd0fb670899f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:04.288431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-77c532ba-289d-48e9-9fc7-bd0fb670899f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144972 Jun 20 07:40:04.288989 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1296/2718] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:04 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:05.308882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6d189d1e-149c-470e-b16b-4823c13fc274 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:05.309476 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6d189d1e-149c-470e-b16b-4823c13fc274 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:05.316097 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d189d1e-149c-470e-b16b-4823c13fc274 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:05.316568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d189d1e-149c-470e-b16b-4823c13fc274 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:05.317314 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d189d1e-149c-470e-b16b-4823c13fc274 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:05.317742 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6d189d1e-149c-470e-b16b-4823c13fc274 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:05.447479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6d189d1e-149c-470e-b16b-4823c13fc274 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:05.455289 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6d189d1e-149c-470e-b16b-4823c13fc274 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150400 Jun 20 07:40:05.455843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1423/2719] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:05 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:06.471398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b3fb515-eaa6-4bbb-b091-8e4771486087 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:06.472013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b3fb515-eaa6-4bbb-b091-8e4771486087 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:06.478494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b3fb515-eaa6-4bbb-b091-8e4771486087 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:06.478945 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b3fb515-eaa6-4bbb-b091-8e4771486087 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:06.479700 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b3fb515-eaa6-4bbb-b091-8e4771486087 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:06.480166 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b3fb515-eaa6-4bbb-b091-8e4771486087 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:06.608944 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b3fb515-eaa6-4bbb-b091-8e4771486087 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:06.617222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b3fb515-eaa6-4bbb-b091-8e4771486087 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149657 Jun 20 07:40:06.617778 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1297/2720] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:06 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:07.634787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-921a8d6c-0f74-431b-b040-f0e0a9035dd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:07.635436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-921a8d6c-0f74-431b-b040-f0e0a9035dd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:07.642415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-921a8d6c-0f74-431b-b040-f0e0a9035dd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:07.642872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-921a8d6c-0f74-431b-b040-f0e0a9035dd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:07.643627 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-921a8d6c-0f74-431b-b040-f0e0a9035dd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:07.644060 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-921a8d6c-0f74-431b-b040-f0e0a9035dd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:07.771634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-921a8d6c-0f74-431b-b040-f0e0a9035dd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:07.779565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-921a8d6c-0f74-431b-b040-f0e0a9035dd3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148714 Jun 20 07:40:07.780148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1424/2721] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:07 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:08.796505 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0a526cf3-a898-455a-a4b2-9c4e173b7018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:08.797120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0a526cf3-a898-455a-a4b2-9c4e173b7018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:08.804306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a526cf3-a898-455a-a4b2-9c4e173b7018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:08.804749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a526cf3-a898-455a-a4b2-9c4e173b7018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:08.805498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a526cf3-a898-455a-a4b2-9c4e173b7018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:08.805934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0a526cf3-a898-455a-a4b2-9c4e173b7018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:08.933039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0a526cf3-a898-455a-a4b2-9c4e173b7018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:08.940867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0a526cf3-a898-455a-a4b2-9c4e173b7018 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148186 Jun 20 07:40:08.941422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1298/2722] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:08 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:09.957707 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8a3731e9-d591-48d2-ae8d-36b57b387306 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:09.958415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8a3731e9-d591-48d2-ae8d-36b57b387306 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:09.964897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a3731e9-d591-48d2-ae8d-36b57b387306 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:09.965349 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a3731e9-d591-48d2-ae8d-36b57b387306 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:09.966107 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a3731e9-d591-48d2-ae8d-36b57b387306 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:09.966546 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8a3731e9-d591-48d2-ae8d-36b57b387306 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:10.091078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8a3731e9-d591-48d2-ae8d-36b57b387306 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:10.099413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8a3731e9-d591-48d2-ae8d-36b57b387306 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145548 Jun 20 07:40:10.099985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1425/2723] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:09 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:11.116834 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6721d77a-0b59-4c89-86aa-9268146b83f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:11.117443 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6721d77a-0b59-4c89-86aa-9268146b83f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:11.123868 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6721d77a-0b59-4c89-86aa-9268146b83f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:11.124349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6721d77a-0b59-4c89-86aa-9268146b83f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:11.125348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6721d77a-0b59-4c89-86aa-9268146b83f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:11.125779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6721d77a-0b59-4c89-86aa-9268146b83f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:11.263855 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6721d77a-0b59-4c89-86aa-9268146b83f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:11.271656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6721d77a-0b59-4c89-86aa-9268146b83f7 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.158678 Jun 20 07:40:11.272239 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1299/2724] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:11 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:12.288977 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bb3b2519-2a2a-448e-bd09-06ca4cd6b2e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:12.289596 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bb3b2519-2a2a-448e-bd09-06ca4cd6b2e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:12.295951 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb3b2519-2a2a-448e-bd09-06ca4cd6b2e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:12.296418 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb3b2519-2a2a-448e-bd09-06ca4cd6b2e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:12.297165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb3b2519-2a2a-448e-bd09-06ca4cd6b2e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:12.297595 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb3b2519-2a2a-448e-bd09-06ca4cd6b2e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:12.422665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bb3b2519-2a2a-448e-bd09-06ca4cd6b2e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:12.430753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bb3b2519-2a2a-448e-bd09-06ca4cd6b2e9 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145654 Jun 20 07:40:12.431307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1426/2725] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:12 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:13.448259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-891375f4-b244-437f-af6d-17147cfb7036 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:13.448829 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-891375f4-b244-437f-af6d-17147cfb7036 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:13.455872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-891375f4-b244-437f-af6d-17147cfb7036 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:13.456352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-891375f4-b244-437f-af6d-17147cfb7036 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:13.457100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-891375f4-b244-437f-af6d-17147cfb7036 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:13.457536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-891375f4-b244-437f-af6d-17147cfb7036 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:13.584631 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-891375f4-b244-437f-af6d-17147cfb7036 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:13.592623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-891375f4-b244-437f-af6d-17147cfb7036 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148417 Jun 20 07:40:13.593186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1300/2726] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:13 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:14.611112 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c674ba16-67e4-4a41-8f98-50a585602fde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:14.611761 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c674ba16-67e4-4a41-8f98-50a585602fde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:14.618286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c674ba16-67e4-4a41-8f98-50a585602fde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:14.618740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c674ba16-67e4-4a41-8f98-50a585602fde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:14.619501 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c674ba16-67e4-4a41-8f98-50a585602fde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:14.619940 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c674ba16-67e4-4a41-8f98-50a585602fde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:14.749024 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c674ba16-67e4-4a41-8f98-50a585602fde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:14.757297 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c674ba16-67e4-4a41-8f98-50a585602fde tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150812 Jun 20 07:40:14.757865 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1427/2727] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:14 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:15.773711 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3f73ab5e-ba21-46c6-ba06-4870f14bbe0f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:15.774313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3f73ab5e-ba21-46c6-ba06-4870f14bbe0f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:15.780741 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f73ab5e-ba21-46c6-ba06-4870f14bbe0f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:15.781207 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f73ab5e-ba21-46c6-ba06-4870f14bbe0f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:15.781951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f73ab5e-ba21-46c6-ba06-4870f14bbe0f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:15.782429 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3f73ab5e-ba21-46c6-ba06-4870f14bbe0f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:15.907689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3f73ab5e-ba21-46c6-ba06-4870f14bbe0f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:15.915459 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3f73ab5e-ba21-46c6-ba06-4870f14bbe0f tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145618 Jun 20 07:40:15.916020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1301/2728] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:15 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:16.933043 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bc7d8f42-2309-4170-8aa3-d4763f57d885 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:16.933594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bc7d8f42-2309-4170-8aa3-d4763f57d885 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:16.940531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc7d8f42-2309-4170-8aa3-d4763f57d885 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:16.940981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc7d8f42-2309-4170-8aa3-d4763f57d885 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:16.941744 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc7d8f42-2309-4170-8aa3-d4763f57d885 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:16.942181 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bc7d8f42-2309-4170-8aa3-d4763f57d885 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:17.070634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bc7d8f42-2309-4170-8aa3-d4763f57d885 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:17.078339 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bc7d8f42-2309-4170-8aa3-d4763f57d885 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149205 Jun 20 07:40:17.078905 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1428/2729] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:16 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:18.095838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b87d9ea-8db9-4564-9110-2e6084f3a686 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:18.096512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4b87d9ea-8db9-4564-9110-2e6084f3a686 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:18.102981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b87d9ea-8db9-4564-9110-2e6084f3a686 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:18.103439 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b87d9ea-8db9-4564-9110-2e6084f3a686 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:18.104229 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b87d9ea-8db9-4564-9110-2e6084f3a686 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:18.104672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b87d9ea-8db9-4564-9110-2e6084f3a686 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:18.228659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4b87d9ea-8db9-4564-9110-2e6084f3a686 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:18.236508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4b87d9ea-8db9-4564-9110-2e6084f3a686 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145091 Jun 20 07:40:18.237072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1302/2730] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:18 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:19.254041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-63bfc77d-e344-4913-bb04-938c934c4546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:19.254676 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-63bfc77d-e344-4913-bb04-938c934c4546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:19.261129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63bfc77d-e344-4913-bb04-938c934c4546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:19.261577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63bfc77d-e344-4913-bb04-938c934c4546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:19.262334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63bfc77d-e344-4913-bb04-938c934c4546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:19.262773 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-63bfc77d-e344-4913-bb04-938c934c4546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:19.394550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-63bfc77d-e344-4913-bb04-938c934c4546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:19.402443 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-63bfc77d-e344-4913-bb04-938c934c4546 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.152862 Jun 20 07:40:19.403009 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1429/2731] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:19 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:20.420494 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-09e84609-b4dc-4a92-9fce-f25d78714a69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:20.421113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-09e84609-b4dc-4a92-9fce-f25d78714a69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:20.427677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09e84609-b4dc-4a92-9fce-f25d78714a69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:20.428150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09e84609-b4dc-4a92-9fce-f25d78714a69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:20.428908 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09e84609-b4dc-4a92-9fce-f25d78714a69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:20.429343 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09e84609-b4dc-4a92-9fce-f25d78714a69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:20.553893 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-09e84609-b4dc-4a92-9fce-f25d78714a69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:20.561683 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-09e84609-b4dc-4a92-9fce-f25d78714a69 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145550 Jun 20 07:40:20.562248 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1303/2732] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:20 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:21.579130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c2fe8d06-a904-4b16-950c-9221f44751d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:21.579755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c2fe8d06-a904-4b16-950c-9221f44751d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:21.586093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2fe8d06-a904-4b16-950c-9221f44751d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:21.586537 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2fe8d06-a904-4b16-950c-9221f44751d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:21.587293 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2fe8d06-a904-4b16-950c-9221f44751d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:21.587732 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2fe8d06-a904-4b16-950c-9221f44751d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:21.715495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c2fe8d06-a904-4b16-950c-9221f44751d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:21.723383 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c2fe8d06-a904-4b16-950c-9221f44751d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148166 Jun 20 07:40:21.723946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1430/2733] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:21 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:22.740568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7c873af-6b9c-4c4c-a34f-235ae9563124 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:22.741194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7c873af-6b9c-4c4c-a34f-235ae9563124 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:22.747616 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7c873af-6b9c-4c4c-a34f-235ae9563124 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:22.748068 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7c873af-6b9c-4c4c-a34f-235ae9563124 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:22.748859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7c873af-6b9c-4c4c-a34f-235ae9563124 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:22.749306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7c873af-6b9c-4c4c-a34f-235ae9563124 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:22.878676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7c873af-6b9c-4c4c-a34f-235ae9563124 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:22.886516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7c873af-6b9c-4c4c-a34f-235ae9563124 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150217 Jun 20 07:40:22.887075 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1304/2734] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:22 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:23.904069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b48448cb-b0c1-4409-bdcc-575729d4f019 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:23.904753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b48448cb-b0c1-4409-bdcc-575729d4f019 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:23.911816 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b48448cb-b0c1-4409-bdcc-575729d4f019 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:23.912302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b48448cb-b0c1-4409-bdcc-575729d4f019 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:23.913059 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b48448cb-b0c1-4409-bdcc-575729d4f019 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:23.913499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b48448cb-b0c1-4409-bdcc-575729d4f019 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:24.039690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b48448cb-b0c1-4409-bdcc-575729d4f019 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:24.047825 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b48448cb-b0c1-4409-bdcc-575729d4f019 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147552 Jun 20 07:40:24.048422 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1431/2735] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:23 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:25.065217 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cf1c622b-e7d3-4b08-a2a1-649204ca7280 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:25.065848 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cf1c622b-e7d3-4b08-a2a1-649204ca7280 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:25.068144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=26 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:40:25.073551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf1c622b-e7d3-4b08-a2a1-649204ca7280 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:25.074009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf1c622b-e7d3-4b08-a2a1-649204ca7280 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:25.074772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf1c622b-e7d3-4b08-a2a1-649204ca7280 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:25.075215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cf1c622b-e7d3-4b08-a2a1-649204ca7280 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:25.079840 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=78 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:40:25.131665 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:40:25.132199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:40:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:40:25.209761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cf1c622b-e7d3-4b08-a2a1-649204ca7280 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:25.217627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cf1c622b-e7d3-4b08-a2a1-649204ca7280 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.156804 Jun 20 07:40:25.218489 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1305/2736] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:25 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:26.234812 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b3c26e62-5458-4ca4-b4a9-778a084c94b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:26.235413 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b3c26e62-5458-4ca4-b4a9-778a084c94b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:26.242095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3c26e62-5458-4ca4-b4a9-778a084c94b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:26.242543 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3c26e62-5458-4ca4-b4a9-778a084c94b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:26.243302 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3c26e62-5458-4ca4-b4a9-778a084c94b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:26.243739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b3c26e62-5458-4ca4-b4a9-778a084c94b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:26.246246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=78 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:40:26.369944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b3c26e62-5458-4ca4-b4a9-778a084c94b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:26.378079 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b3c26e62-5458-4ca4-b4a9-778a084c94b5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147130 Jun 20 07:40:26.378643 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1432/2737] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:26 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:27.395065 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3802b1fb-ad21-467d-b08c-93a416850a45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:27.395678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3802b1fb-ad21-467d-b08c-93a416850a45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:27.402356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3802b1fb-ad21-467d-b08c-93a416850a45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:27.402800 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3802b1fb-ad21-467d-b08c-93a416850a45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:27.403546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3802b1fb-ad21-467d-b08c-93a416850a45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:27.403979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3802b1fb-ad21-467d-b08c-93a416850a45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:27.532984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3802b1fb-ad21-467d-b08c-93a416850a45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:27.541059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3802b1fb-ad21-467d-b08c-93a416850a45 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149658 Jun 20 07:40:27.541730 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1306/2738] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:27 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:28.558669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1f419ac3-21a0-46bb-898f-930ab3d2a9de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:28.559287 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1f419ac3-21a0-46bb-898f-930ab3d2a9de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:28.561603 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=26 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:40:28.566846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f419ac3-21a0-46bb-898f-930ab3d2a9de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:28.567295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f419ac3-21a0-46bb-898f-930ab3d2a9de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:28.568089 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f419ac3-21a0-46bb-898f-930ab3d2a9de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:28.568548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1f419ac3-21a0-46bb-898f-930ab3d2a9de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:28.696554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1f419ac3-21a0-46bb-898f-930ab3d2a9de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:28.705101 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1f419ac3-21a0-46bb-898f-930ab3d2a9de tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150238 Jun 20 07:40:28.705703 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1433/2739] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:28 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:29.723120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6bd375ed-ac29-4396-92b2-fb8211478589 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:29.723729 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6bd375ed-ac29-4396-92b2-fb8211478589 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:29.730230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bd375ed-ac29-4396-92b2-fb8211478589 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:29.730672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bd375ed-ac29-4396-92b2-fb8211478589 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:29.731415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bd375ed-ac29-4396-92b2-fb8211478589 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:29.731844 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6bd375ed-ac29-4396-92b2-fb8211478589 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:29.858878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6bd375ed-ac29-4396-92b2-fb8211478589 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:29.866716 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6bd375ed-ac29-4396-92b2-fb8211478589 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.147981 Jun 20 07:40:29.867263 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1307/2740] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:29 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:30.883636 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-44fdd02c-da7a-419d-b33a-3f2a34bc1112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:30.884312 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-44fdd02c-da7a-419d-b33a-3f2a34bc1112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:30.891495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44fdd02c-da7a-419d-b33a-3f2a34bc1112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:30.891936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44fdd02c-da7a-419d-b33a-3f2a34bc1112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:30.892726 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44fdd02c-da7a-419d-b33a-3f2a34bc1112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:30.893205 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-44fdd02c-da7a-419d-b33a-3f2a34bc1112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:31.021565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-44fdd02c-da7a-419d-b33a-3f2a34bc1112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:31.029419 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-44fdd02c-da7a-419d-b33a-3f2a34bc1112 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149959 Jun 20 07:40:31.029978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1434/2741] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:30 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:32.046757 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a0a78b65-3da5-41cc-bd4f-09dbc67c72d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:32.048381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a0a78b65-3da5-41cc-bd4f-09dbc67c72d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:32.055002 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0a78b65-3da5-41cc-bd4f-09dbc67c72d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:32.055450 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0a78b65-3da5-41cc-bd4f-09dbc67c72d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:32.056233 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0a78b65-3da5-41cc-bd4f-09dbc67c72d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:32.056674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a0a78b65-3da5-41cc-bd4f-09dbc67c72d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:32.182985 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a0a78b65-3da5-41cc-bd4f-09dbc67c72d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:32.191492 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a0a78b65-3da5-41cc-bd4f-09dbc67c72d0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148637 Jun 20 07:40:32.192058 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1308/2742] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:32 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:32.816321 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:40:32.816792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:40:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:40:33.209148 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e6f257ab-8aa7-44b1-ad3b-c72ce0e86706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:33.209679 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e6f257ab-8aa7-44b1-ad3b-c72ce0e86706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:33.216211 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6f257ab-8aa7-44b1-ad3b-c72ce0e86706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:33.216664 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6f257ab-8aa7-44b1-ad3b-c72ce0e86706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:33.217418 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6f257ab-8aa7-44b1-ad3b-c72ce0e86706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:33.217857 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6f257ab-8aa7-44b1-ad3b-c72ce0e86706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:33.347064 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e6f257ab-8aa7-44b1-ad3b-c72ce0e86706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:33.354888 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e6f257ab-8aa7-44b1-ad3b-c72ce0e86706 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.149714 Jun 20 07:40:33.355446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1435/2743] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:33 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:40:34.371926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f49335b5-6dea-4fad-b19f-32ba3ed94f5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:34.372590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f49335b5-6dea-4fad-b19f-32ba3ed94f5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:34.379185 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f49335b5-6dea-4fad-b19f-32ba3ed94f5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:34.379633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f49335b5-6dea-4fad-b19f-32ba3ed94f5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:34.380422 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f49335b5-6dea-4fad-b19f-32ba3ed94f5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:34.380857 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f49335b5-6dea-4fad-b19f-32ba3ed94f5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:34.509425 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f49335b5-6dea-4fad-b19f-32ba3ed94f5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:34.517946 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f49335b5-6dea-4fad-b19f-32ba3ed94f5e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150029 Jun 20 07:40:34.518518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1309/2744] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:34 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:35.536155 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-82b365d1-7dfb-48c2-bda7-00868738d8b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:35.536768 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-82b365d1-7dfb-48c2-bda7-00868738d8b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:35.542856 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82b365d1-7dfb-48c2-bda7-00868738d8b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:35.543304 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82b365d1-7dfb-48c2-bda7-00868738d8b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:35.544046 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82b365d1-7dfb-48c2-bda7-00868738d8b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:35.544496 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82b365d1-7dfb-48c2-bda7-00868738d8b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:35.674686 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-82b365d1-7dfb-48c2-bda7-00868738d8b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:35.682644 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-82b365d1-7dfb-48c2-bda7-00868738d8b0 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.150375 Jun 20 07:40:35.683199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1436/2745] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:35 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:36.698655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-29d10096-ac1a-4d77-819f-a5cf7abf282b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:36.699270 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-29d10096-ac1a-4d77-819f-a5cf7abf282b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:36.705766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29d10096-ac1a-4d77-819f-a5cf7abf282b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:36.706211 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29d10096-ac1a-4d77-819f-a5cf7abf282b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:36.706972 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29d10096-ac1a-4d77-819f-a5cf7abf282b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:36.707407 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29d10096-ac1a-4d77-819f-a5cf7abf282b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:36.831337 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-29d10096-ac1a-4d77-819f-a5cf7abf282b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:36.839144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-29d10096-ac1a-4d77-819f-a5cf7abf282b tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144351 Jun 20 07:40:36.839703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1310/2746] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:36 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:37.856058 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5fd2f7b6-8af0-4f57-89f8-56b8030e23c1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:37.856697 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5fd2f7b6-8af0-4f57-89f8-56b8030e23c1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:37.863915 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5fd2f7b6-8af0-4f57-89f8-56b8030e23c1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:37.864404 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5fd2f7b6-8af0-4f57-89f8-56b8030e23c1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:37.865169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5fd2f7b6-8af0-4f57-89f8-56b8030e23c1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:37.865614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5fd2f7b6-8af0-4f57-89f8-56b8030e23c1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:37.989415 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5fd2f7b6-8af0-4f57-89f8-56b8030e23c1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:37.997407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5fd2f7b6-8af0-4f57-89f8-56b8030e23c1 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.145207 Jun 20 07:40:37.997962 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1437/2747] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:37 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:39.014521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4ff25215-4b9d-426f-b9bf-623903f43c44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:39.015141 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4ff25215-4b9d-426f-b9bf-623903f43c44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:39.021623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ff25215-4b9d-426f-b9bf-623903f43c44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:39.022074 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ff25215-4b9d-426f-b9bf-623903f43c44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:39.022833 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ff25215-4b9d-426f-b9bf-623903f43c44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:39.023273 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ff25215-4b9d-426f-b9bf-623903f43c44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:39.151507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ff25215-4b9d-426f-b9bf-623903f43c44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:39.159392 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4ff25215-4b9d-426f-b9bf-623903f43c44 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148723 Jun 20 07:40:39.159958 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1311/2748] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:39 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:40.176817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-690bd797-9278-46ff-b62d-bacf2c7d2cc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:40.177416 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-690bd797-9278-46ff-b62d-bacf2c7d2cc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:40.184072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-690bd797-9278-46ff-b62d-bacf2c7d2cc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:40.184559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-690bd797-9278-46ff-b62d-bacf2c7d2cc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:40.185325 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-690bd797-9278-46ff-b62d-bacf2c7d2cc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:40.185788 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-690bd797-9278-46ff-b62d-bacf2c7d2cc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:40.310036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-690bd797-9278-46ff-b62d-bacf2c7d2cc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:40.317946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-690bd797-9278-46ff-b62d-bacf2c7d2cc5 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.144917 Jun 20 07:40:40.318514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1438/2749] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:40 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:41.334753 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1f21ad6f-c483-48ec-9549-3905845169e3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:41.335384 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1f21ad6f-c483-48ec-9549-3905845169e3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:41.341790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f21ad6f-c483-48ec-9549-3905845169e3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:41.342242 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f21ad6f-c483-48ec-9549-3905845169e3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:41.342995 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f21ad6f-c483-48ec-9549-3905845169e3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:41.343433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f21ad6f-c483-48ec-9549-3905845169e3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:41.480621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1f21ad6f-c483-48ec-9549-3905845169e3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:41.489624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1f21ad6f-c483-48ec-9549-3905845169e3 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.158770 Jun 20 07:40:41.490193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1312/2750] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:41 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:42.507019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8fec80b0-dbec-491b-a737-7f943e94537c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:42.511561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8fec80b0-dbec-491b-a737-7f943e94537c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: b2be05cc-d645-4d3b-9fcb-dbacd92e2f75] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:40:42.516202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8fec80b0-dbec-491b-a737-7f943e94537c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:42.516657 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8fec80b0-dbec-491b-a737-7f943e94537c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:42.517406 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8fec80b0-dbec-491b-a737-7f943e94537c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:42.517836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8fec80b0-dbec-491b-a737-7f943e94537c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:42.643333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8fec80b0-dbec-491b-a737-7f943e94537c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:40:42.651105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8fec80b0-dbec-491b-a737-7f943e94537c tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75" status: 200 len: 1735 microversion: 2.1 time: 0.148038 Jun 20 07:40:42.651655 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1439/2751] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:40:42 2022] GET /compute/v2.1/servers/b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:40:42.669897 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-65654931-215e-4e9e-885c-d4b1402f8a88 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '.version_select at 0x7ffa1fc0f160>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:40:42.686582 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-65654931-215e-4e9e-885c-d4b1402f8a88 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925049029" status: 202 len: 0 microversion: 2.1 time: 0.020774 Jun 20 07:40:42.687145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1313/2752] 10.222.0.23 () {58 vars in 1220 bytes} [Mon Jun 20 07:40:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925049029 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:40:43.616291 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-794b734a-70bf-4963-89f1-02f5feb58c9c req-5c4b7ba4-9940-4558-988d-f7f9aec9ba22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2be05cc-d645-4d3b-9fcb-dbacd92e2f75", "tag": "f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:40:43.624153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-794b734a-70bf-4963-89f1-02f5feb58c9c req-5c4b7ba4-9940-4558-988d-f7f9aec9ba22 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:40:43.624602 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-794b734a-70bf-4963-89f1-02f5feb58c9c req-5c4b7ba4-9940-4558-988d-f7f9aec9ba22 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:40:43.635752 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-794b734a-70bf-4963-89f1-02f5feb58c9c req-5c4b7ba4-9940-4558-988d-f7f9aec9ba22 service nova] Creating event network-changed:f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad for instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 on hv-cinder-77819 Jun 20 07:40:43.641567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-794b734a-70bf-4963-89f1-02f5feb58c9c req-5c4b7ba4-9940-4558-988d-f7f9aec9ba22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082298 Jun 20 07:40:43.642164 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1440/2753] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:41:44.912914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=47 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:41:44.915197 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:41:44.921576 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3bb0572d-3a13-4804-b698-6ff7db25a5f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:44.922478 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3bb0572d-3a13-4804-b698-6ff7db25a5f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:44.939851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bb0572d-3a13-4804-b698-6ff7db25a5f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:44.941201 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bb0572d-3a13-4804-b698-6ff7db25a5f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:44.943161 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bb0572d-3a13-4804-b698-6ff7db25a5f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:44.943624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3bb0572d-3a13-4804-b698-6ff7db25a5f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:44.976288 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3bb0572d-3a13-4804-b698-6ff7db25a5f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:41:45.065120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3bb0572d-3a13-4804-b698-6ff7db25a5f3 tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "DELETE /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 204 len: 0 microversion: 2.1 time: 0.154810 Jun 20 07:41:45.065982 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1314/2754] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:41:44 2022] DELETE /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:41:45.072098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=15 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:41:45.072930 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=49 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:41:45.077823 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-46c01ff1-6e4e-4a1c-8fed-be207e1c9bef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:45.078516 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-46c01ff1-6e4e-4a1c-8fed-be207e1c9bef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:45.085725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46c01ff1-6e4e-4a1c-8fed-be207e1c9bef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:45.086168 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46c01ff1-6e4e-4a1c-8fed-be207e1c9bef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:45.086941 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46c01ff1-6e4e-4a1c-8fed-be207e1c9bef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:45.087368 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46c01ff1-6e4e-4a1c-8fed-be207e1c9bef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:45.129532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46c01ff1-6e4e-4a1c-8fed-be207e1c9bef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:45.130139 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-46c01ff1-6e4e-4a1c-8fed-be207e1c9bef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:45.130659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-46c01ff1-6e4e-4a1c-8fed-be207e1c9bef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lazy-loading 'fault' on Instance uuid 184f7c82-c8b4-45cf-ba43-b6f17794e153 {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:41:45.174150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-46c01ff1-6e4e-4a1c-8fed-be207e1c9bef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785140aa617e46608e8b3cf89aac5a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e19a3f933284f088747a9d623e9ec24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:41:45.182199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-46c01ff1-6e4e-4a1c-8fed-be207e1c9bef tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 200 len: 1468 microversion: 2.1 time: 0.112103 Jun 20 07:41:45.182764 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1441/2755] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:41:45 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 1468 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:41:45.973340 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c4ec3426-d99d-4e25-8713-c9af7e6465ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:45.973963 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c4ec3426-d99d-4e25-8713-c9af7e6465ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:45.980722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4ec3426-d99d-4e25-8713-c9af7e6465ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:45.981179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4ec3426-d99d-4e25-8713-c9af7e6465ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:45.982940 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4ec3426-d99d-4e25-8713-c9af7e6465ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:45.983380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c4ec3426-d99d-4e25-8713-c9af7e6465ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.000496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-c4ec3426-d99d-4e25-8713-c9af7e6465ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] HTTP exception thrown: Instance 0e214060-f046-41a1-b243-020c88edde42 could not be found. Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c4ec3426-d99d-4e25-8713-c9af7e6465ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Request method failure captured: Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 HTTP/1.1 Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByYWeI4txkwa6yML_OMLCKdHtyqYVZGhRsFgJP0YH_6w5z29R9A4pAjgR7FDgcQt62Lnzl8jrsB_H0r94F_2aR6HwrZj598IR3vtw01nCD6H51aJq54v2SGWnrRyUuf2elld0Dt6NbFp0yPX4a92kR0RH1oZbuuyzWzxCUiwWROEH8 Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 530da3341ec44dddbab5b0042706ac7b Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:41:46.002188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:41:46.004070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:41:46.004070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:41:46.004070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 530da3341ec44dddbab5b0042706ac7b Jun 20 07:41:46.004070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:41:46.004070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeShelveTestJSON-220475795-project Jun 20 07:41:46.004070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:41:46.004070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:41:46.004070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: 1c618f9ab8bd47a3a9913078f8ae895e Jun 20 07:41:46.004070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-220475795-project Jun 20 07:41:46.004070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:41:46.004070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 0e214060-f046-41a1-b243-020c88edde42 could not be found. Jun 20 07:41:46.004070 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '0e214060-f046-41a1-b243-020c88edde42'} Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e214060-f046-41a1-b243-020c88edde42 could not be found. Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:41:46.005279 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e214060-f046-41a1-b243-020c88edde42 could not be found. Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e214060-f046-41a1-b243-020c88edde42 could not be found. Jun 20 07:41:46.006830 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.009184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c4ec3426-d99d-4e25-8713-c9af7e6465ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Returning 404 to user: Instance 0e214060-f046-41a1-b243-020c88edde42 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:41:46.009184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c4ec3426-d99d-4e25-8713-c9af7e6465ec tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 404 len: 111 microversion: 2.20 time: 0.034732 Jun 20 07:41:46.009184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1315/2756] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Jun 20 07:41:45 2022] DELETE /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:41:46.017011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7c990b85-a17a-4257-b731-bdcbe85e4d10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:46.017963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7c990b85-a17a-4257-b731-bdcbe85e4d10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] [instance: 0e214060-f046-41a1-b243-020c88edde42] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:46.026740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c990b85-a17a-4257-b731-bdcbe85e4d10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:46.027193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c990b85-a17a-4257-b731-bdcbe85e4d10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.028265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c990b85-a17a-4257-b731-bdcbe85e4d10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:46.029231 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7c990b85-a17a-4257-b731-bdcbe85e4d10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.043157 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf5d0c9a-4aa2-413c-bea3-7221432bbaef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:46.046015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bf5d0c9a-4aa2-413c-bea3-7221432bbaef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:46.049652 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-7c990b85-a17a-4257-b731-bdcbe85e4d10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] HTTP exception thrown: Instance 0e214060-f046-41a1-b243-020c88edde42 could not be found. Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7c990b85-a17a-4257-b731-bdcbe85e4d10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Request method failure captured: Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 HTTP/1.1 Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisByYWeI4txkwa6yML_OMLCKdHtyqYVZGhRsFgJP0YH_6w5z29R9A4pAjgR7FDgcQt62Lnzl8jrsB_H0r94F_2aR6HwrZj598IR3vtw01nCD6H51aJq54v2SGWnrRyUuf2elld0Dt6NbFp0yPX4a92kR0RH1oZbuuyzWzxCUiwWROEH8 Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 530da3341ec44dddbab5b0042706ac7b Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:41:46.055346 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:41:46.057381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/530da3341ec44dddbab5b0042706ac7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:41:46.057381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:41:46.057381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 530da3341ec44dddbab5b0042706ac7b Jun 20 07:41:46.057381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-220475795 Jun 20 07:41:46.057381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeShelveTestJSON-220475795-project Jun 20 07:41:46.057381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:41:46.057381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:41:46.057381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 1c618f9ab8bd47a3a9913078f8ae895e Jun 20 07:41:46.057381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeShelveTestJSON-220475795-project Jun 20 07:41:46.057381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:41:46.057381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 0e214060-f046-41a1-b243-020c88edde42 could not be found. Jun 20 07:41:46.057381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '0e214060-f046-41a1-b243-020c88edde42'} Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e214060-f046-41a1-b243-020c88edde42 could not be found. Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:41:46.058659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e214060-f046-41a1-b243-020c88edde42 could not be found. Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e214060-f046-41a1-b243-020c88edde42 could not be found. Jun 20 07:41:46.060483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.064588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7c990b85-a17a-4257-b731-bdcbe85e4d10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] Returning 404 to user: Instance 0e214060-f046-41a1-b243-020c88edde42 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:41:46.064950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7c990b85-a17a-4257-b731-bdcbe85e4d10 tempest-AttachVolumeShelveTestJSON-220475795 tempest-AttachVolumeShelveTestJSON-220475795-project] 10.222.0.23 "GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42" status: 404 len: 111 microversion: 2.20 time: 0.053591 Jun 20 07:41:46.067029 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1442/2757] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 07:41:46 2022] GET /compute/v2.1/servers/0e214060-f046-41a1-b243-020c88edde42 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:41:46.069211 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf5d0c9a-4aa2-413c-bea3-7221432bbaef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:46.069904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf5d0c9a-4aa2-413c-bea3-7221432bbaef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.071793 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf5d0c9a-4aa2-413c-bea3-7221432bbaef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:46.072655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf5d0c9a-4aa2-413c-bea3-7221432bbaef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.109574 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-bf5d0c9a-4aa2-413c-bea3-7221432bbaef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf5d0c9a-4aa2-413c-bea3-7221432bbaef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 HTTP/1.1 Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:41:46.111405 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:41:46.113071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:41:46.113071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:46.113071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:41:46.113071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:46.113071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:41:46.113071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:41:46.113071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:41:46.113071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:41:46.113071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:41:46.113071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:41:46.113071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:41:46.113071 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '11509895-4f58-4838-bae7-bf59aa04d5a8'} Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:41:46.114358 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:41:46.116300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.118006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf5d0c9a-4aa2-413c-bea3-7221432bbaef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:41:46.118006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bf5d0c9a-4aa2-413c-bea3-7221432bbaef tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 404 len: 111 microversion: 2.1 time: 0.077484 Jun 20 07:41:46.122511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2281061c-a46e-4041-8d87-ccaee5694e51 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:46.123136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2281061c-a46e-4041-8d87-ccaee5694e51 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 11509895-4f58-4838-bae7-bf59aa04d5a8] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:46.128204 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1316/2758] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:41:46 2022] DELETE /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 07:41:46.130969 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2281061c-a46e-4041-8d87-ccaee5694e51 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:46.131429 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2281061c-a46e-4041-8d87-ccaee5694e51 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.132233 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2281061c-a46e-4041-8d87-ccaee5694e51 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:46.132678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2281061c-a46e-4041-8d87-ccaee5694e51 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.148708 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-2281061c-a46e-4041-8d87-ccaee5694e51 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2281061c-a46e-4041-8d87-ccaee5694e51 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 HTTP/1.1 Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:41:46.150281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:41:46.151874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:41:46.151874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:46.151874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:41:46.151874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:46.151874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:41:46.151874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:41:46.151874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:41:46.151874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:41:46.151874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:41:46.151874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:41:46.151874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:41:46.151874 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '11509895-4f58-4838-bae7-bf59aa04d5a8'} Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:41:46.152799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. Jun 20 07:41:46.155171 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.157023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2281061c-a46e-4041-8d87-ccaee5694e51 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 11509895-4f58-4838-bae7-bf59aa04d5a8 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:41:46.157023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2281061c-a46e-4041-8d87-ccaee5694e51 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8" status: 404 len: 111 microversion: 2.1 time: 0.032946 Jun 20 07:41:46.157023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1443/2759] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:41:46 2022] GET /compute/v2.1/servers/11509895-4f58-4838-bae7-bf59aa04d5a8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:41:46.162101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db23acdd-46f7-42f6-9ffd-b58e19927c85 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:46.162690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-db23acdd-46f7-42f6-9ffd-b58e19927c85 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:46.175399 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db23acdd-46f7-42f6-9ffd-b58e19927c85 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:46.181131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db23acdd-46f7-42f6-9ffd-b58e19927c85 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.182750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db23acdd-46f7-42f6-9ffd-b58e19927c85 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:46.187536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db23acdd-46f7-42f6-9ffd-b58e19927c85 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.204991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6432fffa-a44e-4194-9dd3-a99fc57f2d5b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:46.223125 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6432fffa-a44e-4194-9dd3-a99fc57f2d5b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] [instance: 184f7c82-c8b4-45cf-ba43-b6f17794e153] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:46.258363 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6432fffa-a44e-4194-9dd3-a99fc57f2d5b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:46.258978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6432fffa-a44e-4194-9dd3-a99fc57f2d5b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.260324 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6432fffa-a44e-4194-9dd3-a99fc57f2d5b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:46.273075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6432fffa-a44e-4194-9dd3-a99fc57f2d5b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.276025 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-db23acdd-46f7-42f6-9ffd-b58e19927c85 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db23acdd-46f7-42f6-9ffd-b58e19927c85 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 HTTP/1.1 Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:41:46.282183 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:41:46.284097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:41:46.284097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:46.284097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:41:46.284097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:46.284097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:41:46.284097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:41:46.284097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:41:46.284097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:41:46.284097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:41:46.284097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:41:46.284097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:41:46.284097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '53321809-7dd1-4d7b-b6b8-5a58b1e907f2'} Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:41:46.285039 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:41:46.286444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.287858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db23acdd-46f7-42f6-9ffd-b58e19927c85 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:41:46.287858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db23acdd-46f7-42f6-9ffd-b58e19927c85 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 404 len: 111 microversion: 2.1 time: 0.125942 Jun 20 07:41:46.287858 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1317/2760] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:41:46 2022] DELETE /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:41:46.293599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4913a3fd-7480-42bd-b0cd-288ef0a784f4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:46.294207 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4913a3fd-7480-42bd-b0cd-288ef0a784f4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: 53321809-7dd1-4d7b-b6b8-5a58b1e907f2] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:46.302935 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-6432fffa-a44e-4194-9dd3-a99fc57f2d5b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] HTTP exception thrown: Instance 184f7c82-c8b4-45cf-ba43-b6f17794e153 could not be found. Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6432fffa-a44e-4194-9dd3-a99fc57f2d5b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Request method failure captured: Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 HTTP/1.1 Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisByYZRAmmeV_xJRAsbXax6y3B16P9HTxXDu_RStWYF4tfJaAXTTfF-zs2-agzoeE2gxpRHCHOydhiXF9KSQ8PspeytJOiyka0y3ShrutaYLijgw-aKsyKSWnWxZpTsE2ClphDdXzYi2VUfotFEg9t7IdaO-FEkMA4t8M6UbOx91oBb0 Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 0e19a3f933284f088747a9d623e9ec24 Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-AttachVolumeTestJSON-864634126 Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:41:46.306025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:41:46.307885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e19a3f933284f088747a9d623e9ec24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:41:46.307885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-AttachVolumeTestJSON-864634126 Jun 20 07:41:46.307885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 0e19a3f933284f088747a9d623e9ec24 Jun 20 07:41:46.307885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-AttachVolumeTestJSON-864634126 Jun 20 07:41:46.307885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-AttachVolumeTestJSON-864634126-project Jun 20 07:41:46.307885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:41:46.307885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:41:46.307885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 785140aa617e46608e8b3cf89aac5a44 Jun 20 07:41:46.307885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-AttachVolumeTestJSON-864634126-project Jun 20 07:41:46.307885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:41:46.307885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 184f7c82-c8b4-45cf-ba43-b6f17794e153 could not be found. Jun 20 07:41:46.307885 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '184f7c82-c8b4-45cf-ba43-b6f17794e153'} Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 184f7c82-c8b4-45cf-ba43-b6f17794e153 could not be found. Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:41:46.309026 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 184f7c82-c8b4-45cf-ba43-b6f17794e153 could not be found. Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 184f7c82-c8b4-45cf-ba43-b6f17794e153 could not be found. Jun 20 07:41:46.310787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.314562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6432fffa-a44e-4194-9dd3-a99fc57f2d5b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] Returning 404 to user: Instance 184f7c82-c8b4-45cf-ba43-b6f17794e153 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:41:46.315903 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6432fffa-a44e-4194-9dd3-a99fc57f2d5b tempest-AttachVolumeTestJSON-864634126 tempest-AttachVolumeTestJSON-864634126-project] 10.222.0.23 "GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153" status: 404 len: 111 microversion: 2.1 time: 0.118656 Jun 20 07:41:46.316348 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4913a3fd-7480-42bd-b0cd-288ef0a784f4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:46.321020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4913a3fd-7480-42bd-b0cd-288ef0a784f4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.321020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4913a3fd-7480-42bd-b0cd-288ef0a784f4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:46.321020 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4913a3fd-7480-42bd-b0cd-288ef0a784f4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:46.321841 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1444/2761] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:41:46 2022] GET /compute/v2.1/servers/184f7c82-c8b4-45cf-ba43-b6f17794e153 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:41:46.347652 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-4913a3fd-7480-42bd-b0cd-288ef0a784f4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4913a3fd-7480-42bd-b0cd-288ef0a784f4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 HTTP/1.1 Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:41:46.351195 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:41:46.354577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:41:46.354577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:46.354577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:41:46.354577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:46.354577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:41:46.354577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:41:46.354577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:41:46.354577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:41:46.354577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:41:46.354577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:41:46.354577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:41:46.354577 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '53321809-7dd1-4d7b-b6b8-5a58b1e907f2'} Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:41:46.356473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. Jun 20 07:41:46.360408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:46.364803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4913a3fd-7480-42bd-b0cd-288ef0a784f4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance 53321809-7dd1-4d7b-b6b8-5a58b1e907f2 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:41:46.364803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4913a3fd-7480-42bd-b0cd-288ef0a784f4 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2" status: 404 len: 111 microversion: 2.1 time: 0.063552 Jun 20 07:41:46.364803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1318/2762] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:41:46 2022] GET /compute/v2.1/servers/53321809-7dd1-4d7b-b6b8-5a58b1e907f2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:41:47.081397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-6571e114-0bea-475e-8718-fb245a156853 req-d5d1986c-65ae-4354-bd82-898b25e08b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2be05cc-d645-4d3b-9fcb-dbacd92e2f75", "name": "network-vif-deleted", "tag": "f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:41:47.090385 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6571e114-0bea-475e-8718-fb245a156853 req-d5d1986c-65ae-4354-bd82-898b25e08b9f service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:47.091092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-6571e114-0bea-475e-8718-fb245a156853 req-d5d1986c-65ae-4354-bd82-898b25e08b9f service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:47.103996 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-6571e114-0bea-475e-8718-fb245a156853 req-d5d1986c-65ae-4354-bd82-898b25e08b9f service nova] Creating event network-vif-deleted:f6f1a074-4f5a-4f97-aa0d-27e90f3b6dad for instance b2be05cc-d645-4d3b-9fcb-dbacd92e2f75 on hv-cinder-77819 Jun 20 07:41:47.110908 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-6571e114-0bea-475e-8718-fb245a156853 req-d5d1986c-65ae-4354-bd82-898b25e08b9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109430 Jun 20 07:41:47.112273 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1445/2763] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:41:47.281647 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a5112e09-bef5-4a36-93a6-2f1075f0fded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:47.282278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a5112e09-bef5-4a36-93a6-2f1075f0fded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:47.289256 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5112e09-bef5-4a36-93a6-2f1075f0fded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:47.289842 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5112e09-bef5-4a36-93a6-2f1075f0fded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:47.290738 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5112e09-bef5-4a36-93a6-2f1075f0fded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:47.291282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5112e09-bef5-4a36-93a6-2f1075f0fded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:47.317914 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a5112e09-bef5-4a36-93a6-2f1075f0fded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:41:47.449606 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a5112e09-bef5-4a36-93a6-2f1075f0fded tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 204 len: 0 microversion: 2.1 time: 0.171047 Jun 20 07:41:47.454572 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1319/2764] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:41:47 2022] DELETE /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:41:47.465017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6bec249d-b763-42c6-925c-8eb4c033f0ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:47.473614 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6bec249d-b763-42c6-925c-8eb4c033f0ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:47.485461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6bec249d-b763-42c6-925c-8eb4c033f0ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:47.486008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6bec249d-b763-42c6-925c-8eb4c033f0ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:47.487051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6bec249d-b763-42c6-925c-8eb4c033f0ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:47.487564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6bec249d-b763-42c6-925c-8eb4c033f0ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:47.565487 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5af9d628-951b-4d39-ac14-0f2471065200 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:47.566286 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5af9d628-951b-4d39-ac14-0f2471065200 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:47.572765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5af9d628-951b-4d39-ac14-0f2471065200 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:47.573458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5af9d628-951b-4d39-ac14-0f2471065200 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:47.574406 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5af9d628-951b-4d39-ac14-0f2471065200 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:47.575007 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5af9d628-951b-4d39-ac14-0f2471065200 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:47.591873 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-5af9d628-951b-4d39-ac14-0f2471065200 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5af9d628-951b-4d39-ac14-0f2471065200 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 HTTP/1.1 Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:41:47.593920 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:41:47.595779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:41:47.595779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:47.595779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:41:47.595779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:47.595779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:41:47.595779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:41:47.595779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:41:47.595779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:41:47.595779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:41:47.595779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:41:47.595779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:41:47.595779 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': 'b09ad717-132f-4b7d-896e-48b569f56e34'} Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:41:47.596851 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:41:47.598526 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:47.601879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5af9d628-951b-4d39-ac14-0f2471065200 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:41:47.602938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5af9d628-951b-4d39-ac14-0f2471065200 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 404 len: 111 microversion: 2.1 time: 0.041995 Jun 20 07:41:47.603999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1320/2765] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:41:47 2022] DELETE /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:41:47.615041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-06f216fc-0e87-4c89-8f9b-2b41cce65164 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:47.616207 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-06f216fc-0e87-4c89-8f9b-2b41cce65164 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] [instance: b09ad717-132f-4b7d-896e-48b569f56e34] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:47.626262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06f216fc-0e87-4c89-8f9b-2b41cce65164 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:47.627402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06f216fc-0e87-4c89-8f9b-2b41cce65164 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:47.628558 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06f216fc-0e87-4c89-8f9b-2b41cce65164 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:47.629273 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06f216fc-0e87-4c89-8f9b-2b41cce65164 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:47.645381 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-06f216fc-0e87-4c89-8f9b-2b41cce65164 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] HTTP exception thrown: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-06f216fc-0e87-4c89-8f9b-2b41cce65164 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Request method failure captured: Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 HTTP/1.1 Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisByXmbeuJmucwLd5fQyzDaDgYeGq23z8JY6DDulsy_xvo1rEjqwdwla6AmcmmSThtGaATk8V_p5eS1I6Qmze_daKnyzC6wbBEtAz8yqaI7C9a-XJGxXsdO6CR70S3_SyA-IeZbiFvnjHp1YYGSPdiGifZLWURb9WhVateRx3WM_MPrQ Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:41:47.647563 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:41:47.649475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31415828d04241249f14fb3ef6a3aa0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:41:47.649475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:47.649475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 31415828d04241249f14fb3ef6a3aa0a Jun 20 07:41:47.649475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2096212347 Jun 20 07:41:47.649475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:41:47.649475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:41:47.649475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:41:47.649475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f66183ca9d884f43befaace02099c7f2 Jun 20 07:41:47.649475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-2096212347-project Jun 20 07:41:47.649475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:41:47.649475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:41:47.649475 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': 'b09ad717-132f-4b7d-896e-48b569f56e34'} Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:41:47.650517 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. Jun 20 07:41:47.652237 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:41:47.654678 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-06f216fc-0e87-4c89-8f9b-2b41cce65164 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] Returning 404 to user: Instance b09ad717-132f-4b7d-896e-48b569f56e34 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:41:47.655549 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-06f216fc-0e87-4c89-8f9b-2b41cce65164 tempest-AttachVolumeNegativeTest-2096212347 tempest-AttachVolumeNegativeTest-2096212347-project] 10.222.0.23 "GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34" status: 404 len: 111 microversion: 2.1 time: 0.047338 Jun 20 07:41:47.656398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1321/2766] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:41:47 2022] GET /compute/v2.1/servers/b09ad717-132f-4b7d-896e-48b569f56e34 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:41:47.673557 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6bec249d-b763-42c6-925c-8eb4c033f0ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:41:47.681906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6bec249d-b763-42c6-925c-8eb4c033f0ba tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1508 microversion: 2.1 time: 0.224723 Jun 20 07:41:47.682494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1446/2767] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:41:47 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:41:48.267094 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-0ff3dcb4-71e0-473d-b567-11d74ac88b76 req-001a0824-e10f-4a5f-96ae-67c14dd745b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0ea04e-5c9f-4536-b200-1eaf64edef9c", "name": "network-vif-deleted", "tag": "7ad9a67b-4e75-4ed0-914e-85eca4e84023"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:41:48.282377 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-0ff3dcb4-71e0-473d-b567-11d74ac88b76 req-001a0824-e10f-4a5f-96ae-67c14dd745b6 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:48.283744 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-0ff3dcb4-71e0-473d-b567-11d74ac88b76 req-001a0824-e10f-4a5f-96ae-67c14dd745b6 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:48.306138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-0ff3dcb4-71e0-473d-b567-11d74ac88b76 req-001a0824-e10f-4a5f-96ae-67c14dd745b6 service nova] Creating event network-vif-deleted:7ad9a67b-4e75-4ed0-914e-85eca4e84023 for instance ec0ea04e-5c9f-4536-b200-1eaf64edef9c on hv-cinder-77819 Jun 20 07:41:48.313308 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-0ff3dcb4-71e0-473d-b567-11d74ac88b76 req-001a0824-e10f-4a5f-96ae-67c14dd745b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049768 Jun 20 07:41:48.314629 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1322/2768] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:41:48.701504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5a0bd7a9-3857-4b99-a5fc-3c9466e01fb6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:48.702944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5a0bd7a9-3857-4b99-a5fc-3c9466e01fb6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:48.713441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a0bd7a9-3857-4b99-a5fc-3c9466e01fb6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:48.718802 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a0bd7a9-3857-4b99-a5fc-3c9466e01fb6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:48.720017 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a0bd7a9-3857-4b99-a5fc-3c9466e01fb6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:48.720482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5a0bd7a9-3857-4b99-a5fc-3c9466e01fb6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:48.816942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5a0bd7a9-3857-4b99-a5fc-3c9466e01fb6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:41:48.827134 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5a0bd7a9-3857-4b99-a5fc-3c9466e01fb6 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 200 len: 1466 microversion: 2.1 time: 0.127388 Jun 20 07:41:48.828092 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1447/2769] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:41:48 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 1466 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:41:49.146259 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f456ce49-6e76-4528-9e80-541f2f2196d2 req-251b2f6d-e36d-4c38-9e7f-da2107ad219b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c3378a3-113f-4381-91ac-4478c0a3371d", "name": "network-vif-deleted", "tag": "022b9a11-cfc5-443c-a77c-b63c7232b0dd"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:41:49.172088 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f456ce49-6e76-4528-9e80-541f2f2196d2 req-251b2f6d-e36d-4c38-9e7f-da2107ad219b service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:49.172811 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f456ce49-6e76-4528-9e80-541f2f2196d2 req-251b2f6d-e36d-4c38-9e7f-da2107ad219b service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:49.195313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f456ce49-6e76-4528-9e80-541f2f2196d2 req-251b2f6d-e36d-4c38-9e7f-da2107ad219b service nova] Creating event network-vif-deleted:022b9a11-cfc5-443c-a77c-b63c7232b0dd for instance 6c3378a3-113f-4381-91ac-4478c0a3371d on hv-cinder-77819 Jun 20 07:41:49.207507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f456ce49-6e76-4528-9e80-541f2f2196d2 req-251b2f6d-e36d-4c38-9e7f-da2107ad219b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065098 Jun 20 07:41:49.208419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1323/2770] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:41:49.844163 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4539f6a0-91ba-4e2a-b35e-f812f96eb273 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:49.847198 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4539f6a0-91ba-4e2a-b35e-f812f96eb273 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 6c3378a3-113f-4381-91ac-4478c0a3371d] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:49.856782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4539f6a0-91ba-4e2a-b35e-f812f96eb273 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:49.857226 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4539f6a0-91ba-4e2a-b35e-f812f96eb273 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:49.857985 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4539f6a0-91ba-4e2a-b35e-f812f96eb273 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:49.858414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4539f6a0-91ba-4e2a-b35e-f812f96eb273 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:49.871827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-4539f6a0-91ba-4e2a-b35e-f812f96eb273 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] HTTP exception thrown: Instance 6c3378a3-113f-4381-91ac-4478c0a3371d could not be found. Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4539f6a0-91ba-4e2a-b35e-f812f96eb273 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Request method failure captured: Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d HTTP/1.1 Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisBydWR9hXTdRdgEMgIPM-1lAL620VtySsJQPtX3E4eETT6X1pqkxCAdBrQ05QM3sLf2M6w4suLslwDczM450U7T03NmXju7Tum6YsJN5wR3uh9QywM_y5Z98mk3Ttcwbp4tjIhwIlNWuRc740_x69DYuTSos87GlveyHMBK04lJyYJs Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:41:49.874012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:41:49.875989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:41:49.875989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:41:49.875989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:41:49.875989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:41:49.875989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:41:49.875989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:41:49.875989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:41:49.875989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: af0dee4e1dfb4f879dfe41622a9e23b1 Jun 20 07:41:49.875989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:41:49.875989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:41:49.875989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 6c3378a3-113f-4381-91ac-4478c0a3371d could not be found. Jun 20 07:41:49.875989 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '6c3378a3-113f-4381-91ac-4478c0a3371d'} Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c3378a3-113f-4381-91ac-4478c0a3371d could not be found. Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:41:49.877051 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c3378a3-113f-4381-91ac-4478c0a3371d could not be found. Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c3378a3-113f-4381-91ac-4478c0a3371d could not be found. Jun 20 07:41:49.879041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:49.880468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4539f6a0-91ba-4e2a-b35e-f812f96eb273 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Returning 404 to user: Instance 6c3378a3-113f-4381-91ac-4478c0a3371d could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:41:49.880468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4539f6a0-91ba-4e2a-b35e-f812f96eb273 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d" status: 404 len: 111 microversion: 2.1 time: 0.035527 Jun 20 07:41:49.880468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1448/2771] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:41:49 2022] GET /compute/v2.1/servers/6c3378a3-113f-4381-91ac-4478c0a3371d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:41:49.887515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e8218fac-79f8-4dd6-af3f-728f1684df80 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:49.888812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e8218fac-79f8-4dd6-af3f-728f1684df80 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:49.895306 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8218fac-79f8-4dd6-af3f-728f1684df80 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:49.895866 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8218fac-79f8-4dd6-af3f-728f1684df80 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:49.897118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8218fac-79f8-4dd6-af3f-728f1684df80 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:49.897809 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8218fac-79f8-4dd6-af3f-728f1684df80 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:49.925058 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e8218fac-79f8-4dd6-af3f-728f1684df80 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:41:50.010731 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e8218fac-79f8-4dd6-af3f-728f1684df80 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 204 len: 0 microversion: 2.1 time: 0.128082 Jun 20 07:41:50.011325 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1324/2772] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:41:49 2022] DELETE /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:41:50.020353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-00b2621f-d33b-4dd4-ade7-40d5513cf6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:50.021366 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-00b2621f-d33b-4dd4-ade7-40d5513cf6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:50.028408 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00b2621f-d33b-4dd4-ade7-40d5513cf6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:50.029060 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00b2621f-d33b-4dd4-ade7-40d5513cf6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:50.029910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00b2621f-d33b-4dd4-ade7-40d5513cf6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:50.030419 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-00b2621f-d33b-4dd4-ade7-40d5513cf6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:50.247142 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-00b2621f-d33b-4dd4-ade7-40d5513cf6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:41:50.263639 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-00b2621f-d33b-4dd4-ade7-40d5513cf6d8 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.247224 Jun 20 07:41:50.265577 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1449/2773] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:41:50 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:41:51.283443 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5664bd33-8cb5-4877-a677-693073bad18e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:51.285488 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5664bd33-8cb5-4877-a677-693073bad18e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:51.309319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5664bd33-8cb5-4877-a677-693073bad18e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:51.316906 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5664bd33-8cb5-4877-a677-693073bad18e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:51.318603 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5664bd33-8cb5-4877-a677-693073bad18e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:51.319710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5664bd33-8cb5-4877-a677-693073bad18e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:51.899722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5664bd33-8cb5-4877-a677-693073bad18e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:41:51.911727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5664bd33-8cb5-4877-a677-693073bad18e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1523 microversion: 2.1 time: 0.632165 Jun 20 07:41:51.914220 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1325/2774] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:41:51 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1523 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:41:52.214801 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-a7abc5a4-f3f8-4bce-a38d-feefb9006731 req-df0431bc-3ee3-4d7e-91d2-51434a15eb21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d6b982-e069-44bd-8110-df44d83d451c", "name": "network-vif-deleted", "tag": "d64665e9-c9cd-4584-98fa-4fc8c61bdd87"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:41:52.234105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-a7abc5a4-f3f8-4bce-a38d-feefb9006731 req-df0431bc-3ee3-4d7e-91d2-51434a15eb21 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:52.234842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-a7abc5a4-f3f8-4bce-a38d-feefb9006731 req-df0431bc-3ee3-4d7e-91d2-51434a15eb21 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:52.249651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-a7abc5a4-f3f8-4bce-a38d-feefb9006731 req-df0431bc-3ee3-4d7e-91d2-51434a15eb21 service nova] Creating event network-vif-deleted:d64665e9-c9cd-4584-98fa-4fc8c61bdd87 for instance 63d6b982-e069-44bd-8110-df44d83d451c on hv-cinder-77819 Jun 20 07:41:52.255200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-a7abc5a4-f3f8-4bce-a38d-feefb9006731 req-df0431bc-3ee3-4d7e-91d2-51434a15eb21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044202 Jun 20 07:41:52.256208 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1450/2775] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:41:52.932746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-57e05264-d7cb-4c71-94bb-17bc2eba5b9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:52.933485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-57e05264-d7cb-4c71-94bb-17bc2eba5b9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:52.952683 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57e05264-d7cb-4c71-94bb-17bc2eba5b9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:52.953976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57e05264-d7cb-4c71-94bb-17bc2eba5b9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:52.954777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57e05264-d7cb-4c71-94bb-17bc2eba5b9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:52.958116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57e05264-d7cb-4c71-94bb-17bc2eba5b9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:53.046572 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57e05264-d7cb-4c71-94bb-17bc2eba5b9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:53.047033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-57e05264-d7cb-4c71-94bb-17bc2eba5b9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:53.047650 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-57e05264-d7cb-4c71-94bb-17bc2eba5b9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lazy-loading 'fault' on Instance uuid 63d6b982-e069-44bd-8110-df44d83d451c {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:41:53.158797 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-57e05264-d7cb-4c71-94bb-17bc2eba5b9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0dee4e1dfb4f879dfe41622a9e23b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b7ec64ab448338374bb16c29c7b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:41:53.170150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-57e05264-d7cb-4c71-94bb-17bc2eba5b9e tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 200 len: 1312 microversion: 2.1 time: 0.238783 Jun 20 07:41:53.170150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1326/2776] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:41:52 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 1312 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:41:54.191882 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bb7895cc-d91d-4641-8a95-1177bfe40205 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:54.192720 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bb7895cc-d91d-4641-8a95-1177bfe40205 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] [instance: 63d6b982-e069-44bd-8110-df44d83d451c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:41:54.211123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb7895cc-d91d-4641-8a95-1177bfe40205 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:54.211690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb7895cc-d91d-4641-8a95-1177bfe40205 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:54.213491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb7895cc-d91d-4641-8a95-1177bfe40205 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:41:54.216626 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-bb7895cc-d91d-4641-8a95-1177bfe40205 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:41:54.237238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-bb7895cc-d91d-4641-8a95-1177bfe40205 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] HTTP exception thrown: Instance 63d6b982-e069-44bd-8110-df44d83d451c could not be found. Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bb7895cc-d91d-4641-8a95-1177bfe40205 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Request method failure captured: Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c HTTP/1.1 Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisBydWR9hXTdRdgEMgIPM-1lAL620VtySsJQPtX3E4eETT6X1pqkxCAdBrQ05QM3sLf2M6w4suLslwDczM450U7T03NmXju7Tum6YsJN5wR3uh9QywM_y5Z98mk3Ttcwbp4tjIhwIlNWuRc740_x69DYuTSos87GlveyHMBK04lJyYJs Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:41:54.239895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:41:54.241542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b07b7ec64ab448338374bb16c29c7b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:41:54.241542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:41:54.241542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: b07b7ec64ab448338374bb16c29c7b1d Jun 20 07:41:54.241542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948855940 Jun 20 07:41:54.241542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:41:54.241542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:41:54.241542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:41:54.241542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: af0dee4e1dfb4f879dfe41622a9e23b1 Jun 20 07:41:54.241542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948855940-project Jun 20 07:41:54.241542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:41:54.241542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 63d6b982-e069-44bd-8110-df44d83d451c could not be found. Jun 20 07:41:54.241542 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '63d6b982-e069-44bd-8110-df44d83d451c'} Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d6b982-e069-44bd-8110-df44d83d451c could not be found. Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:41:54.242436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d6b982-e069-44bd-8110-df44d83d451c could not be found. Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d6b982-e069-44bd-8110-df44d83d451c could not be found. Jun 20 07:41:54.244851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:41:54.255588 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bb7895cc-d91d-4641-8a95-1177bfe40205 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] Returning 404 to user: Instance 63d6b982-e069-44bd-8110-df44d83d451c could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:41:54.257227 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bb7895cc-d91d-4641-8a95-1177bfe40205 tempest-ServerRescueNegativeTestJSON-948855940 tempest-ServerRescueNegativeTestJSON-948855940-project] 10.222.0.23 "GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c" status: 404 len: 111 microversion: 2.1 time: 0.072781 Jun 20 07:41:54.258364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1451/2777] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:41:54 2022] GET /compute/v2.1/servers/63d6b982-e069-44bd-8110-df44d83d451c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:41:55.302740 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1957d977-62d9-4b50-8172-fa738ab9f525 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Action: 'create', calling method: .version_select at 0x7ffa2e4cac10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-230372613"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:41:56.003272 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1957d977-62d9-4b50-8172-fa738ab9f525 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.893935 Jun 20 07:41:56.004157 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1327/2778] 10.222.0.23 () {60 vars in 1154 bytes} [Mon Jun 20 07:41:55 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 896 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 07:41:56.016532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ec27880e-5f8e-4998-a0f3-56e58a69cf61 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fb53310>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:56.130944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ec27880e-5f8e-4998-a0f3-56e58a69cf61 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a" status: 200 len: 344 microversion: 2.1 time: 0.119191 Jun 20 07:41:56.132188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1452/2779] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:41:56 2022] GET /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a => generated 344 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:41:57.143999 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-36b60abd-99ab-41b2-aed8-8808a9cdc3c7 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fc0f310>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:57.239899 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-36b60abd-99ab-41b2-aed8-8808a9cdc3c7 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a" status: 200 len: 345 microversion: 2.1 time: 0.100447 Jun 20 07:41:57.241107 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1328/2780] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:41:57 2022] GET /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:41:57.254384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-585aef96-ed42-43c1-acb1-632828136bca tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Action: 'create', calling method: .version_select at 0x7ffa1fc284c0>, body: {"snapshot": {"volume_id": "9bb1e6eb-56c9-4a6b-8178-34c01449b25a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1052791235"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:41:57.649571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-585aef96-ed42-43c1-acb1-632828136bca tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.399553 Jun 20 07:41:57.661048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1453/2781] 10.222.0.23 () {60 vars in 1161 bytes} [Mon Jun 20 07:41:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:41:57.664138 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2877681-339d-46ff-86c8-f5ddde7a1943 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fc1da60>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:57.723677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f2877681-339d-46ff-86c8-f5ddde7a1943 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f" status: 200 len: 287 microversion: 2.1 time: 0.065701 Jun 20 07:41:57.724464 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1329/2782] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 07:41:57 2022] GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:41:57.739618 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5ddef9bb-0609-4802-aa0d-8645aa9fc54b tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fb78550>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:57.816451 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5ddef9bb-0609-4802-aa0d-8645aa9fc54b tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.084880 Jun 20 07:41:57.823037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1454/2783] 10.222.0.23 () {58 vars in 1139 bytes} [Mon Jun 20 07:41:57 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:41:57.831153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b2e826f-3f11-4990-b92a-caf3881238f5 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fae00d0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:57.888514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2b2e826f-3f11-4990-b92a-caf3881238f5 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f" status: 200 len: 287 microversion: 2.1 time: 0.064548 Jun 20 07:41:57.889633 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1330/2784] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 07:41:57 2022] GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:41:58.906660 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ae931dfb-20d7-431a-a135-434ce1983fcd tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fde7280>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:41:58.984311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ae931dfb-20d7-431a-a135-434ce1983fcd tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f" status: 200 len: 287 microversion: 2.1 time: 0.087140 Jun 20 07:41:58.986194 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1455/2785] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 07:41:58 2022] GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:42:00.001485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2863122-c11f-4800-a642-6e85fa8d288f tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fbf55e0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:00.041419 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c2863122-c11f-4800-a642-6e85fa8d288f tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f" status: 200 len: 287 microversion: 2.1 time: 0.047983 Jun 20 07:42:00.043444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1331/2786] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 07:41:59 2022] GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:42:01.056900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5acb23cd-27ce-4abb-a85e-fe36ced8ce4c tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fb74940>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:01.121935 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5acb23cd-27ce-4abb-a85e-fe36ced8ce4c tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f" status: 200 len: 288 microversion: 2.1 time: 0.071429 Jun 20 07:42:01.123459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1456/2787] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 07:42:01 2022] GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:42:01.137441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d44dac73-acee-4ab9-8ef2-9acbb4f5e510 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fb95b80>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:01.242488 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d44dac73-acee-4ab9-8ef2-9acbb4f5e510 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f" status: 202 len: 0 microversion: 2.1 time: 0.112107 Jun 20 07:42:01.243751 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1332/2788] 10.222.0.23 () {58 vars in 1253 bytes} [Mon Jun 20 07:42:01 2022] DELETE /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:42:01.252053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-128a7d20-5b94-4f1c-864c-3b6b87a58ca3 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fc03f70>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:01.295609 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-128a7d20-5b94-4f1c-864c-3b6b87a58ca3 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f" status: 200 len: 287 microversion: 2.1 time: 0.047376 Jun 20 07:42:01.296907 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1457/2789] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 07:42:01 2022] GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:42:02.307468 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4cf9ac04-fa98-419b-97e5-eaa08848a309 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fbf5820>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:02.370499 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-4cf9ac04-fa98-419b-97e5-eaa08848a309 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] HTTP exception thrown: Snapshot ac13562d-fb0d-4bc9-8962-54a38cb5c20f could not be found. Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4cf9ac04-fa98-419b-97e5-eaa08848a309 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Request method failure captured: Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f HTTP/1.1 Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisCTD524GjghLNzU8PbJ6tSFUt5MVtTFGVgLmOensZb6eSh9bDKySbSuFDchIslBJDen2Cb61Z_oGLaECt6OLcbKCFL-AapLrcLoyA0AhG6BGaCVuacOgqmhV3AFemjnHMu_djIgSX1-oWk0drvUqErM5wOP9msh1crVQRE5k7V-5hyw Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: c7ddb21614eb44f4baeafacd2e3baead Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-740616866 Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:42:02.373466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesSnapshotsTestJSON-740616866 Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: c7ddb21614eb44f4baeafacd2e3baead Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-740616866 Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesSnapshotsTestJSON-740616866-project Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f735526cee0b4837862ad8e60277b7b3 Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesSnapshotsTestJSON-740616866-project Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Snapshot ac13562d-fb0d-4bc9-8962-54a38cb5c20f could not be found. Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': 'ac13562d-fb0d-4bc9-8962-54a38cb5c20f'} Jun 20 07:42:02.375546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ac13562d-fb0d-4bc9-8962-54a38cb5c20f could not be found. (HTTP 404) (Request-ID: req-d6fe98c0-f103-4a35-87a6-82f5de1b305b) Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:02.376697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 07:42:02.378038 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ac13562d-fb0d-4bc9-8962-54a38cb5c20f could not be found. Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 20 07:42:02.379512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ac13562d-fb0d-4bc9-8962-54a38cb5c20f could not be found. Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ac13562d-fb0d-4bc9-8962-54a38cb5c20f could not be found. Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4cf9ac04-fa98-419b-97e5-eaa08848a309 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Returning 404 to user: Snapshot ac13562d-fb0d-4bc9-8962-54a38cb5c20f could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:42:02.384871 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4cf9ac04-fa98-419b-97e5-eaa08848a309 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f" status: 404 len: 111 microversion: 2.1 time: 0.072392 Jun 20 07:42:02.390900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1333/2790] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 07:42:02 2022] GET /compute/v2.1/os-snapshots/ac13562d-fb0d-4bc9-8962-54a38cb5c20f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 07:42:02.397646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d55b53ef-0f41-4ec0-8819-391216ef66ec tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fd68e50>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:02.557008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d55b53ef-0f41-4ec0-8819-391216ef66ec tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a" status: 202 len: 0 microversion: 2.1 time: 0.172026 Jun 20 07:42:02.558572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1458/2791] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 07:42:02 2022] DELETE /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:42:02.567801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-893b43e9-d5a8-4ea0-b0e2-00d2982cef98 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fc1d1f0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:02.634308 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-893b43e9-d5a8-4ea0-b0e2-00d2982cef98 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a" status: 200 len: 344 microversion: 2.1 time: 0.071432 Jun 20 07:42:02.636055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1334/2792] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:42:02 2022] GET /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:42:03.657886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c6d93e7-ed47-44e4-9201-56ff2c7d7ba0 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa2c059c10>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:03.715491 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-2c6d93e7-ed47-44e4-9201-56ff2c7d7ba0 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] HTTP exception thrown: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c6d93e7-ed47-44e4-9201-56ff2c7d7ba0 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Request method failure captured: Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a HTTP/1.1 Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisCTD524GjghLNzU8PbJ6tSFUt5MVtTFGVgLmOensZb6eSh9bDKySbSuFDchIslBJDen2Cb61Z_oGLaECt6OLcbKCFL-AapLrcLoyA0AhG6BGaCVuacOgqmhV3AFemjnHMu_djIgSX1-oWk0drvUqErM5wOP9msh1crVQRE5k7V-5hyw Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: c7ddb21614eb44f4baeafacd2e3baead Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-740616866 Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:42:03.718306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotsTestJSON-740616866 Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: c7ddb21614eb44f4baeafacd2e3baead Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-740616866 Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotsTestJSON-740616866-project Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: f735526cee0b4837862ad8e60277b7b3 Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotsTestJSON-740616866-project Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '9bb1e6eb-56c9-4a6b-8178-34c01449b25a'} Jun 20 07:42:03.720295 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. (HTTP 404) (Request-ID: req-d13d1f98-b7ec-48e7-b54d-25303c361171) Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:03.721567 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 07:42:03.723718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 07:42:03.726035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2c6d93e7-ed47-44e4-9201-56ff2c7d7ba0 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Returning 404 to user: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2c6d93e7-ed47-44e4-9201-56ff2c7d7ba0 tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a" status: 404 len: 109 microversion: 2.1 time: 0.074081 Jun 20 07:42:03.728889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1459/2793] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:42:03 2022] GET /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:42:03.734905 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-32a799ed-c93a-461a-a3bb-df43fb5c610f tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa2c01c310>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:03.745121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:42:03.746295 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:42:03.784634 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-32a799ed-c93a-461a-a3bb-df43fb5c610f tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] HTTP exception thrown: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-32a799ed-c93a-461a-a3bb-df43fb5c610f tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Request method failure captured: Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a HTTP/1.1 Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisCTD524GjghLNzU8PbJ6tSFUt5MVtTFGVgLmOensZb6eSh9bDKySbSuFDchIslBJDen2Cb61Z_oGLaECt6OLcbKCFL-AapLrcLoyA0AhG6BGaCVuacOgqmhV3AFemjnHMu_djIgSX1-oWk0drvUqErM5wOP9msh1crVQRE5k7V-5hyw Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: c7ddb21614eb44f4baeafacd2e3baead Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-740616866 Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:42:03.787240 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesSnapshotsTestJSON-740616866 Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: c7ddb21614eb44f4baeafacd2e3baead Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-740616866 Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesSnapshotsTestJSON-740616866-project Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: f735526cee0b4837862ad8e60277b7b3 Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesSnapshotsTestJSON-740616866-project Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '9bb1e6eb-56c9-4a6b-8178-34c01449b25a'} Jun 20 07:42:03.789127 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. (HTTP 404) (Request-ID: req-13d30532-312c-423c-bcec-c92562ab3fdb) Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:03.790189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 07:42:03.791949 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 07:42:03.793681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:42:03.795316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.795316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.795316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:03.795316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.795316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:03.795316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:03.795316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:03.795316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:42:03.795316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:42:03.795316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.795316 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.798697 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-32a799ed-c93a-461a-a3bb-df43fb5c610f tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Returning 404 to user: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:42:03.799179 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-32a799ed-c93a-461a-a3bb-df43fb5c610f tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a" status: 404 len: 109 microversion: 2.1 time: 0.070180 Jun 20 07:42:03.800262 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1335/2794] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 07:42:03 2022] DELETE /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:42:03.808949 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1b494205-3935-4455-b669-5555a8c33f7d tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Calling method '.version_select at 0x7ffa1fe1cca0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:03.851141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-1b494205-3935-4455-b669-5555a8c33f7d tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] HTTP exception thrown: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1b494205-3935-4455-b669-5555a8c33f7d tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Request method failure captured: Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a HTTP/1.1 Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisCTD524GjghLNzU8PbJ6tSFUt5MVtTFGVgLmOensZb6eSh9bDKySbSuFDchIslBJDen2Cb61Z_oGLaECt6OLcbKCFL-AapLrcLoyA0AhG6BGaCVuacOgqmhV3AFemjnHMu_djIgSX1-oWk0drvUqErM5wOP9msh1crVQRE5k7V-5hyw Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: c7ddb21614eb44f4baeafacd2e3baead Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-740616866 Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:42:03.853129 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7ddb21614eb44f4baeafacd2e3baead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesSnapshotsTestJSON-740616866 Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: c7ddb21614eb44f4baeafacd2e3baead Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-740616866 Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesSnapshotsTestJSON-740616866-project Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: f735526cee0b4837862ad8e60277b7b3 Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesSnapshotsTestJSON-740616866-project Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '9bb1e6eb-56c9-4a6b-8178-34c01449b25a'} Jun 20 07:42:03.854738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. (HTTP 404) (Request-ID: req-962708e3-3b1a-4390-bd4e-0f357f400a8e) Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:03.859634 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 07:42:03.862475 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 07:42:03.864981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1b494205-3935-4455-b669-5555a8c33f7d tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] Returning 404 to user: Volume 9bb1e6eb-56c9-4a6b-8178-34c01449b25a could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1b494205-3935-4455-b669-5555a8c33f7d tempest-VolumesSnapshotsTestJSON-740616866 tempest-VolumesSnapshotsTestJSON-740616866-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a" status: 404 len: 109 microversion: 2.1 time: 0.050678 Jun 20 07:42:03.872169 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1460/2795] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:42:03 2022] GET /compute/v2.1/os-volumes/9bb1e6eb-56c9-4a6b-8178-34c01449b25a => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:42:07.728254 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0d5bb70-717a-4425-8959-76b48b2f1b71 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Action: 'create', calling method: .version_select at 0x7ffa1fae0ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-922036056", "metadata": {"Type": "work"}}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0d5bb70-717a-4425-8959-76b48b2f1b71 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Request method failure captured: Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 121 Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisCTOwHEEEp2uTly119i26PMVURP47Q_ILCgx2Fh5NXGEu71YbqGP9Fon2yezeXhibhPCN3rctNCCwdLP0DckanANxK7sLaJBVUbzz8YA6SPS9B6eMfUbsH8MeGvcwAndJaNHIVRptDagknn12w5tidQ95Ng7bUT6yNPYrANIhJaAM5c Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 8e2fe3b3e7b042bd85e0a7775f2f35a1 Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:42:07.748431 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 8e2fe3b3e7b042bd85e0a7775f2f35a1 Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-1637619376-project Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: 2ea2011e97524b00bd471ffa19fcb24d Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-1637619376-project Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-922036056", "metadata": {"Type": "work"}}} Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: Jun 20 07:42:07.750623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-922036056', 'metadata': {'Type': 'work'}}}} Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise error Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi '#$%' Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:42:07.751824 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 07:42:07.753826 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 07:42:07.755506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 07:42:07.755506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.755506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0d5bb70-717a-4425-8959-76b48b2f1b71 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:42:07.755506 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f0d5bb70-717a-4425-8959-76b48b2f1b71 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.577073 Jun 20 07:42:07.759853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1336/2796] 10.222.0.23 () {60 vars in 1155 bytes} [Mon Jun 20 07:42:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 581 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:42:07.771610 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ce55d6de-1b4d-406d-882f-b9a8b1aaf678 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Action: 'create', calling method: .version_select at 0x7ffa1fb539d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1024763049", "metadata": {"Type": "work"}}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ce55d6de-1b4d-406d-882f-b9a8b1aaf678 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Request method failure captured: Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 120 Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisCTOwHEEEp2uTly119i26PMVURP47Q_ILCgx2Fh5NXGEu71YbqGP9Fon2yezeXhibhPCN3rctNCCwdLP0DckanANxK7sLaJBVUbzz8YA6SPS9B6eMfUbsH8MeGvcwAndJaNHIVRptDagknn12w5tidQ95Ng7bUT6yNPYrANIhJaAM5c Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 8e2fe3b3e7b042bd85e0a7775f2f35a1 Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:42:07.782527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 8e2fe3b3e7b042bd85e0a7775f2f35a1 Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesNegativeTest-1637619376-project Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 2ea2011e97524b00bd471ffa19fcb24d Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesNegativeTest-1637619376-project Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1024763049", "metadata": {"Type": "work"}}} Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: Jun 20 07:42:07.784410 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1024763049', 'metadata': {'Type': 'work'}}}} Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise error Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi '0' Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:42:07.789749 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 07:42:07.791710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 07:42:07.793330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 07:42:07.793330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.793330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ce55d6de-1b4d-406d-882f-b9a8b1aaf678 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:42:07.793330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ce55d6de-1b4d-406d-882f-b9a8b1aaf678 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023186 Jun 20 07:42:07.793330 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1461/2797] 10.222.0.23 () {60 vars in 1155 bytes} [Mon Jun 20 07:42:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:42:07.801810 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ddd503e-ec16-41de-936e-4da6601dc259 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Action: 'create', calling method: .version_select at 0x7ffa1fdb1ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-571323158", "metadata": {"Type": "work"}}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ddd503e-ec16-41de-936e-4da6601dc259 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Request method failure captured: Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 118 Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisCTOwHEEEp2uTly119i26PMVURP47Q_ILCgx2Fh5NXGEu71YbqGP9Fon2yezeXhibhPCN3rctNCCwdLP0DckanANxK7sLaJBVUbzz8YA6SPS9B6eMfUbsH8MeGvcwAndJaNHIVRptDagknn12w5tidQ95Ng7bUT6yNPYrANIhJaAM5c Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 8e2fe3b3e7b042bd85e0a7775f2f35a1 Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:42:07.809356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 8e2fe3b3e7b042bd85e0a7775f2f35a1 Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-1637619376-project Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: 2ea2011e97524b00bd471ffa19fcb24d Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-1637619376-project Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-571323158", "metadata": {"Type": "work"}}} Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: Jun 20 07:42:07.811113 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-571323158', 'metadata': {'Type': 'work'}}}} Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise error Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi '' Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:42:07.812472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 07:42:07.814062 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 07:42:07.815396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 07:42:07.815396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.817184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ddd503e-ec16-41de-936e-4da6601dc259 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:42:07.818280 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1ddd503e-ec16-41de-936e-4da6601dc259 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020304 Jun 20 07:42:07.829546 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1337/2798] 10.222.0.23 () {60 vars in 1155 bytes} [Mon Jun 20 07:42:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 07:42:07.831962 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=24 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:42:07.833021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=40 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:42:07.840286 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1275a72a-8c9e-4a82-9e61-a0b4d47b6816 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Calling method '.version_select at 0x7ffa1fb53ee0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:07.925311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-1275a72a-8c9e-4a82-9e61-a0b4d47b6816 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] HTTP exception thrown: Volume tempest-invalid-230560105 could not be found. Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1275a72a-8c9e-4a82-9e61-a0b4d47b6816 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Request method failure captured: Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-230560105 HTTP/1.1 Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisCTOwHEEEp2uTly119i26PMVURP47Q_ILCgx2Fh5NXGEu71YbqGP9Fon2yezeXhibhPCN3rctNCCwdLP0DckanANxK7sLaJBVUbzz8YA6SPS9B6eMfUbsH8MeGvcwAndJaNHIVRptDagknn12w5tidQ95Ng7bUT6yNPYrANIhJaAM5c Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 8e2fe3b3e7b042bd85e0a7775f2f35a1 Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:42:07.927918 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 8e2fe3b3e7b042bd85e0a7775f2f35a1 Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesNegativeTest-1637619376-project Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 2ea2011e97524b00bd471ffa19fcb24d Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesNegativeTest-1637619376-project Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Volume tempest-invalid-230560105 could not be found. Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': 'tempest-invalid-230560105'} Jun 20 07:42:07.929572 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-230560105 could not be found. (HTTP 404) (Request-ID: req-0f25defe-5c9d-42c2-b951-a9faaf554687) Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:07.930746 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 07:42:07.932390 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-230560105 could not be found. Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:42:07.933934 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-230560105 could not be found. Jun 20 07:42:07.935414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.935414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:07.935414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.935414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:07.935414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:07.935414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:07.935414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:42:07.935414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:42:07.935414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-230560105 could not be found. Jun 20 07:42:07.935414 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:07.940771 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1275a72a-8c9e-4a82-9e61-a0b4d47b6816 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Returning 404 to user: Volume tempest-invalid-230560105 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:42:07.941818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1275a72a-8c9e-4a82-9e61-a0b4d47b6816 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-230560105" status: 404 len: 98 microversion: 2.1 time: 0.111470 Jun 20 07:42:07.957784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e314ad2-6227-4044-bd2b-6c00ad715db3 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004481 Jun 20 07:42:07.963942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1338/2799] 10.222.0.23 () {58 vars in 1139 bytes} [Mon Jun 20 07:42:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 07:42:07.966249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1462/2800] 10.222.0.23 () {58 vars in 1214 bytes} [Mon Jun 20 07:42:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-230560105 => generated 98 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 07:42:07.982979 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f562f14e-fc76-4793-9c47-8ea17932a3d5 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017212 Jun 20 07:42:07.983552 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1339/2801] 10.222.0.23 () {58 vars in 1136 bytes} [Mon Jun 20 07:42:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 07:42:07.994361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f8bb53e1-2db4-4585-be06-68cd61528217 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Calling method '.version_select at 0x7ffa1fd9eb80>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:08.086743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-f8bb53e1-2db4-4585-be06-68cd61528217 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] HTTP exception thrown: Volume 0bfd791a-468e-411a-a579-511a92a92750 could not be found. Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f8bb53e1-2db4-4585-be06-68cd61528217 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Request method failure captured: Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/os-volumes/0bfd791a-468e-411a-a579-511a92a92750 HTTP/1.1 Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisCTOwHEEEp2uTly119i26PMVURP47Q_ILCgx2Fh5NXGEu71YbqGP9Fon2yezeXhibhPCN3rctNCCwdLP0DckanANxK7sLaJBVUbzz8YA6SPS9B6eMfUbsH8MeGvcwAndJaNHIVRptDagknn12w5tidQ95Ng7bUT6yNPYrANIhJaAM5c Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 8e2fe3b3e7b042bd85e0a7775f2f35a1 Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:42:08.091412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 8e2fe3b3e7b042bd85e0a7775f2f35a1 Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesNegativeTest-1637619376-project Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 2ea2011e97524b00bd471ffa19fcb24d Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesNegativeTest-1637619376-project Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Volume 0bfd791a-468e-411a-a579-511a92a92750 could not be found. Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '0bfd791a-468e-411a-a579-511a92a92750'} Jun 20 07:42:08.093021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0bfd791a-468e-411a-a579-511a92a92750 could not be found. (HTTP 404) (Request-ID: req-3857a40a-7371-4953-8835-e9100653f40d) Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:08.093981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 07:42:08.095388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0bfd791a-468e-411a-a579-511a92a92750 could not be found. Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 07:42:08.098897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0bfd791a-468e-411a-a579-511a92a92750 could not be found. Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0bfd791a-468e-411a-a579-511a92a92750 could not be found. Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f8bb53e1-2db4-4585-be06-68cd61528217 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Returning 404 to user: Volume 0bfd791a-468e-411a-a579-511a92a92750 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f8bb53e1-2db4-4585-be06-68cd61528217 tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/0bfd791a-468e-411a-a579-511a92a92750" status: 404 len: 109 microversion: 2.1 time: 0.106906 Jun 20 07:42:08.102834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1463/2802] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 07:42:07 2022] DELETE /compute/v2.1/os-volumes/0bfd791a-468e-411a-a579-511a92a92750 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 07:42:08.108723 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e92f73de-1b22-45b9-bce3-e573b00074ac tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Calling method '.version_select at 0x7ffa2dacb8b0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:08.201521 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-e92f73de-1b22-45b9-bce3-e573b00074ac tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] HTTP exception thrown: Volume 6d6d456d-9900-4910-94a8-f36bafa8e83d could not be found. Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e92f73de-1b22-45b9-bce3-e573b00074ac tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Request method failure captured: Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/os-volumes/6d6d456d-9900-4910-94a8-f36bafa8e83d HTTP/1.1 Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisCTOwHEEEp2uTly119i26PMVURP47Q_ILCgx2Fh5NXGEu71YbqGP9Fon2yezeXhibhPCN3rctNCCwdLP0DckanANxK7sLaJBVUbzz8YA6SPS9B6eMfUbsH8MeGvcwAndJaNHIVRptDagknn12w5tidQ95Ng7bUT6yNPYrANIhJaAM5c Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: 8e2fe3b3e7b042bd85e0a7775f2f35a1 Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:42:08.203409 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e2fe3b3e7b042bd85e0a7775f2f35a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 8e2fe3b3e7b042bd85e0a7775f2f35a1 Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-1637619376 Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-1637619376-project Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: 2ea2011e97524b00bd471ffa19fcb24d Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-1637619376-project Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Volume 6d6d456d-9900-4910-94a8-f36bafa8e83d could not be found. Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': '6d6d456d-9900-4910-94a8-f36bafa8e83d'} Jun 20 07:42:08.205234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d6d456d-9900-4910-94a8-f36bafa8e83d could not be found. (HTTP 404) (Request-ID: req-08d475a1-15f3-420c-9188-88752f0e76dd) Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:08.206317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 07:42:08.207676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d6d456d-9900-4910-94a8-f36bafa8e83d could not be found. Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 07:42:08.209511 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:42:08.211215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d6d456d-9900-4910-94a8-f36bafa8e83d could not be found. Jun 20 07:42:08.211215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.211215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:42:08.211215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.211215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:42:08.211215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:42:08.211215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:42:08.211215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:42:08.211215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:42:08.211215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d6d456d-9900-4910-94a8-f36bafa8e83d could not be found. Jun 20 07:42:08.211215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:42:08.216252 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e92f73de-1b22-45b9-bce3-e573b00074ac tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] Returning 404 to user: Volume 6d6d456d-9900-4910-94a8-f36bafa8e83d could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:42:08.216252 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e92f73de-1b22-45b9-bce3-e573b00074ac tempest-VolumesNegativeTest-1637619376 tempest-VolumesNegativeTest-1637619376-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/6d6d456d-9900-4910-94a8-f36bafa8e83d" status: 404 len: 109 microversion: 2.1 time: 0.111561 Jun 20 07:42:08.216252 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1340/2803] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 07:42:08 2022] GET /compute/v2.1/os-volumes/6d6d456d-9900-4910-94a8-f36bafa8e83d => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:42:12.589402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:42:12.590091 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:42:26.739238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2fedc381-ba01-49e8-ab5d-63ba0ae077cc tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Action: 'create', calling method: .version_select at 0x7ffa1fde7ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1308272379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnNznQk0BBIdqMcjNvcnxeSuxEfeNsVZ6tucrLtAwpiFN6mPEXfGYf+TsIeYSKgU5SgnPOmhSlrkeMHPvr5cxEH9B7GZDV1MCibkU51TWWj3TmqtPhjFbDT909AS6hCyg=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:42:26.756502 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-2fedc381-ba01-49e8-ab5d-63ba0ae077cc tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Getting quotas for project 0340346ca5a4424fa8a5374af75990da. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:42:26.760817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-2fedc381-ba01-49e8-ab5d-63ba0ae077cc tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Getting quotas for user eda8b1053f95458abfd8ea79227a0dcf and project 0340346ca5a4424fa8a5374af75990da. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:42:26.788474 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2fedc381-ba01-49e8-ab5d-63ba0ae077cc tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053898 Jun 20 07:42:26.789443 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1464/2804] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 07:42:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:42:26.956018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1448489976", "imageRef": "0304de50-ed67-4e2c-aae7-0cd270f2357c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1308272379", "networks": [{"uuid": "62a056f4-9437-45b3-a9da-b99eb7b37d41"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:42:27.011033 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] validate_networks() for [('62a056f4-9437-45b3-a9da-b99eb7b37d41', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:42:27.713980 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:42:27.714658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:42:27.715386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:42:27.715782 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:42:27.716229 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:42:27.730061 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:27.731805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:27.733591 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:27.734222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:27.768758 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Getting quotas for project 0340346ca5a4424fa8a5374af75990da. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:42:27.773402 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Getting quotas for user eda8b1053f95458abfd8ea79227a0dcf and project 0340346ca5a4424fa8a5374af75990da. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:42:27.785963 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:42:27.788666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0304de50-ed67-4e2c-aae7-0cd270f2357c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:42:27.853324 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0383a016-41f9-4108-926a-49ad9fd5bbfe tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900679 Jun 20 07:42:27.854352 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1341/2805] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:42:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:42:27.864555 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-bd7f30bc-756e-4329-a8df-33c1e369a17a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:27.866872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-bd7f30bc-756e-4329-a8df-33c1e369a17a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:27.993967 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-bd7f30bc-756e-4329-a8df-33c1e369a17a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:28.005495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-bd7f30bc-756e-4329-a8df-33c1e369a17a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1259 microversion: 2.1 time: 0.143770 Jun 20 07:42:28.017523 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1465/2806] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:27 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:29.023496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9097b0bb-505b-45f5-bfe5-835b6e3b845a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:29.025272 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9097b0bb-505b-45f5-bfe5-835b6e3b845a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:29.031690 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9097b0bb-505b-45f5-bfe5-835b6e3b845a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:29.032245 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9097b0bb-505b-45f5-bfe5-835b6e3b845a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:29.033500 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9097b0bb-505b-45f5-bfe5-835b6e3b845a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:29.034444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9097b0bb-505b-45f5-bfe5-835b6e3b845a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:29.108513 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9097b0bb-505b-45f5-bfe5-835b6e3b845a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:29.118977 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9097b0bb-505b-45f5-bfe5-835b6e3b845a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1311 microversion: 2.1 time: 0.099888 Jun 20 07:42:29.119984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1342/2807] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:29 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:30.137714 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a50b3690-68e2-4d29-b10a-f6a97f2fc78a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:30.138563 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a50b3690-68e2-4d29-b10a-f6a97f2fc78a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:30.146259 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a50b3690-68e2-4d29-b10a-f6a97f2fc78a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:30.146806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a50b3690-68e2-4d29-b10a-f6a97f2fc78a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:30.147672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a50b3690-68e2-4d29-b10a-f6a97f2fc78a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:30.148221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a50b3690-68e2-4d29-b10a-f6a97f2fc78a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:30.222924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a50b3690-68e2-4d29-b10a-f6a97f2fc78a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:30.230388 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a50b3690-68e2-4d29-b10a-f6a97f2fc78a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1311 microversion: 2.1 time: 0.097359 Jun 20 07:42:30.231207 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1466/2808] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:30 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:31.250186 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5a907dc3-fdd1-480e-834e-bebe9d163eb2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:31.251009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5a907dc3-fdd1-480e-834e-bebe9d163eb2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:31.258469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a907dc3-fdd1-480e-834e-bebe9d163eb2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:31.259516 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a907dc3-fdd1-480e-834e-bebe9d163eb2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:31.260441 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a907dc3-fdd1-480e-834e-bebe9d163eb2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:31.261219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a907dc3-fdd1-480e-834e-bebe9d163eb2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:31.328309 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5a907dc3-fdd1-480e-834e-bebe9d163eb2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:31.337734 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5a907dc3-fdd1-480e-834e-bebe9d163eb2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1311 microversion: 2.1 time: 0.094083 Jun 20 07:42:31.338984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1343/2809] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:31 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:32.358249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7b0d60eb-7b6f-4ae1-8048-2a6f41a89fca tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:32.359016 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7b0d60eb-7b6f-4ae1-8048-2a6f41a89fca tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:32.369106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b0d60eb-7b6f-4ae1-8048-2a6f41a89fca tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:32.373161 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b0d60eb-7b6f-4ae1-8048-2a6f41a89fca tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:32.376271 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b0d60eb-7b6f-4ae1-8048-2a6f41a89fca tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:32.376983 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7b0d60eb-7b6f-4ae1-8048-2a6f41a89fca tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:32.876236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7b0d60eb-7b6f-4ae1-8048-2a6f41a89fca tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:32.885620 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7b0d60eb-7b6f-4ae1-8048-2a6f41a89fca tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.532272 Jun 20 07:42:32.900684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1467/2810] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:32 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:42:33.909483 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d09f2682-3ef7-443f-9048-0f6d2b41b809 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:33.910099 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d09f2682-3ef7-443f-9048-0f6d2b41b809 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:33.938566 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d09f2682-3ef7-443f-9048-0f6d2b41b809 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:33.942472 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d09f2682-3ef7-443f-9048-0f6d2b41b809 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:33.943444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d09f2682-3ef7-443f-9048-0f6d2b41b809 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:33.952941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d09f2682-3ef7-443f-9048-0f6d2b41b809 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:34.404054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d09f2682-3ef7-443f-9048-0f6d2b41b809 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:34.413977 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d09f2682-3ef7-443f-9048-0f6d2b41b809 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.511870 Jun 20 07:42:34.421160 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1344/2811] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:33 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:34.431943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-3c12ae27-0c8b-439c-8ad1-6478ec29dd9b req-cc81bf39-e438-4b67-aeb7-e5526d85dfac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a546fbf-081e-4103-ab76-435ac1640009", "tag": "acf00405-f14c-42db-a345-206c7cfb6e46"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:42:34.453692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-3c12ae27-0c8b-439c-8ad1-6478ec29dd9b req-cc81bf39-e438-4b67-aeb7-e5526d85dfac service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:34.454362 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-3c12ae27-0c8b-439c-8ad1-6478ec29dd9b req-cc81bf39-e438-4b67-aeb7-e5526d85dfac service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:34.493837 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-3c12ae27-0c8b-439c-8ad1-6478ec29dd9b req-cc81bf39-e438-4b67-aeb7-e5526d85dfac service nova] Creating event network-changed:acf00405-f14c-42db-a345-206c7cfb6e46 for instance 3a546fbf-081e-4103-ab76-435ac1640009 on hv-cinder-77819 Jun 20 07:42:34.509897 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-3c12ae27-0c8b-439c-8ad1-6478ec29dd9b req-cc81bf39-e438-4b67-aeb7-e5526d85dfac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081697 Jun 20 07:42:34.514105 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1468/2812] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:42:35.434867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7768266-1a0d-40f8-916b-53ac2680a550 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:35.435410 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7768266-1a0d-40f8-916b-53ac2680a550 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:35.442383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7768266-1a0d-40f8-916b-53ac2680a550 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:35.442828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7768266-1a0d-40f8-916b-53ac2680a550 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:35.443646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7768266-1a0d-40f8-916b-53ac2680a550 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:35.444085 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7768266-1a0d-40f8-916b-53ac2680a550 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:35.644759 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7768266-1a0d-40f8-916b-53ac2680a550 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:35.654912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7768266-1a0d-40f8-916b-53ac2680a550 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.224715 Jun 20 07:42:35.655750 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1345/2813] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:35 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:36.674684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-64bb840c-d3c7-4eb7-b311-73e4f3b07e05 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:36.676437 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-64bb840c-d3c7-4eb7-b311-73e4f3b07e05 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:36.684792 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64bb840c-d3c7-4eb7-b311-73e4f3b07e05 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:36.685334 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64bb840c-d3c7-4eb7-b311-73e4f3b07e05 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:36.686144 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64bb840c-d3c7-4eb7-b311-73e4f3b07e05 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:36.686578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-64bb840c-d3c7-4eb7-b311-73e4f3b07e05 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:36.902317 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-64bb840c-d3c7-4eb7-b311-73e4f3b07e05 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:36.910883 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-64bb840c-d3c7-4eb7-b311-73e4f3b07e05 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.242344 Jun 20 07:42:36.915972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1469/2814] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:36 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:37.933112 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a6fa72d0-99ce-4b5b-bde5-0ac0a821e66f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:37.933770 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a6fa72d0-99ce-4b5b-bde5-0ac0a821e66f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:37.936282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:42:37.936959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:42:37.943533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6fa72d0-99ce-4b5b-bde5-0ac0a821e66f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:37.943990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6fa72d0-99ce-4b5b-bde5-0ac0a821e66f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:37.944852 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6fa72d0-99ce-4b5b-bde5-0ac0a821e66f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:37.945300 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6fa72d0-99ce-4b5b-bde5-0ac0a821e66f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:38.115828 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6fa72d0-99ce-4b5b-bde5-0ac0a821e66f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:38.124756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a6fa72d0-99ce-4b5b-bde5-0ac0a821e66f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.195691 Jun 20 07:42:38.126939 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1346/2815] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:37 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:39.142674 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-82a0640c-c779-41ff-ae1a-459715a00354 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:39.143352 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-82a0640c-c779-41ff-ae1a-459715a00354 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:39.145752 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=6 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:42:39.151085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82a0640c-c779-41ff-ae1a-459715a00354 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:39.151910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82a0640c-c779-41ff-ae1a-459715a00354 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:39.152718 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82a0640c-c779-41ff-ae1a-459715a00354 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:39.153166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-82a0640c-c779-41ff-ae1a-459715a00354 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:39.302910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-82a0640c-c779-41ff-ae1a-459715a00354 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:39.310189 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-82a0640c-c779-41ff-ae1a-459715a00354 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.171389 Jun 20 07:42:39.310753 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1470/2816] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:39 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:40.330666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-feb07860-1ee5-47fc-bc28-a920ca6e4edc tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:40.330666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-feb07860-1ee5-47fc-bc28-a920ca6e4edc tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:40.346571 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-feb07860-1ee5-47fc-bc28-a920ca6e4edc tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:40.347380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-feb07860-1ee5-47fc-bc28-a920ca6e4edc tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:40.348539 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-feb07860-1ee5-47fc-bc28-a920ca6e4edc tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:40.349194 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-feb07860-1ee5-47fc-bc28-a920ca6e4edc tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:40.495533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-feb07860-1ee5-47fc-bc28-a920ca6e4edc tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:40.505401 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-feb07860-1ee5-47fc-bc28-a920ca6e4edc tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.182076 Jun 20 07:42:40.509021 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1347/2817] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:40 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:41.525642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0efff917-0930-4b46-b695-76365f0a5eb5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:41.526945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0efff917-0930-4b46-b695-76365f0a5eb5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:41.533549 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0efff917-0930-4b46-b695-76365f0a5eb5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:41.534004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0efff917-0930-4b46-b695-76365f0a5eb5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:41.534762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0efff917-0930-4b46-b695-76365f0a5eb5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:41.535495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0efff917-0930-4b46-b695-76365f0a5eb5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:41.690468 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0efff917-0930-4b46-b695-76365f0a5eb5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:41.701095 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0efff917-0930-4b46-b695-76365f0a5eb5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.179175 Jun 20 07:42:41.701683 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1471/2818] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:41 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:42.718595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9cb00ec8-36b0-41ff-8b47-f59c3fff9e76 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:42.719206 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9cb00ec8-36b0-41ff-8b47-f59c3fff9e76 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:42.725580 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cb00ec8-36b0-41ff-8b47-f59c3fff9e76 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:42.726019 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cb00ec8-36b0-41ff-8b47-f59c3fff9e76 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:42.726764 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cb00ec8-36b0-41ff-8b47-f59c3fff9e76 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:42.727193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cb00ec8-36b0-41ff-8b47-f59c3fff9e76 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:42.881131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9cb00ec8-36b0-41ff-8b47-f59c3fff9e76 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:42.897610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9cb00ec8-36b0-41ff-8b47-f59c3fff9e76 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.182843 Jun 20 07:42:42.898188 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1348/2819] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:42 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:43.914760 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d7580514-b75f-47c7-93a9-d1af961916a1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:43.915374 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d7580514-b75f-47c7-93a9-d1af961916a1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:43.922436 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7580514-b75f-47c7-93a9-d1af961916a1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:43.922844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7580514-b75f-47c7-93a9-d1af961916a1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:43.923643 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7580514-b75f-47c7-93a9-d1af961916a1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:43.924088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d7580514-b75f-47c7-93a9-d1af961916a1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:44.058924 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-d7580514-b75f-47c7-93a9-d1af961916a1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:44.066365 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d7580514-b75f-47c7-93a9-d1af961916a1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.155463 Jun 20 07:42:44.067019 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1472/2820] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:43 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:45.082927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-df7af826-ecf2-473b-ac4b-8e6b9372d9d1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:45.083537 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-df7af826-ecf2-473b-ac4b-8e6b9372d9d1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:45.090903 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df7af826-ecf2-473b-ac4b-8e6b9372d9d1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:45.091345 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df7af826-ecf2-473b-ac4b-8e6b9372d9d1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:45.092097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df7af826-ecf2-473b-ac4b-8e6b9372d9d1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:45.092556 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-df7af826-ecf2-473b-ac4b-8e6b9372d9d1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:45.232220 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-df7af826-ecf2-473b-ac4b-8e6b9372d9d1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:45.239790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-df7af826-ecf2-473b-ac4b-8e6b9372d9d1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.160762 Jun 20 07:42:45.240456 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1349/2821] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:45 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:46.257188 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ca0c2672-e593-43b2-9bb5-3a5a7c196a2b tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:46.257894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ca0c2672-e593-43b2-9bb5-3a5a7c196a2b tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:46.265114 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca0c2672-e593-43b2-9bb5-3a5a7c196a2b tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:46.265640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca0c2672-e593-43b2-9bb5-3a5a7c196a2b tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:46.266478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca0c2672-e593-43b2-9bb5-3a5a7c196a2b tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:46.266922 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca0c2672-e593-43b2-9bb5-3a5a7c196a2b tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:46.399805 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca0c2672-e593-43b2-9bb5-3a5a7c196a2b tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:46.408400 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ca0c2672-e593-43b2-9bb5-3a5a7c196a2b tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.154969 Jun 20 07:42:46.408961 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1473/2822] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:46 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:47.428705 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-84311963-d72c-46e1-9ad7-bc8721a8a49e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:47.430897 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-84311963-d72c-46e1-9ad7-bc8721a8a49e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:47.438766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84311963-d72c-46e1-9ad7-bc8721a8a49e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:47.439205 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84311963-d72c-46e1-9ad7-bc8721a8a49e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:47.439978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84311963-d72c-46e1-9ad7-bc8721a8a49e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:47.440498 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84311963-d72c-46e1-9ad7-bc8721a8a49e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:47.851534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-84311963-d72c-46e1-9ad7-bc8721a8a49e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:47.860473 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-84311963-d72c-46e1-9ad7-bc8721a8a49e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.438364 Jun 20 07:42:47.861120 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1350/2823] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:47 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:48.877741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2bcf8ac3-1cfd-4af2-bf28-5bab36084999 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:48.878377 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2bcf8ac3-1cfd-4af2-bf28-5bab36084999 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:48.884944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bcf8ac3-1cfd-4af2-bf28-5bab36084999 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:48.885398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bcf8ac3-1cfd-4af2-bf28-5bab36084999 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:48.886154 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bcf8ac3-1cfd-4af2-bf28-5bab36084999 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:48.886590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2bcf8ac3-1cfd-4af2-bf28-5bab36084999 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:49.011531 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2bcf8ac3-1cfd-4af2-bf28-5bab36084999 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:49.018838 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2bcf8ac3-1cfd-4af2-bf28-5bab36084999 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.145188 Jun 20 07:42:49.019403 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1474/2824] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:48 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:50.035685 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-228a5776-dc2c-4921-9cc8-303ee3063351 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:50.036321 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-228a5776-dc2c-4921-9cc8-303ee3063351 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:50.042296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-228a5776-dc2c-4921-9cc8-303ee3063351 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:50.042742 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-228a5776-dc2c-4921-9cc8-303ee3063351 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:50.043482 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-228a5776-dc2c-4921-9cc8-303ee3063351 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:50.043913 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-228a5776-dc2c-4921-9cc8-303ee3063351 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:50.169927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-228a5776-dc2c-4921-9cc8-303ee3063351 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:50.177334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-228a5776-dc2c-4921-9cc8-303ee3063351 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.145544 Jun 20 07:42:50.177896 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1351/2825] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:50 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:50.737777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-586c0545-f25b-49ba-a049-28847bd467f4 req-48b176c5-56e6-40f6-9e27-53697b7732a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a546fbf-081e-4103-ab76-435ac1640009", "name": "network-vif-plugged", "status": "completed", "tag": "acf00405-f14c-42db-a345-206c7cfb6e46"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:42:50.747025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-586c0545-f25b-49ba-a049-28847bd467f4 req-48b176c5-56e6-40f6-9e27-53697b7732a5 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:50.747476 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-586c0545-f25b-49ba-a049-28847bd467f4 req-48b176c5-56e6-40f6-9e27-53697b7732a5 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:50.759020 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-586c0545-f25b-49ba-a049-28847bd467f4 req-48b176c5-56e6-40f6-9e27-53697b7732a5 service nova] Creating event network-vif-plugged:acf00405-f14c-42db-a345-206c7cfb6e46 for instance 3a546fbf-081e-4103-ab76-435ac1640009 on hv-cinder-77819 Jun 20 07:42:50.763945 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-586c0545-f25b-49ba-a049-28847bd467f4 req-48b176c5-56e6-40f6-9e27-53697b7732a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093386 Jun 20 07:42:50.764568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1475/2826] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:42:51.194990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bf4cb753-cc18-4817-ae38-e43145c0858e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:51.195679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bf4cb753-cc18-4817-ae38-e43145c0858e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:51.203682 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf4cb753-cc18-4817-ae38-e43145c0858e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:51.204228 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf4cb753-cc18-4817-ae38-e43145c0858e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:51.205373 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf4cb753-cc18-4817-ae38-e43145c0858e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:51.205679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bf4cb753-cc18-4817-ae38-e43145c0858e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:51.353912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bf4cb753-cc18-4817-ae38-e43145c0858e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:51.361752 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bf4cb753-cc18-4817-ae38-e43145c0858e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.171004 Jun 20 07:42:51.362319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1352/2827] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:51 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:52.379604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7d83b51c-cce7-479c-83dc-6da97662ade3 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:52.380341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7d83b51c-cce7-479c-83dc-6da97662ade3 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:52.387146 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d83b51c-cce7-479c-83dc-6da97662ade3 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:52.387598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d83b51c-cce7-479c-83dc-6da97662ade3 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:52.388407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d83b51c-cce7-479c-83dc-6da97662ade3 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:52.388855 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7d83b51c-cce7-479c-83dc-6da97662ade3 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:52.518190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7d83b51c-cce7-479c-83dc-6da97662ade3 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:52.525492 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7d83b51c-cce7-479c-83dc-6da97662ade3 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.150606 Jun 20 07:42:52.526047 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1476/2828] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:52 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:53.542600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-80c749a0-c05c-42cf-8d32-a3ca3782e562 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:53.543208 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-80c749a0-c05c-42cf-8d32-a3ca3782e562 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:53.549597 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80c749a0-c05c-42cf-8d32-a3ca3782e562 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:53.550042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80c749a0-c05c-42cf-8d32-a3ca3782e562 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:53.550785 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80c749a0-c05c-42cf-8d32-a3ca3782e562 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:53.551218 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80c749a0-c05c-42cf-8d32-a3ca3782e562 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:53.674119 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-80c749a0-c05c-42cf-8d32-a3ca3782e562 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:53.681455 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-80c749a0-c05c-42cf-8d32-a3ca3782e562 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.142608 Jun 20 07:42:53.682009 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1353/2829] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:53 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:54.698827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-8b83000e-bf20-43ac-bebe-a527f3e3f90c tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:54.699880 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-8b83000e-bf20-43ac-bebe-a527f3e3f90c tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:54.707011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b83000e-bf20-43ac-bebe-a527f3e3f90c tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:54.707459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b83000e-bf20-43ac-bebe-a527f3e3f90c tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:54.708249 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b83000e-bf20-43ac-bebe-a527f3e3f90c tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:54.708677 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-8b83000e-bf20-43ac-bebe-a527f3e3f90c tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:54.832954 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-8b83000e-bf20-43ac-bebe-a527f3e3f90c tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:54.840775 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-8b83000e-bf20-43ac-bebe-a527f3e3f90c tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.145879 Jun 20 07:42:54.841335 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1477/2830] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:54 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:55.857772 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2186510d-4237-485d-b780-12bcca70b39e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:55.858380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2186510d-4237-485d-b780-12bcca70b39e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:55.864745 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2186510d-4237-485d-b780-12bcca70b39e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:55.865193 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2186510d-4237-485d-b780-12bcca70b39e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:55.865937 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2186510d-4237-485d-b780-12bcca70b39e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:55.866368 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2186510d-4237-485d-b780-12bcca70b39e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:55.997623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2186510d-4237-485d-b780-12bcca70b39e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:56.005299 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2186510d-4237-485d-b780-12bcca70b39e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1359 microversion: 2.1 time: 0.152032 Jun 20 07:42:56.005852 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1354/2831] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:55 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:57.021757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f97634f2-6f66-47d1-a71b-78870acef039 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:57.022370 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f97634f2-6f66-47d1-a71b-78870acef039 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:57.024776 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:42:57.030160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f97634f2-6f66-47d1-a71b-78870acef039 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:57.030609 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f97634f2-6f66-47d1-a71b-78870acef039 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:57.031367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f97634f2-6f66-47d1-a71b-78870acef039 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:57.031797 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f97634f2-6f66-47d1-a71b-78870acef039 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:57.036361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=65 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:42:57.157311 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f97634f2-6f66-47d1-a71b-78870acef039 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:57.164872 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f97634f2-6f66-47d1-a71b-78870acef039 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1549 microversion: 2.1 time: 0.146935 Jun 20 07:42:57.165439 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1478/2832] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:57 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:57.181073 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7928214-07c4-41cb-9c60-7eccd3e7a0aa tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:57.181687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7928214-07c4-41cb-9c60-7eccd3e7a0aa tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:57.184600 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:42:57.189518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7928214-07c4-41cb-9c60-7eccd3e7a0aa tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:57.189964 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7928214-07c4-41cb-9c60-7eccd3e7a0aa tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:57.190718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7928214-07c4-41cb-9c60-7eccd3e7a0aa tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:57.191153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7928214-07c4-41cb-9c60-7eccd3e7a0aa tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:57.195623 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=81 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:42:57.325145 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7928214-07c4-41cb-9c60-7eccd3e7a0aa tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:57.336923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7928214-07c4-41cb-9c60-7eccd3e7a0aa tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1549 microversion: 2.1 time: 0.159564 Jun 20 07:42:57.337496 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1355/2833] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:57 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:42:57.353248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b59b3f32-0dfe-46a4-a1b2-63ed42e4ea25 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:57.357430 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b59b3f32-0dfe-46a4-a1b2-63ed42e4ea25 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:57.358199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b59b3f32-0dfe-46a4-a1b2-63ed42e4ea25 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Searching by: {'deleted': False, 'project_id': '0340346ca5a4424fa8a5374af75990da'} {{(pid=117607) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 07:42:57.364853 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b59b3f32-0dfe-46a4-a1b2-63ed42e4ea25 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:57.365296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b59b3f32-0dfe-46a4-a1b2-63ed42e4ea25 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:57.366113 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b59b3f32-0dfe-46a4-a1b2-63ed42e4ea25 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:57.366560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b59b3f32-0dfe-46a4-a1b2-63ed42e4ea25 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:57.457088 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.multi_cell_list [None req-b59b3f32-0dfe-46a4-a1b2-63ed42e4ea25 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117607) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 07:42:57.549910 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b59b3f32-0dfe-46a4-a1b2-63ed42e4ea25 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200522 Jun 20 07:42:57.550411 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1479/2834] 10.222.0.23 () {58 vars in 1124 bytes} [Mon Jun 20 07:42:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:42:57.561042 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2e0406a8-23b8-467a-a4c4-d0aceed78547 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:42:57.561656 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2e0406a8-23b8-467a-a4c4-d0aceed78547 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:42:57.567569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e0406a8-23b8-467a-a4c4-d0aceed78547 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:57.568012 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e0406a8-23b8-467a-a4c4-d0aceed78547 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:57.568784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e0406a8-23b8-467a-a4c4-d0aceed78547 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:42:57.569217 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e0406a8-23b8-467a-a4c4-d0aceed78547 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:42:57.696636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2e0406a8-23b8-467a-a4c4-d0aceed78547 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:42:57.704952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2e0406a8-23b8-467a-a4c4-d0aceed78547 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1549 microversion: 2.1 time: 0.147594 Jun 20 07:42:57.705679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1356/2835] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:42:57 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:00.267843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-d01753c4-2ca6-4af4-b34d-f6016825034a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7f27b6d-34d0-43bb-84ec-d29efa80863a"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:00.269262 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-d01753c4-2ca6-4af4-b34d-f6016825034a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:00.275893 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d01753c4-2ca6-4af4-b34d-f6016825034a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:00.276381 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d01753c4-2ca6-4af4-b34d-f6016825034a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:00.277134 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d01753c4-2ca6-4af4-b34d-f6016825034a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:00.277559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-d01753c4-2ca6-4af4-b34d-f6016825034a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:03.046238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-d01753c4-2ca6-4af4-b34d-f6016825034a tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "POST /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.782227 Jun 20 07:43:03.046846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1480/2836] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 07:43:00 2022] POST /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/os-volume_attachments => generated 194 bytes in 2784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:43:12.796674 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-513bd9dd-9efc-453d-82cd-e208ccbd17a9 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:12.797388 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-513bd9dd-9efc-453d-82cd-e208ccbd17a9 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:12.799862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:12.800529 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=11 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:12.806396 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-513bd9dd-9efc-453d-82cd-e208ccbd17a9 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:12.806850 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-513bd9dd-9efc-453d-82cd-e208ccbd17a9 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:12.807604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-513bd9dd-9efc-453d-82cd-e208ccbd17a9 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:12.808040 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-513bd9dd-9efc-453d-82cd-e208ccbd17a9 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:12.947907 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-513bd9dd-9efc-453d-82cd-e208ccbd17a9 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:12.956560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-513bd9dd-9efc-453d-82cd-e208ccbd17a9 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1595 microversion: 2.1 time: 0.164119 Jun 20 07:43:12.957447 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1357/2837] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:12 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1595 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:15.177791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-d744bc51-f153-4f15-a656-134077e2e5e9 req-ad790558-f3af-479c-82ec-a014e6e2ea2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a546fbf-081e-4103-ab76-435ac1640009", "tag": "acf00405-f14c-42db-a345-206c7cfb6e46"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:15.182735 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:15.186149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=5 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:15.187326 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:15.206942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d744bc51-f153-4f15-a656-134077e2e5e9 req-ad790558-f3af-479c-82ec-a014e6e2ea2a service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:15.206942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-d744bc51-f153-4f15-a656-134077e2e5e9 req-ad790558-f3af-479c-82ec-a014e6e2ea2a service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:15.238799 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-d744bc51-f153-4f15-a656-134077e2e5e9 req-ad790558-f3af-479c-82ec-a014e6e2ea2a service nova] Creating event network-changed:acf00405-f14c-42db-a345-206c7cfb6e46 for instance 3a546fbf-081e-4103-ab76-435ac1640009 on hv-cinder-77819 Jun 20 07:43:15.252396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-d744bc51-f153-4f15-a656-134077e2e5e9 req-ad790558-f3af-479c-82ec-a014e6e2ea2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076580 Jun 20 07:43:15.258868 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1481/2838] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:43:16.786537 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0f072b58-c299-4b43-a6e2-c662c0fa9653 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1956044505"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:16.787763 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0f072b58-c299-4b43-a6e2-c662c0fa9653 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:16.794571 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f072b58-c299-4b43-a6e2-c662c0fa9653 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:16.795030 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f072b58-c299-4b43-a6e2-c662c0fa9653 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:16.795801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f072b58-c299-4b43-a6e2-c662c0fa9653 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:16.796278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f072b58-c299-4b43-a6e2-c662c0fa9653 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:16.952491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.network.security_group_api [None req-0f072b58-c299-4b43-a6e2-c662c0fa9653 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Adding security group efdf2bea-4c89-4777-b1f5-d254c1b85f46 to port acf00405-f14c-42db-a345-206c7cfb6e46 Jun 20 07:43:17.383693 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0f072b58-c299-4b43-a6e2-c662c0fa9653 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "POST /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/action" status: 202 len: 0 microversion: 2.1 time: 0.601007 Jun 20 07:43:17.387382 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1358/2839] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:43:16 2022] POST /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:43:17.405736 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-15430511-169f-47e4-b90d-a7d3b632f52f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:17.408827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-15430511-169f-47e4-b90d-a7d3b632f52f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:17.410098 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f40497e9-4c05-4faf-8918-ee8cd6781d0a req-f6614608-43f5-453b-a24d-1f891aae39a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a546fbf-081e-4103-ab76-435ac1640009", "tag": "acf00405-f14c-42db-a345-206c7cfb6e46"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:17.426153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15430511-169f-47e4-b90d-a7d3b632f52f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:17.427354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f40497e9-4c05-4faf-8918-ee8cd6781d0a req-f6614608-43f5-453b-a24d-1f891aae39a7 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:17.427678 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15430511-169f-47e4-b90d-a7d3b632f52f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:17.428444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f40497e9-4c05-4faf-8918-ee8cd6781d0a req-f6614608-43f5-453b-a24d-1f891aae39a7 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:17.439861 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15430511-169f-47e4-b90d-a7d3b632f52f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:17.440353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-15430511-169f-47e4-b90d-a7d3b632f52f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:17.443469 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f40497e9-4c05-4faf-8918-ee8cd6781d0a req-f6614608-43f5-453b-a24d-1f891aae39a7 service nova] Creating event network-changed:acf00405-f14c-42db-a345-206c7cfb6e46 for instance 3a546fbf-081e-4103-ab76-435ac1640009 on hv-cinder-77819 Jun 20 07:43:17.452766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f40497e9-4c05-4faf-8918-ee8cd6781d0a req-f6614608-43f5-453b-a24d-1f891aae39a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053784 Jun 20 07:43:17.453894 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1359/2840] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:43:17.748681 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-15430511-169f-47e4-b90d-a7d3b632f52f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:17.759747 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-15430511-169f-47e4-b90d-a7d3b632f52f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1761 microversion: 2.1 time: 0.366926 Jun 20 07:43:17.761054 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1482/2841] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:17 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1761 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:20.930163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1747855202", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "networks": [{"uuid": "10f36958-e1ca-454a-ac35-a8afeb40f175"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:20.980978 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] validate_networks() for [('10f36958-e1ca-454a-ac35-a8afeb40f175', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:43:21.325410 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:43:21.325957 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:43:21.326613 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:43:21.327022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:43:21.327432 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:43:21.336207 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:21.336655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:21.337445 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:21.337881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:21.354666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Getting quotas for project 12e43b52db1a4e909d7f11368c2b7d97. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:43:21.359230 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Getting quotas for user 5c11f57e899148da8cafdc6443445a58 and project 12e43b52db1a4e909d7f11368c2b7d97. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:43:21.369938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:43:21.372370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:43:21.417417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0b11d9d9-23d7-4eee-82a2-4d6c614680e2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492030 Jun 20 07:43:21.418250 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1360/2842] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:43:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:43:21.428407 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-663dfe85-0f3e-48b6-95a8-cc8a136a14fd tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:21.429012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-663dfe85-0f3e-48b6-95a8-cc8a136a14fd tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:21.482582 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-663dfe85-0f3e-48b6-95a8-cc8a136a14fd tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:21.489982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-663dfe85-0f3e-48b6-95a8-cc8a136a14fd tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 200 len: 1214 microversion: 2.1 time: 0.065206 Jun 20 07:43:21.490554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1483/2843] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:21 2022] GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:22.510798 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-24e39c30-df58-4005-8dd4-75879ce984ec tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:22.511411 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-24e39c30-df58-4005-8dd4-75879ce984ec tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:22.518889 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24e39c30-df58-4005-8dd4-75879ce984ec tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:22.519330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24e39c30-df58-4005-8dd4-75879ce984ec tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:22.520081 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24e39c30-df58-4005-8dd4-75879ce984ec tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:22.520542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24e39c30-df58-4005-8dd4-75879ce984ec tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:22.599808 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-24e39c30-df58-4005-8dd4-75879ce984ec tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:22.608298 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-24e39c30-df58-4005-8dd4-75879ce984ec tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 200 len: 1272 microversion: 2.1 time: 0.101288 Jun 20 07:43:22.609192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1361/2844] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:22 2022] GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:23.625558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0b1fc037-74c6-4e55-ad70-e2e41ecbbe13 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:23.626862 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0b1fc037-74c6-4e55-ad70-e2e41ecbbe13 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:23.630878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-dc99970b-b286-4918-a0ee-35ee4bfa663f req-126c89d2-d203-4d40-8e26-fb53a0fd5f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e56d695b-4a01-4728-a47c-70ca83c4663a", "tag": "281529a8-b0ac-4035-8ad9-f38052c16a1c"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:23.634514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b1fc037-74c6-4e55-ad70-e2e41ecbbe13 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:23.634795 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b1fc037-74c6-4e55-ad70-e2e41ecbbe13 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:23.635594 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b1fc037-74c6-4e55-ad70-e2e41ecbbe13 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:23.636307 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0b1fc037-74c6-4e55-ad70-e2e41ecbbe13 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:23.655238 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-dc99970b-b286-4918-a0ee-35ee4bfa663f req-126c89d2-d203-4d40-8e26-fb53a0fd5f02 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:23.655882 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-dc99970b-b286-4918-a0ee-35ee4bfa663f req-126c89d2-d203-4d40-8e26-fb53a0fd5f02 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:23.667301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-dc99970b-b286-4918-a0ee-35ee4bfa663f req-126c89d2-d203-4d40-8e26-fb53a0fd5f02 service nova] Creating event network-changed:281529a8-b0ac-4035-8ad9-f38052c16a1c for instance e56d695b-4a01-4728-a47c-70ca83c4663a on hv-cinder-77819 Jun 20 07:43:23.672177 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-dc99970b-b286-4918-a0ee-35ee4bfa663f req-126c89d2-d203-4d40-8e26-fb53a0fd5f02 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044848 Jun 20 07:43:23.672971 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1362/2845] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:43:23.865367 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0b1fc037-74c6-4e55-ad70-e2e41ecbbe13 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:23.873659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0b1fc037-74c6-4e55-ad70-e2e41ecbbe13 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 200 len: 1314 microversion: 2.1 time: 0.252538 Jun 20 07:43:23.874554 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1484/2846] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:23 2022] GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:24.891587 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-60446cfa-624f-4e19-aa19-63073f9b28e9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:24.892357 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-60446cfa-624f-4e19-aa19-63073f9b28e9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:24.898476 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60446cfa-624f-4e19-aa19-63073f9b28e9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:24.898927 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60446cfa-624f-4e19-aa19-63073f9b28e9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:24.899684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60446cfa-624f-4e19-aa19-63073f9b28e9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:24.900133 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-60446cfa-624f-4e19-aa19-63073f9b28e9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:25.365803 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-60446cfa-624f-4e19-aa19-63073f9b28e9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:25.374128 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-60446cfa-624f-4e19-aa19-63073f9b28e9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 200 len: 1314 microversion: 2.1 time: 0.487301 Jun 20 07:43:25.374698 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1363/2847] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:24 2022] GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:26.391041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1e7558fe-2025-4586-ab34-df19b996b41b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:26.391564 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1e7558fe-2025-4586-ab34-df19b996b41b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:26.398096 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e7558fe-2025-4586-ab34-df19b996b41b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:26.398539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e7558fe-2025-4586-ab34-df19b996b41b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:26.399281 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e7558fe-2025-4586-ab34-df19b996b41b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:26.399710 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1e7558fe-2025-4586-ab34-df19b996b41b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:26.527589 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1e7558fe-2025-4586-ab34-df19b996b41b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:26.535601 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1e7558fe-2025-4586-ab34-df19b996b41b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 200 len: 1314 microversion: 2.1 time: 0.148440 Jun 20 07:43:26.536559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1485/2848] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:26 2022] GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:27.557283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ba67343e-5446-4df1-9609-67c3f0313315 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:27.557981 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ba67343e-5446-4df1-9609-67c3f0313315 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:27.566215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba67343e-5446-4df1-9609-67c3f0313315 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:27.566661 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba67343e-5446-4df1-9609-67c3f0313315 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:27.567434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba67343e-5446-4df1-9609-67c3f0313315 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:27.567876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ba67343e-5446-4df1-9609-67c3f0313315 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:27.701685 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ba67343e-5446-4df1-9609-67c3f0313315 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:27.709525 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ba67343e-5446-4df1-9609-67c3f0313315 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 200 len: 1314 microversion: 2.1 time: 0.156152 Jun 20 07:43:27.709766 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1364/2849] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:27 2022] GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:28.681906 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-452da11b-5d26-48b5-9c79-a64615b61255 req-f573cc94-432f-477e-8c64-f729646d8367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56d695b-4a01-4728-a47c-70ca83c4663a", "name": "network-vif-plugged", "status": "completed", "tag": "281529a8-b0ac-4035-8ad9-f38052c16a1c"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:28.690902 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-452da11b-5d26-48b5-9c79-a64615b61255 req-f573cc94-432f-477e-8c64-f729646d8367 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:28.691446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-452da11b-5d26-48b5-9c79-a64615b61255 req-f573cc94-432f-477e-8c64-f729646d8367 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:28.703393 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-452da11b-5d26-48b5-9c79-a64615b61255 req-f573cc94-432f-477e-8c64-f729646d8367 service nova] Creating event network-vif-plugged:281529a8-b0ac-4035-8ad9-f38052c16a1c for instance e56d695b-4a01-4728-a47c-70ca83c4663a on hv-cinder-77819 Jun 20 07:43:28.708426 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-452da11b-5d26-48b5-9c79-a64615b61255 req-f573cc94-432f-477e-8c64-f729646d8367 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030134 Jun 20 07:43:28.709221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1486/2850] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:43:28.728354 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aeba90dc-029e-4ca9-b8d6-253bc674caf8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:28.729118 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aeba90dc-029e-4ca9-b8d6-253bc674caf8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:28.736669 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aeba90dc-029e-4ca9-b8d6-253bc674caf8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:28.737137 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aeba90dc-029e-4ca9-b8d6-253bc674caf8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:28.737900 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aeba90dc-029e-4ca9-b8d6-253bc674caf8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:28.738350 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aeba90dc-029e-4ca9-b8d6-253bc674caf8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:28.902765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aeba90dc-029e-4ca9-b8d6-253bc674caf8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:28.910627 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aeba90dc-029e-4ca9-b8d6-253bc674caf8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 200 len: 1314 microversion: 2.1 time: 0.187492 Jun 20 07:43:28.911189 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1365/2851] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:28 2022] GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:29.928962 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-75eb038b-0945-4c93-b979-a323fbed231d tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:29.929765 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-75eb038b-0945-4c93-b979-a323fbed231d tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:29.936548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75eb038b-0945-4c93-b979-a323fbed231d tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:29.937069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75eb038b-0945-4c93-b979-a323fbed231d tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:29.937894 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75eb038b-0945-4c93-b979-a323fbed231d tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:29.938397 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-75eb038b-0945-4c93-b979-a323fbed231d tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:30.072659 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-75eb038b-0945-4c93-b979-a323fbed231d tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:30.080642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-75eb038b-0945-4c93-b979-a323fbed231d tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 200 len: 1314 microversion: 2.1 time: 0.157352 Jun 20 07:43:30.081213 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1487/2852] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:29 2022] GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:31.097378 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f6dccbfb-8c3a-4bae-9223-cea97dc1ae88 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:31.098000 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f6dccbfb-8c3a-4bae-9223-cea97dc1ae88 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:31.104547 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6dccbfb-8c3a-4bae-9223-cea97dc1ae88 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:31.105004 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6dccbfb-8c3a-4bae-9223-cea97dc1ae88 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:31.105765 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6dccbfb-8c3a-4bae-9223-cea97dc1ae88 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:31.106223 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6dccbfb-8c3a-4bae-9223-cea97dc1ae88 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:31.237018 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f6dccbfb-8c3a-4bae-9223-cea97dc1ae88 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:31.244385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f6dccbfb-8c3a-4bae-9223-cea97dc1ae88 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 200 len: 1497 microversion: 2.1 time: 0.150865 Jun 20 07:43:31.244951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1366/2853] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:31 2022] GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:31.619078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-39ae0349-68fb-4f3c-ae0e-0ba52c1f59c8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:31.619905 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-39ae0349-68fb-4f3c-ae0e-0ba52c1f59c8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:31.622448 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:31.628993 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39ae0349-68fb-4f3c-ae0e-0ba52c1f59c8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:31.629447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39ae0349-68fb-4f3c-ae0e-0ba52c1f59c8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:31.630202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39ae0349-68fb-4f3c-ae0e-0ba52c1f59c8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:31.630637 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-39ae0349-68fb-4f3c-ae0e-0ba52c1f59c8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:31.657611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-39ae0349-68fb-4f3c-ae0e-0ba52c1f59c8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:43:31.737536 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-39ae0349-68fb-4f3c-ae0e-0ba52c1f59c8 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 204 len: 0 microversion: 2.1 time: 0.121774 Jun 20 07:43:31.738306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1488/2854] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:43:31 2022] DELETE /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:43:31.746892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1374c3f8-ac61-44be-a421-bb57cbb3e7a9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:31.747671 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1374c3f8-ac61-44be-a421-bb57cbb3e7a9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:31.753802 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:31.754466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:31.756063 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1374c3f8-ac61-44be-a421-bb57cbb3e7a9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:31.756479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1374c3f8-ac61-44be-a421-bb57cbb3e7a9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:31.757531 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1374c3f8-ac61-44be-a421-bb57cbb3e7a9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:31.758163 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1374c3f8-ac61-44be-a421-bb57cbb3e7a9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:31.889931 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1374c3f8-ac61-44be-a421-bb57cbb3e7a9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:31.897438 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1374c3f8-ac61-44be-a421-bb57cbb3e7a9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 200 len: 1503 microversion: 2.1 time: 0.154461 Jun 20 07:43:31.898006 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1367/2855] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:31 2022] GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:32.858854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-daa246b0-e8ee-45b5-a835-aad38faa814f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:32.859891 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-daa246b0-e8ee-45b5-a835-aad38faa814f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:32.866310 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-daa246b0-e8ee-45b5-a835-aad38faa814f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:32.866762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-daa246b0-e8ee-45b5-a835-aad38faa814f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:32.867520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-daa246b0-e8ee-45b5-a835-aad38faa814f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:32.867955 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-daa246b0-e8ee-45b5-a835-aad38faa814f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:32.914666 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-84fd694e-6e34-4895-be78-949c58795ca2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:32.915284 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-84fd694e-6e34-4895-be78-949c58795ca2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:32.922935 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84fd694e-6e34-4895-be78-949c58795ca2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:32.923569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84fd694e-6e34-4895-be78-949c58795ca2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:32.924548 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84fd694e-6e34-4895-be78-949c58795ca2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:32.924988 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-84fd694e-6e34-4895-be78-949c58795ca2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:32.941562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-daa246b0-e8ee-45b5-a835-aad38faa814f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "POST /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/action" status: 202 len: 0 microversion: 2.1 time: 0.087188 Jun 20 07:43:32.945123 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1489/2856] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:43:32 2022] POST /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:43:32.950445 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-29789d6b-c375-474c-9c4e-17b2401c09ac tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:32.951147 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-29789d6b-c375-474c-9c4e-17b2401c09ac tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:32.957248 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29789d6b-c375-474c-9c4e-17b2401c09ac tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:32.957692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29789d6b-c375-474c-9c4e-17b2401c09ac tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:32.958447 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29789d6b-c375-474c-9c4e-17b2401c09ac tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:32.958876 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29789d6b-c375-474c-9c4e-17b2401c09ac tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:33.116355 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-84fd694e-6e34-4895-be78-949c58795ca2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:33.143795 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-84fd694e-6e34-4895-be78-949c58795ca2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 200 len: 1503 microversion: 2.1 time: 0.232701 Jun 20 07:43:33.144608 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1368/2857] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:32 2022] GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:43:33.186558 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29789d6b-c375-474c-9c4e-17b2401c09ac tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:33.194420 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-29789d6b-c375-474c-9c4e-17b2401c09ac tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1753 microversion: 2.1 time: 0.248006 Jun 20 07:43:33.194992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1490/2858] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:32 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1753 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:43:33.588822 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-52e2c07a-5490-45e6-9dd4-a06cb6d3bfa3 req-a93564fd-ca9f-4cdc-ab35-e6f88807e879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56d695b-4a01-4728-a47c-70ca83c4663a", "name": "network-vif-deleted", "tag": "281529a8-b0ac-4035-8ad9-f38052c16a1c"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:33.599200 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-52e2c07a-5490-45e6-9dd4-a06cb6d3bfa3 req-a93564fd-ca9f-4cdc-ab35-e6f88807e879 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:33.599636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-52e2c07a-5490-45e6-9dd4-a06cb6d3bfa3 req-a93564fd-ca9f-4cdc-ab35-e6f88807e879 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:33.615872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-52e2c07a-5490-45e6-9dd4-a06cb6d3bfa3 req-a93564fd-ca9f-4cdc-ab35-e6f88807e879 service nova] Creating event network-vif-deleted:281529a8-b0ac-4035-8ad9-f38052c16a1c for instance e56d695b-4a01-4728-a47c-70ca83c4663a on hv-cinder-77819 Jun 20 07:43:33.621072 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-52e2c07a-5490-45e6-9dd4-a06cb6d3bfa3 req-a93564fd-ca9f-4cdc-ab35-e6f88807e879 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035777 Jun 20 07:43:33.622134 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1369/2859] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:43:34.162098 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b0b76849-3825-4ec9-9cc7-ebbbf9f28a8e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:34.162828 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b0b76849-3825-4ec9-9cc7-ebbbf9f28a8e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: e56d695b-4a01-4728-a47c-70ca83c4663a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:34.168986 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0b76849-3825-4ec9-9cc7-ebbbf9f28a8e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:34.169514 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0b76849-3825-4ec9-9cc7-ebbbf9f28a8e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:34.170183 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0b76849-3825-4ec9-9cc7-ebbbf9f28a8e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:34.170617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b0b76849-3825-4ec9-9cc7-ebbbf9f28a8e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:34.184078 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-b0b76849-3825-4ec9-9cc7-ebbbf9f28a8e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] HTTP exception thrown: Instance e56d695b-4a01-4728-a47c-70ca83c4663a could not be found. Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b0b76849-3825-4ec9-9cc7-ebbbf9f28a8e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Request method failure captured: Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a HTTP/1.1 Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisCUX4W0Z2k3-95W-gGF5FHVJWIQNotLrUKm8sG8WFnBuXGeFobOj9xtibqXYYzG3UVkYLdB41FfcbHwOaR-qSnaQeaxZ94Sw73FBfbSYmWVyg8bNlxpIl2ozkQ-hrJjXOfww7u7CVEeexNIwif7n33lAZeabgkcSDS14usdOVN0lv_o Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 12e43b52db1a4e909d7f11368c2b7d97 Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesActionsTest-2119344596 Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:43:34.185743 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:43:34.186854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_12e43b52db1a4e909d7f11368c2b7d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12e43b52db1a4e909d7f11368c2b7d97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/12e43b52db1a4e909d7f11368c2b7d97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12e43b52db1a4e909d7f11368c2b7d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:43:34.186854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesActionsTest-2119344596 Jun 20 07:43:34.186854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 12e43b52db1a4e909d7f11368c2b7d97 Jun 20 07:43:34.186854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesActionsTest-2119344596 Jun 20 07:43:34.186854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesActionsTest-2119344596-project Jun 20 07:43:34.186854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:43:34.186854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:43:34.186854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 5c11f57e899148da8cafdc6443445a58 Jun 20 07:43:34.186854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesActionsTest-2119344596-project Jun 20 07:43:34.186854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:43:34.186854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance e56d695b-4a01-4728-a47c-70ca83c4663a could not be found. Jun 20 07:43:34.186854 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': 'e56d695b-4a01-4728-a47c-70ca83c4663a'} Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e56d695b-4a01-4728-a47c-70ca83c4663a could not be found. Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:43:34.188081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e56d695b-4a01-4728-a47c-70ca83c4663a could not be found. Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e56d695b-4a01-4728-a47c-70ca83c4663a could not be found. Jun 20 07:43:34.189323 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:43:34.190443 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b0b76849-3825-4ec9-9cc7-ebbbf9f28a8e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Returning 404 to user: Instance e56d695b-4a01-4728-a47c-70ca83c4663a could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:43:34.190443 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b0b76849-3825-4ec9-9cc7-ebbbf9f28a8e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a" status: 404 len: 111 microversion: 2.1 time: 0.029109 Jun 20 07:43:34.190443 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1491/2860] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:34 2022] GET /compute/v2.1/servers/e56d695b-4a01-4728-a47c-70ca83c4663a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 07:43:34.212151 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-54f2b8ac-13bf-4182-8ed8-7e3ff564ac52 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:34.213359 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-54f2b8ac-13bf-4182-8ed8-7e3ff564ac52 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:34.219967 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54f2b8ac-13bf-4182-8ed8-7e3ff564ac52 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:34.220839 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54f2b8ac-13bf-4182-8ed8-7e3ff564ac52 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:34.221746 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54f2b8ac-13bf-4182-8ed8-7e3ff564ac52 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:34.222169 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54f2b8ac-13bf-4182-8ed8-7e3ff564ac52 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:34.294497 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2066277936", "imageRef": "f49a9d34-6ce9-4ba0-a6b5-4d931512a379", "flavorRef": "452", "networks": [{"uuid": "10f36958-e1ca-454a-ac35-a8afeb40f175"}]}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:34.346011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.network.neutron [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] validate_networks() for [('10f36958-e1ca-454a-ac35-a8afeb40f175', None, None, None, None, None)] {{(pid=117607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:43:34.525178 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-54f2b8ac-13bf-4182-8ed8-7e3ff564ac52 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:34.533051 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-54f2b8ac-13bf-4182-8ed8-7e3ff564ac52 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1758 microversion: 2.1 time: 0.324955 Jun 20 07:43:34.533616 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1370/2861] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:34 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1758 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:35.074561 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Flavor limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:43:35.074981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Image limits 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:43:35.075441 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Flavor pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:43:35.075844 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Image pref 0:0:0 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:43:35.076318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.virt.hardware [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:43:35.085484 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:35.085926 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:35.086712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:35.087143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:35.103740 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Getting quotas for project 12e43b52db1a4e909d7f11368c2b7d97. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:43:35.107620 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Getting quotas for user 5c11f57e899148da8cafdc6443445a58 and project 12e43b52db1a4e909d7f11368c2b7d97. Resources: {'instances', 'ram', 'cores'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:43:35.118316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Going to run 1 instances... {{(pid=117607) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:43:35.120579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f49a9d34-6ce9-4ba0-a6b5-4d931512a379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:43:35.167112 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR oslo.messaging._drivers.impl_rabbit [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [7ad96e08-1929-46f7-bd8c-eddac38705e7] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 07:43:35.550257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-66d728b6-b994-4891-8613-c3573088e506 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:35.550878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-66d728b6-b994-4891-8613-c3573088e506 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:35.557638 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66d728b6-b994-4891-8613-c3573088e506 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:35.558093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66d728b6-b994-4891-8613-c3573088e506 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:35.558887 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66d728b6-b994-4891-8613-c3573088e506 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:35.559330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66d728b6-b994-4891-8613-c3573088e506 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:35.702278 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-66d728b6-b994-4891-8613-c3573088e506 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:35.710974 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-66d728b6-b994-4891-8613-c3573088e506 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1758 microversion: 2.1 time: 0.164486 Jun 20 07:43:35.711637 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1371/2862] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:35 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:43:36.174534 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [7ad96e08-1929-46f7-bd8c-eddac38705e7] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60526. Jun 20 07:43:36.178329 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-825bce88-9eae-4976-9e18-9efbfef99134 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.887681 Jun 20 07:43:36.178972 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1492/2863] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:43:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 07:43:36.188684 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7a8a89e4-fc14-47c7-98fe-8e740bf02ea1 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:36.189294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7a8a89e4-fc14-47c7-98fe-8e740bf02ea1 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:36.240677 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7a8a89e4-fc14-47c7-98fe-8e740bf02ea1 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:36.247152 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7a8a89e4-fc14-47c7-98fe-8e740bf02ea1 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 200 len: 1214 microversion: 2.1 time: 0.062211 Jun 20 07:43:36.247756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1372/2864] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:36 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 1214 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:36.728565 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-b01ca04b-a6ee-4323-9d86-b0e822581056 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:36.729197 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-b01ca04b-a6ee-4323-9d86-b0e822581056 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:36.735265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b01ca04b-a6ee-4323-9d86-b0e822581056 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:36.735712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b01ca04b-a6ee-4323-9d86-b0e822581056 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:36.736504 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b01ca04b-a6ee-4323-9d86-b0e822581056 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:36.736936 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-b01ca04b-a6ee-4323-9d86-b0e822581056 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:36.887190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-b01ca04b-a6ee-4323-9d86-b0e822581056 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:36.898943 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-b01ca04b-a6ee-4323-9d86-b0e822581056 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1758 microversion: 2.1 time: 0.174277 Jun 20 07:43:36.899511 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1493/2865] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:36 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:37.264410 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c5a45a38-d6dc-43a0-8237-fe28c6e1fee2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:37.265543 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c5a45a38-d6dc-43a0-8237-fe28c6e1fee2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:37.272509 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5a45a38-d6dc-43a0-8237-fe28c6e1fee2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:37.272960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5a45a38-d6dc-43a0-8237-fe28c6e1fee2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:37.273727 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5a45a38-d6dc-43a0-8237-fe28c6e1fee2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:37.274170 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5a45a38-d6dc-43a0-8237-fe28c6e1fee2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:37.356955 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5a45a38-d6dc-43a0-8237-fe28c6e1fee2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:37.365022 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c5a45a38-d6dc-43a0-8237-fe28c6e1fee2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 200 len: 1272 microversion: 2.1 time: 0.104497 Jun 20 07:43:37.365590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1373/2866] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:37 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:37.916036 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-29fb0d7e-bc46-4e83-a076-ebe2a0fbcf1f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:37.916774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-29fb0d7e-bc46-4e83-a076-ebe2a0fbcf1f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:37.923637 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29fb0d7e-bc46-4e83-a076-ebe2a0fbcf1f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:37.924182 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29fb0d7e-bc46-4e83-a076-ebe2a0fbcf1f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:37.924937 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29fb0d7e-bc46-4e83-a076-ebe2a0fbcf1f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:37.925364 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-29fb0d7e-bc46-4e83-a076-ebe2a0fbcf1f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:38.149279 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-29fb0d7e-bc46-4e83-a076-ebe2a0fbcf1f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:38.157895 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-29fb0d7e-bc46-4e83-a076-ebe2a0fbcf1f tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1758 microversion: 2.1 time: 0.245878 Jun 20 07:43:38.158550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1494/2867] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:37 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1758 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:43:38.382184 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6b6f1075-8e45-4c53-bec1-6e425a404459 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:38.382805 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6b6f1075-8e45-4c53-bec1-6e425a404459 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:38.389541 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b6f1075-8e45-4c53-bec1-6e425a404459 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:38.389987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b6f1075-8e45-4c53-bec1-6e425a404459 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:38.390951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b6f1075-8e45-4c53-bec1-6e425a404459 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:38.391390 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b6f1075-8e45-4c53-bec1-6e425a404459 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:38.421646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-f7aabe75-c1ab-4866-8895-db8402adf15f req-6831de7a-96dd-43d5-8962-8c866057a56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4c50c5-e5ad-4125-b91c-c2f4748c321a", "tag": "353bc33e-16bd-4242-be12-c5ff6872466c"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:38.439160 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f7aabe75-c1ab-4866-8895-db8402adf15f req-6831de7a-96dd-43d5-8962-8c866057a56f service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:38.439619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-f7aabe75-c1ab-4866-8895-db8402adf15f req-6831de7a-96dd-43d5-8962-8c866057a56f service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:38.453843 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-f7aabe75-c1ab-4866-8895-db8402adf15f req-6831de7a-96dd-43d5-8962-8c866057a56f service nova] Creating event network-changed:353bc33e-16bd-4242-be12-c5ff6872466c for instance 8d4c50c5-e5ad-4125-b91c-c2f4748c321a on hv-cinder-77819 Jun 20 07:43:38.459029 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-f7aabe75-c1ab-4866-8895-db8402adf15f req-6831de7a-96dd-43d5-8962-8c866057a56f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041840 Jun 20 07:43:38.459643 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1495/2868] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:43:38.570124 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6b6f1075-8e45-4c53-bec1-6e425a404459 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:38.577485 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6b6f1075-8e45-4c53-bec1-6e425a404459 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 200 len: 1314 microversion: 2.1 time: 0.199199 Jun 20 07:43:38.578051 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1374/2869] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:38 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:39.176147 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e4c4877c-95e4-48c1-8e5b-1663761d6644 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:39.176791 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e4c4877c-95e4-48c1-8e5b-1663761d6644 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:39.183243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4c4877c-95e4-48c1-8e5b-1663761d6644 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:39.183688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4c4877c-95e4-48c1-8e5b-1663761d6644 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:39.184493 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4c4877c-95e4-48c1-8e5b-1663761d6644 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:39.184925 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e4c4877c-95e4-48c1-8e5b-1663761d6644 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:39.374421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-e4c4877c-95e4-48c1-8e5b-1663761d6644 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:39.382846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e4c4877c-95e4-48c1-8e5b-1663761d6644 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1758 microversion: 2.1 time: 0.211624 Jun 20 07:43:39.383472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1496/2870] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:39 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1758 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:39.594319 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dfa672e7-7ec5-4b04-af52-030e96e315f9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:39.594942 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dfa672e7-7ec5-4b04-af52-030e96e315f9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:39.601454 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfa672e7-7ec5-4b04-af52-030e96e315f9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:39.601904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfa672e7-7ec5-4b04-af52-030e96e315f9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:39.602664 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfa672e7-7ec5-4b04-af52-030e96e315f9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:39.603107 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dfa672e7-7ec5-4b04-af52-030e96e315f9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:39.733426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dfa672e7-7ec5-4b04-af52-030e96e315f9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:39.740797 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dfa672e7-7ec5-4b04-af52-030e96e315f9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 200 len: 1314 microversion: 2.1 time: 0.150426 Jun 20 07:43:39.741366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1375/2871] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:39 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:40.399497 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f050140a-27d5-4211-83dd-e0bed5361e49 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:40.400124 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f050140a-27d5-4211-83dd-e0bed5361e49 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:40.406712 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f050140a-27d5-4211-83dd-e0bed5361e49 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:40.407150 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f050140a-27d5-4211-83dd-e0bed5361e49 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:40.408072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f050140a-27d5-4211-83dd-e0bed5361e49 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:40.408534 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f050140a-27d5-4211-83dd-e0bed5361e49 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:40.548532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f050140a-27d5-4211-83dd-e0bed5361e49 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:40.556361 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f050140a-27d5-4211-83dd-e0bed5361e49 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1758 microversion: 2.1 time: 0.160613 Jun 20 07:43:40.556839 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1497/2872] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:40 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:40.757630 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-06f4ee93-d176-4884-b69e-f507e6df9b55 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:40.758246 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-06f4ee93-d176-4884-b69e-f507e6df9b55 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:40.764649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06f4ee93-d176-4884-b69e-f507e6df9b55 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:40.765093 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06f4ee93-d176-4884-b69e-f507e6df9b55 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:40.765838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06f4ee93-d176-4884-b69e-f507e6df9b55 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:40.766269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-06f4ee93-d176-4884-b69e-f507e6df9b55 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:40.890541 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-06f4ee93-d176-4884-b69e-f507e6df9b55 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:40.897801 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-06f4ee93-d176-4884-b69e-f507e6df9b55 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 200 len: 1314 microversion: 2.1 time: 0.144056 Jun 20 07:43:40.898356 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1376/2873] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:40 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:41.573952 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1a342955-e4d7-4d34-9867-3d8f52c68ee5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:41.574568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1a342955-e4d7-4d34-9867-3d8f52c68ee5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:41.581772 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a342955-e4d7-4d34-9867-3d8f52c68ee5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:41.582222 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a342955-e4d7-4d34-9867-3d8f52c68ee5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:41.583042 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a342955-e4d7-4d34-9867-3d8f52c68ee5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:41.583487 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1a342955-e4d7-4d34-9867-3d8f52c68ee5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:41.727116 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1a342955-e4d7-4d34-9867-3d8f52c68ee5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:41.735398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1a342955-e4d7-4d34-9867-3d8f52c68ee5 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1758 microversion: 2.1 time: 0.165304 Jun 20 07:43:41.735959 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1498/2874] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:41 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:41.914926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63b4be9e-e4da-4a53-9c1d-a737ed991faf tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:41.915560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63b4be9e-e4da-4a53-9c1d-a737ed991faf tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:41.922881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63b4be9e-e4da-4a53-9c1d-a737ed991faf tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:41.923331 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63b4be9e-e4da-4a53-9c1d-a737ed991faf tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:41.924087 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63b4be9e-e4da-4a53-9c1d-a737ed991faf tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:41.924548 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63b4be9e-e4da-4a53-9c1d-a737ed991faf tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:41.941932 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:42.052173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-63b4be9e-e4da-4a53-9c1d-a737ed991faf tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:42.059433 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63b4be9e-e4da-4a53-9c1d-a737ed991faf tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 200 len: 1314 microversion: 2.1 time: 0.148508 Jun 20 07:43:42.059993 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1377/2875] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:41 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:42.752578 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ca779c10-f197-4429-bb55-7de9a068beba tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:42.753322 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ca779c10-f197-4429-bb55-7de9a068beba tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:42.760075 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca779c10-f197-4429-bb55-7de9a068beba tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:42.760559 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca779c10-f197-4429-bb55-7de9a068beba tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:42.761333 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca779c10-f197-4429-bb55-7de9a068beba tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:42.761774 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ca779c10-f197-4429-bb55-7de9a068beba tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:42.780958 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:42.919235 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ca779c10-f197-4429-bb55-7de9a068beba tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:42.927471 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ca779c10-f197-4429-bb55-7de9a068beba tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1758 microversion: 2.1 time: 0.179083 Jun 20 07:43:42.928314 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1499/2876] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:42 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:43.076702 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f5266aaf-8baa-465b-83d6-ae0a6f2f4a3a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:43.077323 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f5266aaf-8baa-465b-83d6-ae0a6f2f4a3a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:43.080269 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:43.085605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5266aaf-8baa-465b-83d6-ae0a6f2f4a3a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:43.086050 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5266aaf-8baa-465b-83d6-ae0a6f2f4a3a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:43.086817 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5266aaf-8baa-465b-83d6-ae0a6f2f4a3a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:43.087254 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f5266aaf-8baa-465b-83d6-ae0a6f2f4a3a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:43.220088 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f5266aaf-8baa-465b-83d6-ae0a6f2f4a3a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:43.227421 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f5266aaf-8baa-465b-83d6-ae0a6f2f4a3a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 200 len: 1314 microversion: 2.1 time: 0.154617 Jun 20 07:43:43.228015 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1378/2877] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:43 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:43.944982 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-a958a867-e451-4e1d-a957-a6bc053944a2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:43.945498 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-a958a867-e451-4e1d-a957-a6bc053944a2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:43.952064 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a958a867-e451-4e1d-a957-a6bc053944a2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:43.952544 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a958a867-e451-4e1d-a957-a6bc053944a2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:43.953305 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a958a867-e451-4e1d-a957-a6bc053944a2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:43.953738 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-a958a867-e451-4e1d-a957-a6bc053944a2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:44.201946 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-a958a867-e451-4e1d-a957-a6bc053944a2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:44.210200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-a958a867-e451-4e1d-a957-a6bc053944a2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1758 microversion: 2.1 time: 0.269271 Jun 20 07:43:44.210766 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1500/2878] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:43 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1758 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:44.243784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-15f79c16-3ab4-4fb9-9804-902014dee20a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:44.244426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-15f79c16-3ab4-4fb9-9804-902014dee20a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:44.251060 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15f79c16-3ab4-4fb9-9804-902014dee20a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:44.251508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15f79c16-3ab4-4fb9-9804-902014dee20a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:44.252292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15f79c16-3ab4-4fb9-9804-902014dee20a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:44.252732 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-15f79c16-3ab4-4fb9-9804-902014dee20a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:44.380261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-15f79c16-3ab4-4fb9-9804-902014dee20a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:44.387518 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-15f79c16-3ab4-4fb9-9804-902014dee20a tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 200 len: 1314 microversion: 2.1 time: 0.147523 Jun 20 07:43:44.388083 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1379/2879] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:44 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:44.893244 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-edfadcd1-c4e4-4db0-8069-1d32146eb718 req-8fdd4eec-fe68-4a5a-980b-1573c217e67e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4c50c5-e5ad-4125-b91c-c2f4748c321a", "name": "network-vif-plugged", "status": "completed", "tag": "353bc33e-16bd-4242-be12-c5ff6872466c"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:44.901412 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-edfadcd1-c4e4-4db0-8069-1d32146eb718 req-8fdd4eec-fe68-4a5a-980b-1573c217e67e service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:44.901842 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-edfadcd1-c4e4-4db0-8069-1d32146eb718 req-8fdd4eec-fe68-4a5a-980b-1573c217e67e service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:44.914923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-edfadcd1-c4e4-4db0-8069-1d32146eb718 req-8fdd4eec-fe68-4a5a-980b-1573c217e67e service nova] Creating event network-vif-plugged:353bc33e-16bd-4242-be12-c5ff6872466c for instance 8d4c50c5-e5ad-4125-b91c-c2f4748c321a on hv-cinder-77819 Jun 20 07:43:44.920006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-edfadcd1-c4e4-4db0-8069-1d32146eb718 req-8fdd4eec-fe68-4a5a-980b-1573c217e67e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030408 Jun 20 07:43:44.921034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1501/2880] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:43:45.226602 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1bf3f3a6-8ee8-4f2e-9d0f-f1532e4fd243 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:45.227227 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1bf3f3a6-8ee8-4f2e-9d0f-f1532e4fd243 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:45.233301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bf3f3a6-8ee8-4f2e-9d0f-f1532e4fd243 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:45.233751 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bf3f3a6-8ee8-4f2e-9d0f-f1532e4fd243 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:45.234542 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bf3f3a6-8ee8-4f2e-9d0f-f1532e4fd243 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:45.234984 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1bf3f3a6-8ee8-4f2e-9d0f-f1532e4fd243 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:45.379256 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1bf3f3a6-8ee8-4f2e-9d0f-f1532e4fd243 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:45.387121 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1bf3f3a6-8ee8-4f2e-9d0f-f1532e4fd243 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1761 microversion: 2.1 time: 0.164378 Jun 20 07:43:45.387687 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1380/2881] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:45 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1761 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:45.404568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-4c565903-4b7c-4b0e-979a-2c6151981aa9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:45.405253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-4c565903-4b7c-4b0e-979a-2c6151981aa9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:45.408130 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:45.408782 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=6 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:45.409478 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:45.416139 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c565903-4b7c-4b0e-979a-2c6151981aa9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:45.416520 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c565903-4b7c-4b0e-979a-2c6151981aa9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:45.417266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c565903-4b7c-4b0e-979a-2c6151981aa9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:45.417695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-4c565903-4b7c-4b0e-979a-2c6151981aa9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:45.546431 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-4c565903-4b7c-4b0e-979a-2c6151981aa9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:45.553867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-4c565903-4b7c-4b0e-979a-2c6151981aa9 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 200 len: 1314 microversion: 2.1 time: 0.153571 Jun 20 07:43:45.554421 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1502/2882] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:45 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:45.638815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:43:45.638977 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:43:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:43:46.570225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9304ed38-b1d2-4c6e-9d6c-4bb98387710e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:46.570863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9304ed38-b1d2-4c6e-9d6c-4bb98387710e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:46.572788 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:43:46.578393 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9304ed38-b1d2-4c6e-9d6c-4bb98387710e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:46.578848 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9304ed38-b1d2-4c6e-9d6c-4bb98387710e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:46.579605 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9304ed38-b1d2-4c6e-9d6c-4bb98387710e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:46.580044 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9304ed38-b1d2-4c6e-9d6c-4bb98387710e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:46.710134 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9304ed38-b1d2-4c6e-9d6c-4bb98387710e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:46.718301 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9304ed38-b1d2-4c6e-9d6c-4bb98387710e tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 200 len: 1496 microversion: 2.1 time: 0.151941 Jun 20 07:43:46.719390 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1381/2883] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:46 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 1496 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:47.111995 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-817deeff-f74d-4b3c-8302-1deb40f31c3b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:47.112522 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-817deeff-f74d-4b3c-8302-1deb40f31c3b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:47.118855 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-817deeff-f74d-4b3c-8302-1deb40f31c3b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:47.119299 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-817deeff-f74d-4b3c-8302-1deb40f31c3b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:47.120041 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-817deeff-f74d-4b3c-8302-1deb40f31c3b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:47.120495 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-817deeff-f74d-4b3c-8302-1deb40f31c3b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:47.146331 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-817deeff-f74d-4b3c-8302-1deb40f31c3b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:43:47.219085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-817deeff-f74d-4b3c-8302-1deb40f31c3b tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 204 len: 0 microversion: 2.1 time: 0.109831 Jun 20 07:43:47.219968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1503/2884] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:43:47 2022] DELETE /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:43:47.228003 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-05329dce-7916-4cfa-803e-ea9a1fbcadd2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:47.228650 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-05329dce-7916-4cfa-803e-ea9a1fbcadd2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:47.234554 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05329dce-7916-4cfa-803e-ea9a1fbcadd2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:47.234997 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05329dce-7916-4cfa-803e-ea9a1fbcadd2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:47.235738 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05329dce-7916-4cfa-803e-ea9a1fbcadd2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:47.236209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05329dce-7916-4cfa-803e-ea9a1fbcadd2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:47.364846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-05329dce-7916-4cfa-803e-ea9a1fbcadd2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:47.372394 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-05329dce-7916-4cfa-803e-ea9a1fbcadd2 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 200 len: 1502 microversion: 2.1 time: 0.148199 Jun 20 07:43:47.372959 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1382/2885] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:47 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:48.391479 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-401294c1-0610-4deb-9716-58a98ffba6e3 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:48.392141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-401294c1-0610-4deb-9716-58a98ffba6e3 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:48.398528 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-401294c1-0610-4deb-9716-58a98ffba6e3 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:48.398978 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-401294c1-0610-4deb-9716-58a98ffba6e3 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:48.399734 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-401294c1-0610-4deb-9716-58a98ffba6e3 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:48.400199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-401294c1-0610-4deb-9716-58a98ffba6e3 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:48.570175 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-401294c1-0610-4deb-9716-58a98ffba6e3 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c11f57e899148da8cafdc6443445a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e43b52db1a4e909d7f11368c2b7d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:43:48.578266 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-401294c1-0610-4deb-9716-58a98ffba6e3 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 200 len: 1502 microversion: 2.1 time: 0.191135 Jun 20 07:43:48.578826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1504/2886] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:48 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:43:48.966111 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-01fd2460-4643-4bd3-9f56-540c94f9d4ec req-ba180dd1-50b6-474d-8af8-6702c888e77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4c50c5-e5ad-4125-b91c-c2f4748c321a", "name": "network-vif-deleted", "tag": "353bc33e-16bd-4242-be12-c5ff6872466c"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:43:48.977292 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-01fd2460-4643-4bd3-9f56-540c94f9d4ec req-ba180dd1-50b6-474d-8af8-6702c888e77a service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:48.977773 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-01fd2460-4643-4bd3-9f56-540c94f9d4ec req-ba180dd1-50b6-474d-8af8-6702c888e77a service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:48.990507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-01fd2460-4643-4bd3-9f56-540c94f9d4ec req-ba180dd1-50b6-474d-8af8-6702c888e77a service nova] Creating event network-vif-deleted:353bc33e-16bd-4242-be12-c5ff6872466c for instance 8d4c50c5-e5ad-4125-b91c-c2f4748c321a on hv-cinder-77819 Jun 20 07:43:48.995798 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-01fd2460-4643-4bd3-9f56-540c94f9d4ec req-ba180dd1-50b6-474d-8af8-6702c888e77a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033363 Jun 20 07:43:48.996428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1383/2887] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:43:49.596343 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-35d5a6f5-0a5d-44b2-b5c3-dea0fe5d9ae0 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:43:49.596877 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-35d5a6f5-0a5d-44b2-b5c3-dea0fe5d9ae0 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] [instance: 8d4c50c5-e5ad-4125-b91c-c2f4748c321a] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:43:49.603278 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35d5a6f5-0a5d-44b2-b5c3-dea0fe5d9ae0 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:49.603725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35d5a6f5-0a5d-44b2-b5c3-dea0fe5d9ae0 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:49.604513 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35d5a6f5-0a5d-44b2-b5c3-dea0fe5d9ae0 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:43:49.604950 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-35d5a6f5-0a5d-44b2-b5c3-dea0fe5d9ae0 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:43:49.618532 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-35d5a6f5-0a5d-44b2-b5c3-dea0fe5d9ae0 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] HTTP exception thrown: Instance 8d4c50c5-e5ad-4125-b91c-c2f4748c321a could not be found. Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-35d5a6f5-0a5d-44b2-b5c3-dea0fe5d9ae0 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Request method failure captured: Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a HTTP/1.1 Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisCUX4W0Z2k3-95W-gGF5FHVJWIQNotLrUKm8sG8WFnBuXGeFobOj9xtibqXYYzG3UVkYLdB41FfcbHwOaR-qSnaQeaxZ94Sw73FBfbSYmWVyg8bNlxpIl2ozkQ-hrJjXOfww7u7CVEeexNIwif7n33lAZeabgkcSDS14usdOVN0lv_o Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 12e43b52db1a4e909d7f11368c2b7d97 Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-VolumesActionsTest-2119344596 Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:43:49.620200 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:43:49.621606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_12e43b52db1a4e909d7f11368c2b7d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12e43b52db1a4e909d7f11368c2b7d97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/12e43b52db1a4e909d7f11368c2b7d97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12e43b52db1a4e909d7f11368c2b7d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:43:49.621606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-VolumesActionsTest-2119344596 Jun 20 07:43:49.621606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 12e43b52db1a4e909d7f11368c2b7d97 Jun 20 07:43:49.621606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-VolumesActionsTest-2119344596 Jun 20 07:43:49.621606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-VolumesActionsTest-2119344596-project Jun 20 07:43:49.621606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:43:49.621606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:43:49.621606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: 5c11f57e899148da8cafdc6443445a58 Jun 20 07:43:49.621606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-VolumesActionsTest-2119344596-project Jun 20 07:43:49.621606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:43:49.621606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 8d4c50c5-e5ad-4125-b91c-c2f4748c321a could not be found. Jun 20 07:43:49.621606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '8d4c50c5-e5ad-4125-b91c-c2f4748c321a'} Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4c50c5-e5ad-4125-b91c-c2f4748c321a could not be found. Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:43:49.622472 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4c50c5-e5ad-4125-b91c-c2f4748c321a could not be found. Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4c50c5-e5ad-4125-b91c-c2f4748c321a could not be found. Jun 20 07:43:49.624149 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:43:49.625136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-35d5a6f5-0a5d-44b2-b5c3-dea0fe5d9ae0 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] Returning 404 to user: Instance 8d4c50c5-e5ad-4125-b91c-c2f4748c321a could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:43:49.625136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-35d5a6f5-0a5d-44b2-b5c3-dea0fe5d9ae0 tempest-VolumesActionsTest-2119344596 tempest-VolumesActionsTest-2119344596-project] 10.222.0.23 "GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a" status: 404 len: 111 microversion: 2.1 time: 0.029733 Jun 20 07:43:49.625136 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1505/2888] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:43:49 2022] GET /compute/v2.1/servers/8d4c50c5-e5ad-4125-b91c-c2f4748c321a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:44:17.712282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3af26406-c06c-4f5a-b724-c31c4f3c1260 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1956044505"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:44:17.712941 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3af26406-c06c-4f5a-b724-c31c4f3c1260 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:44:17.715361 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=11 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:44:17.716174 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=34 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:44:17.724055 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3af26406-c06c-4f5a-b724-c31c4f3c1260 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:17.724607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3af26406-c06c-4f5a-b724-c31c4f3c1260 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:17.725578 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3af26406-c06c-4f5a-b724-c31c4f3c1260 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:17.726097 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3af26406-c06c-4f5a-b724-c31c4f3c1260 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:17.866313 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.network.security_group_api [None req-3af26406-c06c-4f5a-b724-c31c4f3c1260 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Removing security group efdf2bea-4c89-4777-b1f5-d254c1b85f46 from port acf00405-f14c-42db-a345-206c7cfb6e46 Jun 20 07:44:18.201013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3af26406-c06c-4f5a-b724-c31c4f3c1260 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "POST /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/action" status: 202 len: 0 microversion: 2.1 time: 0.493269 Jun 20 07:44:18.202329 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1384/2889] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:44:17 2022] POST /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 07:44:18.210527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-40c0189b-86b0-4365-b476-2fe72045be1c req-f6232e6d-7f97-4998-a98a-7eb8239bf0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a546fbf-081e-4103-ab76-435ac1640009", "tag": "acf00405-f14c-42db-a345-206c7cfb6e46"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:44:18.215423 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:44:18.216900 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:44:18.224072 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-40c0189b-86b0-4365-b476-2fe72045be1c req-f6232e6d-7f97-4998-a98a-7eb8239bf0b9 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:18.224931 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-40c0189b-86b0-4365-b476-2fe72045be1c req-f6232e6d-7f97-4998-a98a-7eb8239bf0b9 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:18.238796 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-40c0189b-86b0-4365-b476-2fe72045be1c req-f6232e6d-7f97-4998-a98a-7eb8239bf0b9 service nova] Creating event network-changed:acf00405-f14c-42db-a345-206c7cfb6e46 for instance 3a546fbf-081e-4103-ab76-435ac1640009 on hv-cinder-77819 Jun 20 07:44:18.246646 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-40c0189b-86b0-4365-b476-2fe72045be1c req-f6232e6d-7f97-4998-a98a-7eb8239bf0b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039000 Jun 20 07:44:18.248315 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1506/2890] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:44:19.369330 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d156ea33-b5e2-417b-95c4-50954bb08f7e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:44:19.369837 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d156ea33-b5e2-417b-95c4-50954bb08f7e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:44:19.371290 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-1ca7b827-e80e-42e5-bbdd-080da568f818 req-b5327665-ac89-4362-bdc9-d6abf348d089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a546fbf-081e-4103-ab76-435ac1640009", "tag": "acf00405-f14c-42db-a345-206c7cfb6e46"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:44:19.376913 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d156ea33-b5e2-417b-95c4-50954bb08f7e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:19.377151 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d156ea33-b5e2-417b-95c4-50954bb08f7e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:19.377923 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d156ea33-b5e2-417b-95c4-50954bb08f7e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:19.378604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d156ea33-b5e2-417b-95c4-50954bb08f7e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:19.381122 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-1ca7b827-e80e-42e5-bbdd-080da568f818 req-b5327665-ac89-4362-bdc9-d6abf348d089 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:19.381957 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-1ca7b827-e80e-42e5-bbdd-080da568f818 req-b5327665-ac89-4362-bdc9-d6abf348d089 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:19.394617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-1ca7b827-e80e-42e5-bbdd-080da568f818 req-b5327665-ac89-4362-bdc9-d6abf348d089 service nova] Creating event network-changed:acf00405-f14c-42db-a345-206c7cfb6e46 for instance 3a546fbf-081e-4103-ab76-435ac1640009 on hv-cinder-77819 Jun 20 07:44:19.400034 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-1ca7b827-e80e-42e5-bbdd-080da568f818 req-b5327665-ac89-4362-bdc9-d6abf348d089 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033372 Jun 20 07:44:19.400777 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1507/2891] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:44:19.466134 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-d156ea33-b5e2-417b-95c4-50954bb08f7e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lazy-loading 'services' on Instance uuid 3a546fbf-081e-4103-ab76-435ac1640009 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:44:19.550704 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d156ea33-b5e2-417b-95c4-50954bb08f7e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/os-volume_attachments/a7f27b6d-34d0-43bb-84ec-d29efa80863a" status: 202 len: 0 microversion: 2.1 time: 0.186197 Jun 20 07:44:19.561463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f5efc5df-73d2-436b-9fec-3e135953d8ee tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:44:19.563822 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f5efc5df-73d2-436b-9fec-3e135953d8ee tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:44:19.568434 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1385/2892] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:44:19 2022] DELETE /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/os-volume_attachments/a7f27b6d-34d0-43bb-84ec-d29efa80863a => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:44:19.573526 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5efc5df-73d2-436b-9fec-3e135953d8ee tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:19.574186 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5efc5df-73d2-436b-9fec-3e135953d8ee tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:19.575068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5efc5df-73d2-436b-9fec-3e135953d8ee tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:19.576515 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f5efc5df-73d2-436b-9fec-3e135953d8ee tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:19.614035 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f5efc5df-73d2-436b-9fec-3e135953d8ee tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057129 Jun 20 07:44:19.614611 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1508/2893] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:44:19 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:44:20.627386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1017272-9205-4878-89fc-8564156b1ca1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:44:20.628477 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a1017272-9205-4878-89fc-8564156b1ca1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:44:20.635257 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1017272-9205-4878-89fc-8564156b1ca1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:20.635707 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1017272-9205-4878-89fc-8564156b1ca1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:20.636487 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1017272-9205-4878-89fc-8564156b1ca1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:20.636952 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1017272-9205-4878-89fc-8564156b1ca1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:20.664714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a1017272-9205-4878-89fc-8564156b1ca1 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042482 Jun 20 07:44:20.665266 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1386/2894] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 07:44:20 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 07:44:20.675340 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c84e0efd-3531-48d1-abbb-8c0e4c5d58e7 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:44:20.675836 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c84e0efd-3531-48d1-abbb-8c0e4c5d58e7 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:44:20.682236 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c84e0efd-3531-48d1-abbb-8c0e4c5d58e7 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:20.682684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c84e0efd-3531-48d1-abbb-8c0e4c5d58e7 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:20.683434 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c84e0efd-3531-48d1-abbb-8c0e4c5d58e7 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:20.683867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c84e0efd-3531-48d1-abbb-8c0e4c5d58e7 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:20.759195 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-c84e0efd-3531-48d1-abbb-8c0e4c5d58e7 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] HTTP exception thrown: Instance 3a546fbf-081e-4103-ab76-435ac1640009 is not attached to volume a7f27b6d-34d0-43bb-84ec-d29efa80863a Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c84e0efd-3531-48d1-abbb-8c0e4c5d58e7 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Request method failure captured: Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: DELETE /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/os-volume_attachments/a7f27b6d-34d0-43bb-84ec-d29efa80863a HTTP/1.1 Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisCTIc0-8OW8hmpv4ayhEhnlZ_BCLyTFqWxQC6WkGsjKvMP52809bYHHmuF271G27c8_0Jq2IcmH1nAlGGMj9BhkBs8V4kwvD6pwet9xjUh8g0JeRkpCd5ZyWWwJCBqRvTQLqWSvktGg1FyMUWINacdw3HOu2pcnpZIfHOeD1Bar21UA Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 0340346ca5a4424fa8a5374af75990da Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-TestMinimumBasicScenario-32583781 Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:44:20.761605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:44:20.763106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0340346ca5a4424fa8a5374af75990da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0340346ca5a4424fa8a5374af75990da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0340346ca5a4424fa8a5374af75990da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0340346ca5a4424fa8a5374af75990da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:44:20.763106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-TestMinimumBasicScenario-32583781 Jun 20 07:44:20.763106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 0340346ca5a4424fa8a5374af75990da Jun 20 07:44:20.763106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-TestMinimumBasicScenario-32583781 Jun 20 07:44:20.763106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-TestMinimumBasicScenario-32583781-project Jun 20 07:44:20.763106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:44:20.763106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:44:20.763106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: eda8b1053f95458abfd8ea79227a0dcf Jun 20 07:44:20.763106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-TestMinimumBasicScenario-32583781-project Jun 20 07:44:20.763106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:44:20.763106 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 3a546fbf-081e-4103-ab76-435ac1640009 is not attached to volume a7f27b6d-34d0-43bb-84ec-d29efa80863a Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'server_id': '3a546fbf-081e-4103-ab76-435ac1640009', 'id': 'a7f27b6d-34d0-43bb-84ec-d29efa80863a'} Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a7f27b6d-34d0-43bb-84ec-d29efa80863a. Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:44:20.763835 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a546fbf-081e-4103-ab76-435ac1640009 is not attached to volume a7f27b6d-34d0-43bb-84ec-d29efa80863a Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a546fbf-081e-4103-ab76-435ac1640009 is not attached to volume a7f27b6d-34d0-43bb-84ec-d29efa80863a Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:44:20.764963 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c84e0efd-3531-48d1-abbb-8c0e4c5d58e7 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Returning 404 to user: Instance 3a546fbf-081e-4103-ab76-435ac1640009 is not attached to volume a7f27b6d-34d0-43bb-84ec-d29efa80863a {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:44:20.765787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c84e0efd-3531-48d1-abbb-8c0e4c5d58e7 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/os-volume_attachments/a7f27b6d-34d0-43bb-84ec-d29efa80863a" status: 404 len: 154 microversion: 2.1 time: 0.092142 Jun 20 07:44:20.765787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1509/2895] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 07:44:20 2022] DELETE /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009/os-volume_attachments/a7f27b6d-34d0-43bb-84ec-d29efa80863a => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:44:21.894951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-afea354d-4668-4a0d-8a61-cd3f04ea5b02 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:44:21.895450 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-afea354d-4668-4a0d-8a61-cd3f04ea5b02 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:44:21.901938 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afea354d-4668-4a0d-8a61-cd3f04ea5b02 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:21.902366 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afea354d-4668-4a0d-8a61-cd3f04ea5b02 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:21.903109 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afea354d-4668-4a0d-8a61-cd3f04ea5b02 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:21.903538 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afea354d-4668-4a0d-8a61-cd3f04ea5b02 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:21.928054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-afea354d-4668-4a0d-8a61-cd3f04ea5b02 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:44:21.999100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-afea354d-4668-4a0d-8a61-cd3f04ea5b02 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 204 len: 0 microversion: 2.1 time: 0.108326 Jun 20 07:44:21.999594 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1387/2896] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:44:21 2022] DELETE /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:44:22.008991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-f134020f-e154-476e-a54f-dc727fb1df11 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:44:22.009693 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-f134020f-e154-476e-a54f-dc727fb1df11 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:44:22.016806 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f134020f-e154-476e-a54f-dc727fb1df11 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:22.017316 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f134020f-e154-476e-a54f-dc727fb1df11 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:22.018074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f134020f-e154-476e-a54f-dc727fb1df11 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:22.018616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-f134020f-e154-476e-a54f-dc727fb1df11 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:22.150398 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-f134020f-e154-476e-a54f-dc727fb1df11 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:44:22.158093 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-f134020f-e154-476e-a54f-dc727fb1df11 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1555 microversion: 2.1 time: 0.152968 Jun 20 07:44:22.158668 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1510/2897] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:44:22 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:44:23.176123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d62e63cf-7699-4748-8dff-48604e1a7f12 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:44:23.176846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d62e63cf-7699-4748-8dff-48604e1a7f12 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:44:23.183157 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d62e63cf-7699-4748-8dff-48604e1a7f12 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:23.183609 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d62e63cf-7699-4748-8dff-48604e1a7f12 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:23.184383 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d62e63cf-7699-4748-8dff-48604e1a7f12 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:23.184821 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d62e63cf-7699-4748-8dff-48604e1a7f12 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:23.313617 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d62e63cf-7699-4748-8dff-48604e1a7f12 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:44:23.321122 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d62e63cf-7699-4748-8dff-48604e1a7f12 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1555 microversion: 2.1 time: 0.149738 Jun 20 07:44:23.321694 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1388/2898] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:44:23 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:44:24.084143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-ea37f1bc-dd2c-4a9c-90d1-86e8307bf6c2 req-cd77d7cd-a3fe-4d48-b06f-ed0a9e2672ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a546fbf-081e-4103-ab76-435ac1640009", "name": "network-vif-deleted", "tag": "acf00405-f14c-42db-a345-206c7cfb6e46"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:44:24.093068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-ea37f1bc-dd2c-4a9c-90d1-86e8307bf6c2 req-cd77d7cd-a3fe-4d48-b06f-ed0a9e2672ad service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:24.094069 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-ea37f1bc-dd2c-4a9c-90d1-86e8307bf6c2 req-cd77d7cd-a3fe-4d48-b06f-ed0a9e2672ad service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:24.105205 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-ea37f1bc-dd2c-4a9c-90d1-86e8307bf6c2 req-cd77d7cd-a3fe-4d48-b06f-ed0a9e2672ad service nova] Creating event network-vif-deleted:acf00405-f14c-42db-a345-206c7cfb6e46 for instance 3a546fbf-081e-4103-ab76-435ac1640009 on hv-cinder-77819 Jun 20 07:44:24.111108 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-ea37f1bc-dd2c-4a9c-90d1-86e8307bf6c2 req-cd77d7cd-a3fe-4d48-b06f-ed0a9e2672ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030649 Jun 20 07:44:24.111688 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1511/2899] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:44:24.338599 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-37be6f18-97de-4b68-86bb-856c3c9b9e81 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:44:24.339175 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-37be6f18-97de-4b68-86bb-856c3c9b9e81 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:44:24.345703 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37be6f18-97de-4b68-86bb-856c3c9b9e81 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:24.346156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37be6f18-97de-4b68-86bb-856c3c9b9e81 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:24.346909 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37be6f18-97de-4b68-86bb-856c3c9b9e81 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:24.347349 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37be6f18-97de-4b68-86bb-856c3c9b9e81 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:24.380125 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37be6f18-97de-4b68-86bb-856c3c9b9e81 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:24.380595 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-37be6f18-97de-4b68-86bb-856c3c9b9e81 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:24.381054 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-37be6f18-97de-4b68-86bb-856c3c9b9e81 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lazy-loading 'fault' on Instance uuid 3a546fbf-081e-4103-ab76-435ac1640009 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:44:24.424140 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-37be6f18-97de-4b68-86bb-856c3c9b9e81 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda8b1053f95458abfd8ea79227a0dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0340346ca5a4424fa8a5374af75990da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:44:24.433116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-37be6f18-97de-4b68-86bb-856c3c9b9e81 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 200 len: 1349 microversion: 2.1 time: 0.098390 Jun 20 07:44:24.433670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1389/2900] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:44:24 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:44:25.451757 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-661b5492-7dac-486a-8d31-ed98458b396e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:44:25.452401 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-661b5492-7dac-486a-8d31-ed98458b396e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] [instance: 3a546fbf-081e-4103-ab76-435ac1640009] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:44:25.458508 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-661b5492-7dac-486a-8d31-ed98458b396e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:25.458947 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-661b5492-7dac-486a-8d31-ed98458b396e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:25.459692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-661b5492-7dac-486a-8d31-ed98458b396e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:25.460141 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-661b5492-7dac-486a-8d31-ed98458b396e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:25.472717 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.wsgi [None req-661b5492-7dac-486a-8d31-ed98458b396e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] HTTP exception thrown: Instance 3a546fbf-081e-4103-ab76-435ac1640009 could not be found. Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-661b5492-7dac-486a-8d31-ed98458b396e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Request method failure captured: Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: request: GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 HTTP/1.1 Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept: application/json Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Accept-Encoding: identity Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Connection: close Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Length: 0 Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Content-Type: application/json Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Host: 10.222.0.23 Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Openstack-System-Scope: None Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: User-Agent: python-urllib3/1.26.9 Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Auth-Token: gAAAAABisCTIc0-8OW8hmpv4ayhEhnlZ_BCLyTFqWxQC6WkGsjKvMP52809bYHHmuF271G27c8_0Jq2IcmH1nAlGGMj9BhkBs8V4kwvD6pwet9xjUh8g0JeRkpCd5ZyWWwJCBqRvTQLqWSvktGg1FyMUWINacdw3HOu2pcnpZIfHOeD1Bar21UA Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Id: None Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Domain-Name: None Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Identity-Status: Confirmed Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Is-Admin-Project: True Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Id: default Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Domain-Name: Default Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Id: 0340346ca5a4424fa8a5374af75990da Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Project-Name: tempest-TestMinimumBasicScenario-32583781 Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Role: member,reader Jun 20 07:44:25.474274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Roles: member,reader Jun 20 07:44:25.475649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0340346ca5a4424fa8a5374af75990da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0340346ca5a4424fa8a5374af75990da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0340346ca5a4424fa8a5374af75990da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0340346ca5a4424fa8a5374af75990da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:44:25.475649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant: tempest-TestMinimumBasicScenario-32583781 Jun 20 07:44:25.475649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Id: 0340346ca5a4424fa8a5374af75990da Jun 20 07:44:25.475649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-Tenant-Name: tempest-TestMinimumBasicScenario-32583781 Jun 20 07:44:25.475649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User: tempest-TestMinimumBasicScenario-32583781-project Jun 20 07:44:25.475649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Id: default Jun 20 07:44:25.475649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Domain-Name: Default Jun 20 07:44:25.475649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Id: eda8b1053f95458abfd8ea79227a0dcf Jun 20 07:44:25.475649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: X-User-Name: tempest-TestMinimumBasicScenario-32583781-project Jun 20 07:44:25.475649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: method: > Jun 20 07:44:25.475649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: exception: Instance 3a546fbf-081e-4103-ab76-435ac1640009 could not be found. Jun 20 07:44:25.475649 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: action_args: {'id': '3a546fbf-081e-4103-ab76-435ac1640009'} Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a546fbf-081e-4103-ab76-435ac1640009 could not be found. Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:44:25.476371 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a546fbf-081e-4103-ab76-435ac1640009 could not be found. Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a546fbf-081e-4103-ab76-435ac1640009 could not be found. Jun 20 07:44:25.477729 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR nova.api.openstack.wsgi Jun 20 07:44:25.478899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-661b5492-7dac-486a-8d31-ed98458b396e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Returning 404 to user: Instance 3a546fbf-081e-4103-ab76-435ac1640009 could not be found. {{(pid=117607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:44:25.478899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-661b5492-7dac-486a-8d31-ed98458b396e tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009" status: 404 len: 111 microversion: 2.1 time: 0.028603 Jun 20 07:44:25.478899 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1512/2901] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:44:25 2022] GET /compute/v2.1/servers/3a546fbf-081e-4103-ab76-435ac1640009 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:44:25.486948 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b1d38751-af44-4440-bee3-89f6e9052fc2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] Calling method '.version_select at 0x7ffa1faf0700>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:44:25.511334 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b1d38751-af44-4440-bee3-89f6e9052fc2 tempest-TestMinimumBasicScenario-32583781 tempest-TestMinimumBasicScenario-32583781-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1308272379" status: 202 len: 0 microversion: 2.1 time: 0.030664 Jun 20 07:44:25.511904 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1390/2902] 10.222.0.23 () {58 vars in 1271 bytes} [Mon Jun 20 07:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1308272379 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:44:43.197970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=14 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:44:43.198745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=26 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:44:43.382480 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5b9d75ce-caee-45d9-8e96-4cc04bad6667 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Action: 'create', calling method: .version_select at 0x7ffa1fb74ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1403787706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJO1RF/E9LbFUBGg5SbL5zdVmVA+pVdkkz8VCvU82D/ueYRvk9rDYhObpJ/Nb3dvHRZ+R42tP7QGEkVaMIT+rcjfd+jMLhyqX8tLfHhjFwg+Y2oPoyu1da90TdwudIXOg=="}} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:44:43.398901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-5b9d75ce-caee-45d9-8e96-4cc04bad6667 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Getting quotas for project c5446ee5342d42a4a39476d540fb03d0. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:44:43.404656 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.quota [None req-5b9d75ce-caee-45d9-8e96-4cc04bad6667 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Getting quotas for user 8a6bf639c83d4d0ea6f908f3e1f3772c and project c5446ee5342d42a4a39476d540fb03d0. Resources: {'key_pairs'} {{(pid=117607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:44:43.426645 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5b9d75ce-caee-45d9-8e96-4cc04bad6667 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.233903 Jun 20 07:44:43.427243 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1513/2903] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 07:44:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:44:58.473888 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:44:58.474646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:44:58.478589 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1715529770", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1403787706", "security_groups": [{"name": "tempest-secgroup-smoke-1407408128"}], "networks": [{"uuid": "42de5519-d3e8-4c78-aa4f-b771148ee8ef"}], "block_device_mapping_v2": [{"uuid": "1f38da6d-b6a5-4a06-90cc-f04eb9ed2fca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:44:58.589426 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] validate_networks() for [('42de5519-d3e8-4c78-aa4f-b771148ee8ef', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 07:44:58.950590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 07:44:58.951017 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 07:44:58.951522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 07:44:58.951937 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 07:44:58.952370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 07:44:58.961621 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:58.962066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:58.962855 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:44:58.963293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:44:58.979990 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Getting quotas for project c5446ee5342d42a4a39476d540fb03d0. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 07:44:58.983911 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Getting quotas for user 8a6bf639c83d4d0ea6f908f3e1f3772c and project c5446ee5342d42a4a39476d540fb03d0. Resources: {'instances', 'ram', 'cores'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 07:44:59.042590 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 07:44:59.044748 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f38da6d-b6a5-4a06-90cc-f04eb9ed2fca',volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 07:44:59.167768 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7802839b-39c9-4046-8c86-b50c7237eea0 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.695308 Jun 20 07:44:59.168470 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1391/2904] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 07:44:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 07:44:59.178211 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1bf29f0c-00ef-4f13-b8a2-331b7a76fb21 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:44:59.178826 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1bf29f0c-00ef-4f13-b8a2-331b7a76fb21 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:44:59.182153 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=4 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:44:59.182991 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:44:59.239463 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1bf29f0c-00ef-4f13-b8a2-331b7a76fb21 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:44:59.246202 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1bf29f0c-00ef-4f13-b8a2-331b7a76fb21 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1089 microversion: 2.1 time: 0.071797 Jun 20 07:44:59.246768 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1514/2905] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:44:59 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:00.264642 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-943f7da0-6a9b-45c8-867b-54f629969491 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:00.265261 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-943f7da0-6a9b-45c8-867b-54f629969491 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:00.271380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-943f7da0-6a9b-45c8-867b-54f629969491 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:00.272222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-943f7da0-6a9b-45c8-867b-54f629969491 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:00.272986 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-943f7da0-6a9b-45c8-867b-54f629969491 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:00.273429 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-943f7da0-6a9b-45c8-867b-54f629969491 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:00.350777 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-943f7da0-6a9b-45c8-867b-54f629969491 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:00.358671 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-943f7da0-6a9b-45c8-867b-54f629969491 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1205 microversion: 2.1 time: 0.098353 Jun 20 07:45:00.359282 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1392/2906] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:00 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1205 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:01.375917 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-da5aa23b-0f92-40fc-94a9-4f1a01bd2dd3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:01.377214 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-da5aa23b-0f92-40fc-94a9-4f1a01bd2dd3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:01.383953 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da5aa23b-0f92-40fc-94a9-4f1a01bd2dd3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:01.384446 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da5aa23b-0f92-40fc-94a9-4f1a01bd2dd3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:01.385245 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da5aa23b-0f92-40fc-94a9-4f1a01bd2dd3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:01.385675 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da5aa23b-0f92-40fc-94a9-4f1a01bd2dd3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:01.442104 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-bbd3d7a5-fd19-406a-a20c-3ed8467d1e99 req-3a35be01-f41f-4b50-8ceb-9841e901259f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19a6fa7-3934-4582-940f-2daa3938fb0c", "tag": "a96690da-2d7c-4454-8e1c-d68e84d3a51d"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:45:01.452606 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-bbd3d7a5-fd19-406a-a20c-3ed8467d1e99 req-3a35be01-f41f-4b50-8ceb-9841e901259f service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:01.453041 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-bbd3d7a5-fd19-406a-a20c-3ed8467d1e99 req-3a35be01-f41f-4b50-8ceb-9841e901259f service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:01.464892 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-bbd3d7a5-fd19-406a-a20c-3ed8467d1e99 req-3a35be01-f41f-4b50-8ceb-9841e901259f service nova] Creating event network-changed:a96690da-2d7c-4454-8e1c-d68e84d3a51d for instance a19a6fa7-3934-4582-940f-2daa3938fb0c on hv-cinder-77819 Jun 20 07:45:01.470147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-bbd3d7a5-fd19-406a-a20c-3ed8467d1e99 req-3a35be01-f41f-4b50-8ceb-9841e901259f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032579 Jun 20 07:45:01.471610 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1393/2907] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 07:45:01.643027 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-da5aa23b-0f92-40fc-94a9-4f1a01bd2dd3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:01.650706 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-da5aa23b-0f92-40fc-94a9-4f1a01bd2dd3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1261 microversion: 2.1 time: 0.279004 Jun 20 07:45:01.651358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1515/2908] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:01 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1261 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:02.668946 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aa577fad-f8af-4ad6-a98e-0da8b0dfa612 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:02.669653 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aa577fad-f8af-4ad6-a98e-0da8b0dfa612 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:02.675721 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa577fad-f8af-4ad6-a98e-0da8b0dfa612 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:02.676203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa577fad-f8af-4ad6-a98e-0da8b0dfa612 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:02.676960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa577fad-f8af-4ad6-a98e-0da8b0dfa612 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:02.677400 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa577fad-f8af-4ad6-a98e-0da8b0dfa612 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:02.812380 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aa577fad-f8af-4ad6-a98e-0da8b0dfa612 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:02.819726 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aa577fad-f8af-4ad6-a98e-0da8b0dfa612 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1261 microversion: 2.1 time: 0.155382 Jun 20 07:45:02.820317 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1394/2909] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:02 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:03.836725 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-2aa43682-b390-4b34-96ce-fc86a45ccc74 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:03.837342 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-2aa43682-b390-4b34-96ce-fc86a45ccc74 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:03.843748 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2aa43682-b390-4b34-96ce-fc86a45ccc74 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:03.844227 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2aa43682-b390-4b34-96ce-fc86a45ccc74 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:03.844987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2aa43682-b390-4b34-96ce-fc86a45ccc74 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:03.845425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-2aa43682-b390-4b34-96ce-fc86a45ccc74 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:03.973548 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-2aa43682-b390-4b34-96ce-fc86a45ccc74 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:03.981091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-2aa43682-b390-4b34-96ce-fc86a45ccc74 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1261 microversion: 2.1 time: 0.148217 Jun 20 07:45:03.981739 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1516/2910] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:03 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:04.997876 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a9890e79-9533-43ad-b0ee-6c90078511a2 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:04.998389 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a9890e79-9533-43ad-b0ee-6c90078511a2 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:05.005514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9890e79-9533-43ad-b0ee-6c90078511a2 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:05.005961 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9890e79-9533-43ad-b0ee-6c90078511a2 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:05.006714 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9890e79-9533-43ad-b0ee-6c90078511a2 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:05.007147 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a9890e79-9533-43ad-b0ee-6c90078511a2 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:05.134862 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a9890e79-9533-43ad-b0ee-6c90078511a2 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:05.142202 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a9890e79-9533-43ad-b0ee-6c90078511a2 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1261 microversion: 2.1 time: 0.148473 Jun 20 07:45:05.142815 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1395/2911] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:04 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:06.158485 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-464e5280-8fb1-47fa-80df-cc00036124d6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:06.159104 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-464e5280-8fb1-47fa-80df-cc00036124d6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:06.165358 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-464e5280-8fb1-47fa-80df-cc00036124d6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:06.165808 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-464e5280-8fb1-47fa-80df-cc00036124d6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:06.166568 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-464e5280-8fb1-47fa-80df-cc00036124d6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:06.167008 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-464e5280-8fb1-47fa-80df-cc00036124d6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:06.293787 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-464e5280-8fb1-47fa-80df-cc00036124d6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:06.301199 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-464e5280-8fb1-47fa-80df-cc00036124d6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1261 microversion: 2.1 time: 0.146568 Jun 20 07:45:06.301762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1517/2912] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:06 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:07.316901 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d294ce46-d532-420c-8d2a-b30b7975523f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:07.317515 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d294ce46-d532-420c-8d2a-b30b7975523f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:07.324293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d294ce46-d532-420c-8d2a-b30b7975523f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:07.324902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d294ce46-d532-420c-8d2a-b30b7975523f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:07.325983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d294ce46-d532-420c-8d2a-b30b7975523f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:07.326613 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d294ce46-d532-420c-8d2a-b30b7975523f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:07.467649 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d294ce46-d532-420c-8d2a-b30b7975523f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:07.475050 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d294ce46-d532-420c-8d2a-b30b7975523f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1261 microversion: 2.1 time: 0.162072 Jun 20 07:45:07.475609 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1396/2913] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:07 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:08.491221 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-c2d31fa0-529d-48c6-a465-8584bd631d76 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:08.491832 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-c2d31fa0-529d-48c6-a465-8584bd631d76 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:08.498583 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2d31fa0-529d-48c6-a465-8584bd631d76 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:08.499029 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2d31fa0-529d-48c6-a465-8584bd631d76 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:08.499780 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2d31fa0-529d-48c6-a465-8584bd631d76 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:08.500238 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-c2d31fa0-529d-48c6-a465-8584bd631d76 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:08.628745 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-c2d31fa0-529d-48c6-a465-8584bd631d76 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:08.636011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-c2d31fa0-529d-48c6-a465-8584bd631d76 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1261 microversion: 2.1 time: 0.148632 Jun 20 07:45:08.636607 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1518/2914] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:08 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:09.652951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-faa4f14e-1d87-4367-9ee2-9f54a8d9c861 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:09.653673 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-faa4f14e-1d87-4367-9ee2-9f54a8d9c861 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:09.656101 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:45:09.656790 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:45:09.662749 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-faa4f14e-1d87-4367-9ee2-9f54a8d9c861 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:09.663209 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-faa4f14e-1d87-4367-9ee2-9f54a8d9c861 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:09.664066 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-faa4f14e-1d87-4367-9ee2-9f54a8d9c861 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:09.664530 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-faa4f14e-1d87-4367-9ee2-9f54a8d9c861 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:09.797296 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-faa4f14e-1d87-4367-9ee2-9f54a8d9c861 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:09.805370 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-faa4f14e-1d87-4367-9ee2-9f54a8d9c861 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1261 microversion: 2.1 time: 0.156289 Jun 20 07:45:09.805936 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1397/2915] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:09 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:10.822068 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-1ad7c279-f287-4c24-badc-eeb89249f4b8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:10.822598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-1ad7c279-f287-4c24-badc-eeb89249f4b8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:10.824560 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell0:SELECT=2 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:45:10.831306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ad7c279-f287-4c24-badc-eeb89249f4b8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:10.831755 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ad7c279-f287-4c24-badc-eeb89249f4b8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:10.832550 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ad7c279-f287-4c24-badc-eeb89249f4b8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:10.832987 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-1ad7c279-f287-4c24-badc-eeb89249f4b8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:10.973672 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-1ad7c279-f287-4c24-badc-eeb89249f4b8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:10.981083 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-1ad7c279-f287-4c24-badc-eeb89249f4b8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1261 microversion: 2.1 time: 0.162967 Jun 20 07:45:10.981737 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1519/2916] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:10 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:11.638884 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-417e1a3d-6003-4287-b9e6-a845a6733b8b req-81255604-358f-44bf-b68c-79ef0e9d721f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a6fa7-3934-4582-940f-2daa3938fb0c", "name": "network-vif-plugged", "status": "completed", "tag": "a96690da-2d7c-4454-8e1c-d68e84d3a51d"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:45:11.650216 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-417e1a3d-6003-4287-b9e6-a845a6733b8b req-81255604-358f-44bf-b68c-79ef0e9d721f service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:11.650659 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-417e1a3d-6003-4287-b9e6-a845a6733b8b req-81255604-358f-44bf-b68c-79ef0e9d721f service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:11.663260 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-417e1a3d-6003-4287-b9e6-a845a6733b8b req-81255604-358f-44bf-b68c-79ef0e9d721f service nova] Creating event network-vif-plugged:a96690da-2d7c-4454-8e1c-d68e84d3a51d for instance a19a6fa7-3934-4582-940f-2daa3938fb0c on hv-cinder-77819 Jun 20 07:45:11.668274 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-417e1a3d-6003-4287-b9e6-a845a6733b8b req-81255604-358f-44bf-b68c-79ef0e9d721f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033010 Jun 20 07:45:11.668859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1398/2917] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:45:11.998968 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-393cef66-b126-46e9-91ea-b2762af8243b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:11.999579 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-393cef66-b126-46e9-91ea-b2762af8243b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:12.006517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-393cef66-b126-46e9-91ea-b2762af8243b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:12.006970 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-393cef66-b126-46e9-91ea-b2762af8243b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:12.007727 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-393cef66-b126-46e9-91ea-b2762af8243b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:12.008192 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-393cef66-b126-46e9-91ea-b2762af8243b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:12.137837 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-393cef66-b126-46e9-91ea-b2762af8243b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:12.145818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-393cef66-b126-46e9-91ea-b2762af8243b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1261 microversion: 2.1 time: 0.150979 Jun 20 07:45:12.146387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1520/2918] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:11 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:13.164219 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61f6d6d0-e046-4226-95ae-d4754ac46e02 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:13.165013 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61f6d6d0-e046-4226-95ae-d4754ac46e02 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:13.171568 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61f6d6d0-e046-4226-95ae-d4754ac46e02 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:13.172027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61f6d6d0-e046-4226-95ae-d4754ac46e02 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:13.172812 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61f6d6d0-e046-4226-95ae-d4754ac46e02 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:13.173285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61f6d6d0-e046-4226-95ae-d4754ac46e02 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:13.311272 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61f6d6d0-e046-4226-95ae-d4754ac46e02 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:13.318929 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61f6d6d0-e046-4226-95ae-d4754ac46e02 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1261 microversion: 2.1 time: 0.159352 Jun 20 07:45:13.319497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1399/2919] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:13 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:14.337616 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6e9b6928-f230-4e4e-a1db-072d443c080b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:14.338256 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6e9b6928-f230-4e4e-a1db-072d443c080b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:14.347800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e9b6928-f230-4e4e-a1db-072d443c080b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:14.348282 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e9b6928-f230-4e4e-a1db-072d443c080b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:14.349048 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e9b6928-f230-4e4e-a1db-072d443c080b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:14.349488 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6e9b6928-f230-4e4e-a1db-072d443c080b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:14.476425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6e9b6928-f230-4e4e-a1db-072d443c080b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:14.483723 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6e9b6928-f230-4e4e-a1db-072d443c080b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1444 microversion: 2.1 time: 0.152083 Jun 20 07:45:14.484306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1521/2920] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:14 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:14.500271 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bd001a55-a81d-448b-8eb6-28489edba968 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:45:14.500926 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bd001a55-a81d-448b-8eb6-28489edba968 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:45:14.507451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bd001a55-a81d-448b-8eb6-28489edba968 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:14.507901 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bd001a55-a81d-448b-8eb6-28489edba968 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:14.508702 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bd001a55-a81d-448b-8eb6-28489edba968 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:14.509144 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bd001a55-a81d-448b-8eb6-28489edba968 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:14.639156 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bd001a55-a81d-448b-8eb6-28489edba968 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:45:14.647125 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bd001a55-a81d-448b-8eb6-28489edba968 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1444 microversion: 2.1 time: 0.150936 Jun 20 07:45:14.647689 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1400/2921] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:45:14 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:45:16.292210 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [req-50a2f87c-3d69-4649-a28d-9f363ce5b278 req-ea7fafb2-ca11-4b3a-9ff4-55e5998b3db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19a6fa7-3934-4582-940f-2daa3938fb0c", "tag": "a96690da-2d7c-4454-8e1c-d68e84d3a51d"}]} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:45:16.300562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-50a2f87c-3d69-4649-a28d-9f363ce5b278 req-ea7fafb2-ca11-4b3a-9ff4-55e5998b3db6 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:45:16.301006 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [req-50a2f87c-3d69-4649-a28d-9f363ce5b278 req-ea7fafb2-ca11-4b3a-9ff4-55e5998b3db6 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:45:16.311988 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.compute.server_external_events [req-50a2f87c-3d69-4649-a28d-9f363ce5b278 req-ea7fafb2-ca11-4b3a-9ff4-55e5998b3db6 service nova] Creating event network-changed:a96690da-2d7c-4454-8e1c-d68e84d3a51d for instance a19a6fa7-3934-4582-940f-2daa3938fb0c on hv-cinder-77819 Jun 20 07:45:16.317246 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [req-50a2f87c-3d69-4649-a28d-9f363ce5b278 req-ea7fafb2-ca11-4b3a-9ff4-55e5998b3db6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028666 Jun 20 07:45:16.317855 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1522/2922] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:47:05.647466 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:47:05.648064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:47:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:47:10.390823 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9088376-3f70-40e7-983c-295a551cf81c] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 20 07:47:10.392222 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:47:10.392951 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=48 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:47:10.396902 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bc1e452f-d196-457a-abdf-a9af189e207b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:47:10.397428 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bc1e452f-d196-457a-abdf-a9af189e207b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:10.404743 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc1e452f-d196-457a-abdf-a9af189e207b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:10.405191 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc1e452f-d196-457a-abdf-a9af189e207b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:10.405934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc1e452f-d196-457a-abdf-a9af189e207b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:10.406360 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bc1e452f-d196-457a-abdf-a9af189e207b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:10.428551 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-bc1e452f-d196-457a-abdf-a9af189e207b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lazy-loading 'flavor' on Instance uuid a19a6fa7-3934-4582-940f-2daa3938fb0c {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:47:10.498722 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bc1e452f-d196-457a-abdf-a9af189e207b tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "POST /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c/action" status: 202 len: 0 microversion: 2.1 time: 0.109437 Jun 20 07:47:10.499285 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1401/2923] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:47:10 2022] POST /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:47:10.505719 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: ERROR oslo.messaging._drivers.impl_rabbit [-] [af127c91-79ba-43b3-8803-17d8812793ac] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 07:47:10.506320 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=20 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:47:10.507084 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=44 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:47:10.511916 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-5d770752-caba-42db-a31b-56d33be26960 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:10.512762 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-5d770752-caba-42db-a31b-56d33be26960 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:10.521353 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d770752-caba-42db-a31b-56d33be26960 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:10.521865 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d770752-caba-42db-a31b-56d33be26960 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:10.522617 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d770752-caba-42db-a31b-56d33be26960 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:10.523053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-5d770752-caba-42db-a31b-56d33be26960 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:10.655425 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-5d770752-caba-42db-a31b-56d33be26960 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:10.663455 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-5d770752-caba-42db-a31b-56d33be26960 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.159706 Jun 20 07:47:10.664013 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1523/2924] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:10 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:11.682670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c18de3a5-7a0f-44db-9b8f-6d778375806f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:11.683376 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c18de3a5-7a0f-44db-9b8f-6d778375806f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:11.690618 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c18de3a5-7a0f-44db-9b8f-6d778375806f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:11.691100 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c18de3a5-7a0f-44db-9b8f-6d778375806f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:11.691881 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c18de3a5-7a0f-44db-9b8f-6d778375806f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:11.692351 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c18de3a5-7a0f-44db-9b8f-6d778375806f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:11.695853 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9088376-3f70-40e7-983c-295a551cf81c] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33034. Jun 20 07:47:11.825922 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c18de3a5-7a0f-44db-9b8f-6d778375806f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:11.833398 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c18de3a5-7a0f-44db-9b8f-6d778375806f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.156013 Jun 20 07:47:11.833960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1402/2925] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:11 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:12.599417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:47:12.599417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:47:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:47:12.850508 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-ba5441d5-bd5e-4bf7-bb39-324be3f22f4d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:12.851091 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-ba5441d5-bd5e-4bf7-bb39-324be3f22f4d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:12.862971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] [af127c91-79ba-43b3-8803-17d8812793ac] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33042. Jun 20 07:47:12.864393 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba5441d5-bd5e-4bf7-bb39-324be3f22f4d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:12.864834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba5441d5-bd5e-4bf7-bb39-324be3f22f4d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:12.865598 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba5441d5-bd5e-4bf7-bb39-324be3f22f4d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:12.866025 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-ba5441d5-bd5e-4bf7-bb39-324be3f22f4d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:12.998669 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-ba5441d5-bd5e-4bf7-bb39-324be3f22f4d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:13.006692 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-ba5441d5-bd5e-4bf7-bb39-324be3f22f4d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.160220 Jun 20 07:47:13.007253 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1524/2926] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:12 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:14.023512 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ce7e5afb-ac40-4e3e-9fd8-e3cd7a2f0cba tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:14.024150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ce7e5afb-ac40-4e3e-9fd8-e3cd7a2f0cba tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:14.030848 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce7e5afb-ac40-4e3e-9fd8-e3cd7a2f0cba tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:14.031293 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce7e5afb-ac40-4e3e-9fd8-e3cd7a2f0cba tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:14.032050 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce7e5afb-ac40-4e3e-9fd8-e3cd7a2f0cba tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:14.032508 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ce7e5afb-ac40-4e3e-9fd8-e3cd7a2f0cba tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:14.165960 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ce7e5afb-ac40-4e3e-9fd8-e3cd7a2f0cba tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:14.174080 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ce7e5afb-ac40-4e3e-9fd8-e3cd7a2f0cba tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.154445 Jun 20 07:47:14.174635 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1403/2927] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:14 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:15.190690 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0003d48f-b1bc-4623-b7c5-c7c4e7b0bfd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:15.191296 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0003d48f-b1bc-4623-b7c5-c7c4e7b0bfd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:15.197682 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0003d48f-b1bc-4623-b7c5-c7c4e7b0bfd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:15.198125 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0003d48f-b1bc-4623-b7c5-c7c4e7b0bfd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:15.198873 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0003d48f-b1bc-4623-b7c5-c7c4e7b0bfd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:15.199309 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0003d48f-b1bc-4623-b7c5-c7c4e7b0bfd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:15.329120 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0003d48f-b1bc-4623-b7c5-c7c4e7b0bfd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:15.336521 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0003d48f-b1bc-4623-b7c5-c7c4e7b0bfd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.150230 Jun 20 07:47:15.337081 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1525/2928] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:15 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:16.353835 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ee2dc56e-2172-405b-b26c-ed510026bc4f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:16.354458 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ee2dc56e-2172-405b-b26c-ed510026bc4f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:16.361457 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee2dc56e-2172-405b-b26c-ed510026bc4f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:16.361912 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee2dc56e-2172-405b-b26c-ed510026bc4f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:16.362672 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee2dc56e-2172-405b-b26c-ed510026bc4f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:16.363116 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ee2dc56e-2172-405b-b26c-ed510026bc4f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:16.492829 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ee2dc56e-2172-405b-b26c-ed510026bc4f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:16.501294 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ee2dc56e-2172-405b-b26c-ed510026bc4f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.150655 Jun 20 07:47:16.501859 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1404/2929] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:16 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:17.518382 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-0ee832a4-ab11-48ae-8cb8-57c0d50f658c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:17.518992 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-0ee832a4-ab11-48ae-8cb8-57c0d50f658c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:17.525442 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ee832a4-ab11-48ae-8cb8-57c0d50f658c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:17.525889 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ee832a4-ab11-48ae-8cb8-57c0d50f658c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:17.526641 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ee832a4-ab11-48ae-8cb8-57c0d50f658c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:17.527073 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-0ee832a4-ab11-48ae-8cb8-57c0d50f658c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:17.655387 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-0ee832a4-ab11-48ae-8cb8-57c0d50f658c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:17.663348 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-0ee832a4-ab11-48ae-8cb8-57c0d50f658c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.148882 Jun 20 07:47:17.663913 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1526/2930] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:17 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:18.680854 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ecb943ef-8f6e-4acb-bbf9-b7181c60e64f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:18.681444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ecb943ef-8f6e-4acb-bbf9-b7181c60e64f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:18.688514 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecb943ef-8f6e-4acb-bbf9-b7181c60e64f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:18.688976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecb943ef-8f6e-4acb-bbf9-b7181c60e64f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:18.689733 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecb943ef-8f6e-4acb-bbf9-b7181c60e64f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:18.690173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecb943ef-8f6e-4acb-bbf9-b7181c60e64f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:18.821645 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ecb943ef-8f6e-4acb-bbf9-b7181c60e64f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:18.829077 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ecb943ef-8f6e-4acb-bbf9-b7181c60e64f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.152227 Jun 20 07:47:18.829628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1405/2931] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:18 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:19.845850 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-3554833f-2c10-4566-821f-9d8c08c91ba7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:19.846460 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-3554833f-2c10-4566-821f-9d8c08c91ba7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:19.853005 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3554833f-2c10-4566-821f-9d8c08c91ba7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:19.853459 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3554833f-2c10-4566-821f-9d8c08c91ba7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:19.854254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3554833f-2c10-4566-821f-9d8c08c91ba7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:19.854696 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-3554833f-2c10-4566-821f-9d8c08c91ba7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:19.980562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-3554833f-2c10-4566-821f-9d8c08c91ba7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:19.987886 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-3554833f-2c10-4566-821f-9d8c08c91ba7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.145970 Jun 20 07:47:19.988483 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1527/2932] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:19 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:21.005934 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c819dcbf-3ae7-4e5a-bf2d-536718c0a6aa tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:21.006497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c819dcbf-3ae7-4e5a-bf2d-536718c0a6aa tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:21.013427 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c819dcbf-3ae7-4e5a-bf2d-536718c0a6aa tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:21.013878 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c819dcbf-3ae7-4e5a-bf2d-536718c0a6aa tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:21.014658 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c819dcbf-3ae7-4e5a-bf2d-536718c0a6aa tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:21.015095 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c819dcbf-3ae7-4e5a-bf2d-536718c0a6aa tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:21.205386 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c819dcbf-3ae7-4e5a-bf2d-536718c0a6aa tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:21.212879 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c819dcbf-3ae7-4e5a-bf2d-536718c0a6aa tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.211008 Jun 20 07:47:21.213451 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1406/2933] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:21 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:47:22.229694 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-7bd19abf-17db-498f-84d1-46af34cbcf2d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:22.230306 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-7bd19abf-17db-498f-84d1-46af34cbcf2d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:22.237023 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7bd19abf-17db-498f-84d1-46af34cbcf2d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:22.237473 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7bd19abf-17db-498f-84d1-46af34cbcf2d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:22.238261 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7bd19abf-17db-498f-84d1-46af34cbcf2d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:22.238695 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-7bd19abf-17db-498f-84d1-46af34cbcf2d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:22.368867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-7bd19abf-17db-498f-84d1-46af34cbcf2d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:22.377193 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-7bd19abf-17db-498f-84d1-46af34cbcf2d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.151344 Jun 20 07:47:22.377817 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1528/2934] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:22 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:23.394064 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-92e055c0-b099-41ad-862a-6026b14413d3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:23.394681 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-92e055c0-b099-41ad-862a-6026b14413d3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:23.401109 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92e055c0-b099-41ad-862a-6026b14413d3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:23.401555 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92e055c0-b099-41ad-862a-6026b14413d3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:23.402336 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92e055c0-b099-41ad-862a-6026b14413d3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:23.402774 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92e055c0-b099-41ad-862a-6026b14413d3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:23.536090 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-92e055c0-b099-41ad-862a-6026b14413d3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:23.543502 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-92e055c0-b099-41ad-862a-6026b14413d3 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1569 microversion: 2.1 time: 0.153327 Jun 20 07:47:23.544058 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1407/2935] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:23 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:23.559942 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-90e1c181-9c48-4411-8461-b9cb03da9e3c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:47:23.560562 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-90e1c181-9c48-4411-8461-b9cb03da9e3c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:23.566935 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90e1c181-9c48-4411-8461-b9cb03da9e3c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:23.567377 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90e1c181-9c48-4411-8461-b9cb03da9e3c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:23.568165 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90e1c181-9c48-4411-8461-b9cb03da9e3c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:23.568606 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-90e1c181-9c48-4411-8461-b9cb03da9e3c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:23.666923 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-90e1c181-9c48-4411-8461-b9cb03da9e3c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "POST /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c/action" status: 202 len: 0 microversion: 2.1 time: 0.110432 Jun 20 07:47:23.667640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1529/2936] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 07:47:23 2022] POST /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:47:23.677123 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f143428e-a904-489c-8b94-4d45021f36e6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:23.677756 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f143428e-a904-489c-8b94-4d45021f36e6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:23.683798 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f143428e-a904-489c-8b94-4d45021f36e6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:23.684289 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f143428e-a904-489c-8b94-4d45021f36e6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:23.685046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f143428e-a904-489c-8b94-4d45021f36e6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:23.685479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f143428e-a904-489c-8b94-4d45021f36e6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:23.816897 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f143428e-a904-489c-8b94-4d45021f36e6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:23.824670 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f143428e-a904-489c-8b94-4d45021f36e6 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1517 microversion: 2.1 time: 0.151502 Jun 20 07:47:23.825232 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1408/2937] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:23 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:24.841499 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-798d928b-406f-432c-9d88-85daf00b8c52 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:24.842053 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-798d928b-406f-432c-9d88-85daf00b8c52 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:24.849851 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-798d928b-406f-432c-9d88-85daf00b8c52 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:24.850294 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-798d928b-406f-432c-9d88-85daf00b8c52 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:24.851037 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-798d928b-406f-432c-9d88-85daf00b8c52 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:24.851461 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-798d928b-406f-432c-9d88-85daf00b8c52 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:24.988769 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-798d928b-406f-432c-9d88-85daf00b8c52 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:24.997341 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-798d928b-406f-432c-9d88-85daf00b8c52 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1575 microversion: 2.1 time: 0.159718 Jun 20 07:47:24.997901 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1530/2938] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:24 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 07:47:26.014173 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1040195f-f3a8-4648-85a3-656c0a09be5d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:26.014787 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1040195f-f3a8-4648-85a3-656c0a09be5d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:26.021780 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1040195f-f3a8-4648-85a3-656c0a09be5d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:26.022225 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1040195f-f3a8-4648-85a3-656c0a09be5d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:26.022970 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1040195f-f3a8-4648-85a3-656c0a09be5d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:26.023404 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1040195f-f3a8-4648-85a3-656c0a09be5d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:26.151491 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1040195f-f3a8-4648-85a3-656c0a09be5d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:26.159086 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1040195f-f3a8-4648-85a3-656c0a09be5d tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1575 microversion: 2.1 time: 0.148724 Jun 20 07:47:26.159657 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1409/2939] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:26 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:27.175971 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-da1fe4b4-e9ab-47d9-b94a-550f817a86eb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:27.176619 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-da1fe4b4-e9ab-47d9-b94a-550f817a86eb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:27.183085 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da1fe4b4-e9ab-47d9-b94a-550f817a86eb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:27.183527 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da1fe4b4-e9ab-47d9-b94a-550f817a86eb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:27.184318 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da1fe4b4-e9ab-47d9-b94a-550f817a86eb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:27.184754 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-da1fe4b4-e9ab-47d9-b94a-550f817a86eb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:27.317867 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-da1fe4b4-e9ab-47d9-b94a-550f817a86eb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:27.325274 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-da1fe4b4-e9ab-47d9-b94a-550f817a86eb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1575 microversion: 2.1 time: 0.153186 Jun 20 07:47:27.325834 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1531/2940] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:27 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:28.144497 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a8352af0-d500-4d30-b3b1-2eedccfbb612 req-fb708a63-01c0-41b2-b44b-e4d387128fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a6fa7-3934-4582-940f-2daa3938fb0c", "name": "network-vif-unplugged", "status": "completed", "tag": "a96690da-2d7c-4454-8e1c-d68e84d3a51d"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:47:28.153082 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a8352af0-d500-4d30-b3b1-2eedccfbb612 req-fb708a63-01c0-41b2-b44b-e4d387128fa6 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:28.153535 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a8352af0-d500-4d30-b3b1-2eedccfbb612 req-fb708a63-01c0-41b2-b44b-e4d387128fa6 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:28.164712 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a8352af0-d500-4d30-b3b1-2eedccfbb612 req-fb708a63-01c0-41b2-b44b-e4d387128fa6 service nova] Creating event network-vif-unplugged:a96690da-2d7c-4454-8e1c-d68e84d3a51d for instance a19a6fa7-3934-4582-940f-2daa3938fb0c on hv-cinder-77819 Jun 20 07:47:28.169569 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a8352af0-d500-4d30-b3b1-2eedccfbb612 req-fb708a63-01c0-41b2-b44b-e4d387128fa6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029426 Jun 20 07:47:28.170150 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1410/2941] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:47:28.342590 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-941355c5-322d-4bbc-ba52-99cbba3d0cd7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:28.343137 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-941355c5-322d-4bbc-ba52-99cbba3d0cd7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:28.349608 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-941355c5-322d-4bbc-ba52-99cbba3d0cd7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:28.350060 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-941355c5-322d-4bbc-ba52-99cbba3d0cd7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:28.350818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-941355c5-322d-4bbc-ba52-99cbba3d0cd7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:28.351254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-941355c5-322d-4bbc-ba52-99cbba3d0cd7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:28.478328 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-941355c5-322d-4bbc-ba52-99cbba3d0cd7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:28.486345 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-941355c5-322d-4bbc-ba52-99cbba3d0cd7 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1575 microversion: 2.1 time: 0.147619 Jun 20 07:47:28.486914 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1532/2942] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:28 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:29.504710 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b19a92a5-547d-4d10-af60-a18e87d37c5e tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:29.505408 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b19a92a5-547d-4d10-af60-a18e87d37c5e tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:29.511533 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b19a92a5-547d-4d10-af60-a18e87d37c5e tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:29.511976 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b19a92a5-547d-4d10-af60-a18e87d37c5e tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:29.512761 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b19a92a5-547d-4d10-af60-a18e87d37c5e tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:29.513192 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b19a92a5-547d-4d10-af60-a18e87d37c5e tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:29.645646 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b19a92a5-547d-4d10-af60-a18e87d37c5e tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:29.652982 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b19a92a5-547d-4d10-af60-a18e87d37c5e tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1575 microversion: 2.1 time: 0.153484 Jun 20 07:47:29.653536 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1411/2943] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:29 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:30.669858 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6075da89-1235-4a8a-bced-43aeefbe964c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:30.670440 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-6075da89-1235-4a8a-bced-43aeefbe964c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:30.677396 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6075da89-1235-4a8a-bced-43aeefbe964c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:30.677846 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6075da89-1235-4a8a-bced-43aeefbe964c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:30.678605 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6075da89-1235-4a8a-bced-43aeefbe964c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:30.679043 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-6075da89-1235-4a8a-bced-43aeefbe964c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:30.808642 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-6075da89-1235-4a8a-bced-43aeefbe964c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:30.816800 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6075da89-1235-4a8a-bced-43aeefbe964c tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1575 microversion: 2.1 time: 0.150899 Jun 20 07:47:30.817368 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1533/2944] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:30 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:31.834215 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b595d218-fc05-4882-bb76-43449dd292bb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:31.834838 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b595d218-fc05-4882-bb76-43449dd292bb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:31.841415 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b595d218-fc05-4882-bb76-43449dd292bb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:31.841867 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b595d218-fc05-4882-bb76-43449dd292bb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:31.842628 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b595d218-fc05-4882-bb76-43449dd292bb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:31.843067 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b595d218-fc05-4882-bb76-43449dd292bb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:31.969676 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b595d218-fc05-4882-bb76-43449dd292bb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:31.977553 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b595d218-fc05-4882-bb76-43449dd292bb tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1575 microversion: 2.1 time: 0.147211 Jun 20 07:47:31.978153 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1412/2945] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:31 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:32.995151 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-fb79ac18-c35a-4aa7-bc05-25e5b005582a tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:47:32.995684 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-fb79ac18-c35a-4aa7-bc05-25e5b005582a tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:47:33.002539 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb79ac18-c35a-4aa7-bc05-25e5b005582a tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:33.002981 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb79ac18-c35a-4aa7-bc05-25e5b005582a tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:33.003741 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb79ac18-c35a-4aa7-bc05-25e5b005582a tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:33.004203 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-fb79ac18-c35a-4aa7-bc05-25e5b005582a tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:33.140011 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-fb79ac18-c35a-4aa7-bc05-25e5b005582a tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:47:33.148890 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-fb79ac18-c35a-4aa7-bc05-25e5b005582a tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1562 microversion: 2.1 time: 0.158264 Jun 20 07:47:33.149462 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1534/2946] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:47:32 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:47:36.189655 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-3cf95d86-6b2b-4702-8108-b1acd8cdc7cf req-fca043f5-d59a-4daf-8a41-35328efca570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a6fa7-3934-4582-940f-2daa3938fb0c", "name": "network-vif-plugged", "status": "completed", "tag": "a96690da-2d7c-4454-8e1c-d68e84d3a51d"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:47:36.198528 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-3cf95d86-6b2b-4702-8108-b1acd8cdc7cf req-fca043f5-d59a-4daf-8a41-35328efca570 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:47:36.199059 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-3cf95d86-6b2b-4702-8108-b1acd8cdc7cf req-fca043f5-d59a-4daf-8a41-35328efca570 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:47:36.210607 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-3cf95d86-6b2b-4702-8108-b1acd8cdc7cf req-fca043f5-d59a-4daf-8a41-35328efca570 service nova] Creating event network-vif-plugged:a96690da-2d7c-4454-8e1c-d68e84d3a51d for instance a19a6fa7-3934-4582-940f-2daa3938fb0c on hv-cinder-77819 Jun 20 07:47:36.215507 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-3cf95d86-6b2b-4702-8108-b1acd8cdc7cf req-fca043f5-d59a-4daf-8a41-35328efca570 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029499 Jun 20 07:47:36.216088 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1413/2947] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:48:46.079640 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_api:SELECT=26 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:48:46.080428 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG dbcounter [-] [117607] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:48:46.085998 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-e6779c84-a0ab-40cc-9711-684762677aea tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:48:46.086580 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e6779c84-a0ab-40cc-9711-684762677aea tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:48:46.086821 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=26 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:48:46.087560 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 07:48:46.096045 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6779c84-a0ab-40cc-9711-684762677aea tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:46.097000 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6779c84-a0ab-40cc-9711-684762677aea tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:46.097432 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6779c84-a0ab-40cc-9711-684762677aea tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:46.098074 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-e6779c84-a0ab-40cc-9711-684762677aea tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:46.125517 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-e6779c84-a0ab-40cc-9711-684762677aea tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Going to try to terminate instance {{(pid=117607) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 07:48:46.158368 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-41c3a9cc-7445-4aa2-be9b-7255fd308675 req-583be71f-34e0-4c69-b608-5ff4873c795f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19a6fa7-3934-4582-940f-2daa3938fb0c", "tag": "a96690da-2d7c-4454-8e1c-d68e84d3a51d"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:48:46.166624 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-41c3a9cc-7445-4aa2-be9b-7255fd308675 req-583be71f-34e0-4c69-b608-5ff4873c795f service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:46.167203 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-41c3a9cc-7445-4aa2-be9b-7255fd308675 req-583be71f-34e0-4c69-b608-5ff4873c795f service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:46.179996 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-41c3a9cc-7445-4aa2-be9b-7255fd308675 req-583be71f-34e0-4c69-b608-5ff4873c795f service nova] Creating event network-changed:a96690da-2d7c-4454-8e1c-d68e84d3a51d for instance a19a6fa7-3934-4582-940f-2daa3938fb0c on hv-cinder-77819 Jun 20 07:48:46.185823 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-41c3a9cc-7445-4aa2-be9b-7255fd308675 req-583be71f-34e0-4c69-b608-5ff4873c795f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105187 Jun 20 07:48:46.187534 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1414/2948] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:48:46.223175 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-e6779c84-a0ab-40cc-9711-684762677aea tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 204 len: 0 microversion: 2.1 time: 0.145278 Jun 20 07:48:46.224004 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1535/2949] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 07:48:46 2022] DELETE /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 07:48:46.232675 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ceeab525-dea8-4068-98be-9653df389cd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:48:46.233385 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ceeab525-dea8-4068-98be-9653df389cd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:48:46.240417 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ceeab525-dea8-4068-98be-9653df389cd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:46.240872 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ceeab525-dea8-4068-98be-9653df389cd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:46.241846 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ceeab525-dea8-4068-98be-9653df389cd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:46.242283 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ceeab525-dea8-4068-98be-9653df389cd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:46.428987 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ceeab525-dea8-4068-98be-9653df389cd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:48:46.436481 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ceeab525-dea8-4068-98be-9653df389cd8 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.207963 Jun 20 07:48:46.437046 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1415/2950] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:48:46 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:48:47.454675 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-903a07a5-225e-48d8-bf6c-343b3c7375e1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:48:47.455384 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-903a07a5-225e-48d8-bf6c-343b3c7375e1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:48:47.461944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-903a07a5-225e-48d8-bf6c-343b3c7375e1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:47.462392 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-903a07a5-225e-48d8-bf6c-343b3c7375e1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:47.463166 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-903a07a5-225e-48d8-bf6c-343b3c7375e1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:47.463604 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-903a07a5-225e-48d8-bf6c-343b3c7375e1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:47.662827 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-903a07a5-225e-48d8-bf6c-343b3c7375e1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:48:47.670254 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-903a07a5-225e-48d8-bf6c-343b3c7375e1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1568 microversion: 2.1 time: 0.219801 Jun 20 07:48:47.670818 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1536/2951] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:48:47 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:48:48.212767 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a037ee24-eadb-4b9e-a301-bc144574b28d req-6fe39d25-f2f6-40ea-be12-aa2e933527b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a6fa7-3934-4582-940f-2daa3938fb0c", "name": "network-vif-deleted", "tag": "a96690da-2d7c-4454-8e1c-d68e84d3a51d"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 07:48:48.220679 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a037ee24-eadb-4b9e-a301-bc144574b28d req-6fe39d25-f2f6-40ea-be12-aa2e933527b7 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:48.221131 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a037ee24-eadb-4b9e-a301-bc144574b28d req-6fe39d25-f2f6-40ea-be12-aa2e933527b7 service nova] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:48.231444 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a037ee24-eadb-4b9e-a301-bc144574b28d req-6fe39d25-f2f6-40ea-be12-aa2e933527b7 service nova] Creating event network-vif-deleted:a96690da-2d7c-4454-8e1c-d68e84d3a51d for instance a19a6fa7-3934-4582-940f-2daa3938fb0c on hv-cinder-77819 Jun 20 07:48:48.236162 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a037ee24-eadb-4b9e-a301-bc144574b28d req-6fe39d25-f2f6-40ea-be12-aa2e933527b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085381 Jun 20 07:48:48.236718 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1416/2952] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 07:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 07:48:48.688482 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-28702878-5cb0-4e4f-bdc6-97ec15514a17 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:48:48.689021 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.compute.api [None req-28702878-5cb0-4e4f-bdc6-97ec15514a17 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117607) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:48:48.696079 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28702878-5cb0-4e4f-bdc6-97ec15514a17 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:48.696571 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28702878-5cb0-4e4f-bdc6-97ec15514a17 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:48.697377 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28702878-5cb0-4e4f-bdc6-97ec15514a17 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:48.697809 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28702878-5cb0-4e4f-bdc6-97ec15514a17 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:48.728012 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28702878-5cb0-4e4f-bdc6-97ec15514a17 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:48.728494 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG oslo_concurrency.lockutils [None req-28702878-5cb0-4e4f-bdc6-97ec15514a17 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:48.728944 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.objects.instance [None req-28702878-5cb0-4e4f-bdc6-97ec15514a17 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lazy-loading 'fault' on Instance uuid a19a6fa7-3934-4582-940f-2daa3938fb0c {{(pid=117607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 07:48:48.773190 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.policy [None req-28702878-5cb0-4e4f-bdc6-97ec15514a17 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bf639c83d4d0ea6f908f3e1f3772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5446ee5342d42a4a39476d540fb03d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117607) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 07:48:48.780643 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-28702878-5cb0-4e4f-bdc6-97ec15514a17 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 200 len: 1225 microversion: 2.1 time: 0.096767 Jun 20 07:48:48.781544 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1537/2953] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:48:48 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 07:48:49.797874 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ce4a2a8-8790-420d-a9e7-d588f259b0b1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:48:49.798573 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3ce4a2a8-8790-420d-a9e7-d588f259b0b1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] [instance: a19a6fa7-3934-4582-940f-2daa3938fb0c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 07:48:49.804786 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ce4a2a8-8790-420d-a9e7-d588f259b0b1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:49.805234 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ce4a2a8-8790-420d-a9e7-d588f259b0b1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:49.805983 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ce4a2a8-8790-420d-a9e7-d588f259b0b1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 07:48:49.806420 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ce4a2a8-8790-420d-a9e7-d588f259b0b1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Lock "2fa5826d-163d-47a7-aeb4-e55abc7a6a21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 07:48:49.819604 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-3ce4a2a8-8790-420d-a9e7-d588f259b0b1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] HTTP exception thrown: Instance a19a6fa7-3934-4582-940f-2daa3938fb0c could not be found. Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ce4a2a8-8790-420d-a9e7-d588f259b0b1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Request method failure captured: Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c HTTP/1.1 Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Host: 10.222.0.23 Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisCVlCIpAYhXk-n7PyTJaSD-y_m4JYeVcNzi5ZIC71rRTebGPqPNTwj3gCmQcz0oym9u-KgEVEa_v_AyCR_eK-BSEmHAeu6UQFdjf7z2PaC-Z19npTiPew4IalBFhTu3oZRdDXmCICTnyDrXDG-tK1gxgpWmGKRptv_3Qq7AFPaHG8lw Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Id: c5446ee5342d42a4a39476d540fb03d0 Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestShelveInstance-495833685 Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 07:48:49.821213 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 07:48:49.822636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c5446ee5342d42a4a39476d540fb03d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5446ee5342d42a4a39476d540fb03d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c5446ee5342d42a4a39476d540fb03d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5446ee5342d42a4a39476d540fb03d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 20 07:48:49.822636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestShelveInstance-495833685 Jun 20 07:48:49.822636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Id: c5446ee5342d42a4a39476d540fb03d0 Jun 20 07:48:49.822636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestShelveInstance-495833685 Jun 20 07:48:49.822636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User: tempest-TestShelveInstance-495833685-project Jun 20 07:48:49.822636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 07:48:49.822636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 07:48:49.822636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Id: 8a6bf639c83d4d0ea6f908f3e1f3772c Jun 20 07:48:49.822636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestShelveInstance-495833685-project Jun 20 07:48:49.822636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: method: > Jun 20 07:48:49.822636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: exception: Instance a19a6fa7-3934-4582-940f-2daa3938fb0c could not be found. Jun 20 07:48:49.822636 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: action_args: {'id': 'a19a6fa7-3934-4582-940f-2daa3938fb0c'} Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a19a6fa7-3934-4582-940f-2daa3938fb0c could not be found. Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 07:48:49.823479 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a19a6fa7-3934-4582-940f-2daa3938fb0c could not be found. Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a19a6fa7-3934-4582-940f-2daa3938fb0c could not be found. Jun 20 07:48:49.824864 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 07:48:49.826027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ce4a2a8-8790-420d-a9e7-d588f259b0b1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Returning 404 to user: Instance a19a6fa7-3934-4582-940f-2daa3938fb0c could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 07:48:49.826027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3ce4a2a8-8790-420d-a9e7-d588f259b0b1 tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c" status: 404 len: 111 microversion: 2.1 time: 0.029383 Jun 20 07:48:49.826027 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1417/2954] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 07:48:49 2022] GET /compute/v2.1/servers/a19a6fa7-3934-4582-940f-2daa3938fb0c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 07:48:49.976424 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: DEBUG nova.api.openstack.wsgi [None req-6a850262-46a8-437a-bef8-40c922165c4f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] Calling method '.version_select at 0x7ffa303ce4c0>' {{(pid=117607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 07:48:49.994143 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO nova.api.openstack.requestlog [None req-6a850262-46a8-437a-bef8-40c922165c4f tempest-TestShelveInstance-495833685 tempest-TestShelveInstance-495833685-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1403787706" status: 202 len: 0 microversion: 2.1 time: 0.021608 Jun 20 07:48:49.994722 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: [pid: 117607|app: 0|req: 1538/2955] 10.222.0.23 () {58 vars in 1253 bytes} [Mon Jun 20 07:48:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1403787706 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 07:50:25.655784 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:50:25.656346 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:50:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:50:32.607863 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:50:32.608522 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:50:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:50:32.832680 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:50:32.833170 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:50:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:52:05.152964 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:52:05.153651 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:52:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:53:45.663791 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:53:45.664412 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:53:52.615836 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:53:52.616427 dv-cinder-778193-28-iscsi devstack@n-api.service[117606]: Mon Jun 20 07:53:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 07:53:52.840807 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 07:53:52.841265 dv-cinder-778193-28-iscsi devstack@n-api.service[117607]: Mon Jun 20 07:53:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!